00000100:00100000:2.0:1789303867.521336:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789303867.521348:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785463552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789303867.521359:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303867.521364:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312945b2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312945ab expref: 19 pid: 5845 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521374:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312945b2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312945ab expref: 19 pid: 5845 timeout: 1467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521388:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294653 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521396:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294653 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521409:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294653 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521416:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294653 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521422:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294653 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521429:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294653 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521434:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789303867.521439:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294653 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521447:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294653 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521463:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294653 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303867.521472:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789303867.526043:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785463552:12345-0@lo:103:ldlm_bl.0 Request processed in 4684us (5028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303867.526061:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789303868.180326:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785463680 00000100:00100000:1.0:1789303868.180405:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1789303868.180414:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785463680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789303868.180451:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303868.181282:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785463680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 864us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303868.181292:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1789303868.184834:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785463680:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789303868.882158:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789303868.882165:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789303868.882170:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789303868.882226:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303868.882245:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303868.882258:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303868.882283:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785463808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789303868.882360:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303868.882412:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b024b5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789303868.883184:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785463808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303868.883200:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303868.883218:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303868.883251:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789303868.883256:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303868.883264:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303869.717707:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785464320:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.717785:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303869.717851:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789303869.717858:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785463936:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.717887:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303869.717913:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785464448:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.717936:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303869.717963:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785464064:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.717985:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303869.718004:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785464576:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.718029:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303869.718048:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789303869.718053:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785464192:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.718073:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303869.718124:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785464320 00000100:00100000:2.0:1789303869.718132:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785464320 00000100:00100000:2.0:1789303869.718184:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785464448 00000100:00100000:2.0:1789303869.718187:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785464448 00000100:00100000:2.0:1789303869.718221:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785464064 00000100:00100000:2.0:1789303869.718224:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785464064 00000100:00100000:2.0:1789303869.718241:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1789303869.718250:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785464320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.718304:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785464320:12345-0@lo:400:kworker.0 Request processed in 54us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303869.718311:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1789303869.718329:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1789303869.718336:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785464448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.718361:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785464448:12345-0@lo:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303869.718367:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1789303869.718377:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1789303869.718383:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785464064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.718411:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785464064:12345-0@lo:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303869.718417:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1789303869.718434:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785463936 00000100:00100000:2.0:1789303869.718438:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785463936 00000100:00100000:2.0:1789303869.718475:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1789303869.718483:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785463936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.719131:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785463936:12345-0@lo:400:kworker.0 Request processed in 645us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303869.719140:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1789303869.719184:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785464576 00000100:00100000:2.0:1789303869.719190:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785464576 00000100:00100000:2.0:1789303869.719219:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785464192 00000100:00100000:2.0:1789303869.719230:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785464192 00000100:00100000:2.0:1789303869.719254:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1789303869.719260:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785464576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.719317:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785464576:12345-0@lo:400:kworker.0 Request processed in 58us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303869.719323:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1789303869.719333:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1789303869.719339:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785464192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.719365:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785464192:12345-0@lo:400:kworker.0 Request processed in 27us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303869.719371:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00080000:2.0:1789303869.719391:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789303869.719395:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789303869.719398:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303869.719441:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785464192:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.719451:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785464064:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.719460:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785464576:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.719501:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785463936:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.719628:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785464448:0@lo:400:kworker.0 00000100:00100000:2.0:1789303869.719645:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785464320:0@lo:400:kworker.0 00000100:00100000:2.0:1789303870.217144:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:2.0:1789303870.220930:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303870.221687:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303870.221943:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765376128 00000100:00100000:1.0:1789303870.221954:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765376128 00000100:00100000:1.0:1789303870.222006:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 390 00000100:00100000:1.0:1789303870.222015:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:34998:x1876219765376128:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789303870.222065:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789303870.222110:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129466f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffed3 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303870.222128:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312945ce) 00010000:00010000:1.0:1789303870.222132:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:1.0:1789303870.222142:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789303870.222183:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294676 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303870.222196:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303870.222205:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789303870.258487:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064df5ab1 reply state 000000004db12fca transno 4294967455 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303870.258530:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789303870.258547:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00010000:00080000:1.0:1789303870.258655:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789303870.258674:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:34998:x1876219765376128:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 36656us (36988us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789303870.258683:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 390 00010000:00010000:1.0:1789303870.745636:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789303871.058056:0:58832:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe62afe740 20000000:00000080:2.0:1789303871.058084:0:58832:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c07c61400 uarg=0000000000000000 00010000:00010000:2.0:1789303871.058647:0:58832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789303871.058665:0:58832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789303871.058678:0:58832:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789303871.058698:0:58832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303871.058717:0:58832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294661 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129465a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303871.058724:0:58832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303871.058764:0:58832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294661 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129465a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303871.058777:0:58832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294661 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129465a expref: 18 pid: 5845 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303871.058791:0:58832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58832:1876219785464704:0@lo:104: 00000100:00100000:2.0:1789303871.058849:0:58832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303871.058899:0:58832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b024b5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789303871.060955:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785464704 00000100:00100000:1.0:1789303871.060971:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785464704 00000100:00100000:1.0:1789303871.061052:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789303871.061063:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:58832:x1876219785464704:12345-0@lo:104: 00010000:00010000:1.0:1789303871.061081:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.061358:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789303871.061365:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:58832:x1876219785464704:12345-0@lo:104: Request processed in 305us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303871.061372:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00010000:00010000:1.0:1789303871.061397:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303871.061402:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.061409:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789303871.061425:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.061433:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789303871.061468:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789303871.061473:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789303871.061511:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.061518:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789303871.061536:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.061543:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb723129465a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294661 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.061562:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303871.061564:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303871.061566:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303871.062525:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785464832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789303871.062578:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303871.062703:0:58832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58832:1876219785464704:0@lo:104: 00010000:00010000:2.0:1789303871.062724:0:58832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303871.067427:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785464832 00000100:00100000:1.0:1789303871.067446:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785464832 00010000:00010000:1.0:1789303871.067507:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294661 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129465a expref: 19 pid: 5845 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303871.067587:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789303871.067597:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785464832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789303871.067613:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303871.067620:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294661 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129465a expref: 19 pid: 5845 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.067634:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294661 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129465a expref: 19 pid: 5845 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.067669:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294661 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129465a expref: 19 pid: 5845 timeout: 1470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.067683:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.067692:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.067710:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.067718:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.067735:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.067743:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.067749:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303871.067753:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.067762:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303871.070210:0:58832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303871.070477:0:58832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.071319:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.071346:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb723129467d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303871.071368:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789303871.072009:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785464832:12345-0@lo:103:ldlm_bl.0 Request processed in 4407us (9424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303871.072021:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789303872.274640:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785464960 00000100:00100000:1.0:1789303872.274649:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785464960 00000100:00100000:1.0:1789303872.274730:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1789303872.274741:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785464960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789303872.274782:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303872.274841:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785464960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303872.274849:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1789303872.274924:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785464960:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789303872.355966:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789303872.796505:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303872.928686:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785465088 00000100:00100000:2.0:1789303872.928697:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785465088 00000100:00100000:2.0:1789303872.928746:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:2.0:1789303872.928756:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785465088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303872.928771:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303872.928789:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129468b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294684 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303872.928820:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129468b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294684 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303872.928833:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129468b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294684 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303872.928843:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc400, rc 0) 00000100:00100000:2.0:1789303872.928894:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785465088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303872.928902:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1789303873.303180:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785465216 00000100:00100000:1.0:1789303873.303188:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785465216 00000100:00100000:1.0:1789303873.303251:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1789303873.303259:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785465216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789303873.303292:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303873.303345:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785465216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303873.303351:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:1.0:1789303873.303397:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1789303873.303402:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c385c4a80, transno 4294967322 00000100:00100000:1.0:1789303873.303418:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785465216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789303873.800743:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:1.0:1789303873.814837:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303873.816544:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303873.819796:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765377024 00000100:00100000:2.0:1789303873.819808:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765377024 00000100:00100000:2.0:1789303873.819875:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 393 00000100:00100000:2.0:1789303873.819885:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:35076:x1876219765377024:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789303873.819905:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303873.819930:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312946c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860ffee8 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820015:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312946ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820032:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312946ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820045:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312946ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820062:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312946d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820069:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312946d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820075:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312946d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820171:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312946ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820178:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312946ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820185:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312946ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820191:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303873.820196:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312946ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820215:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312946ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820227:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:2.0:1789303873.820230:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303873.820236:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312946ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820242:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312946ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820257:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312946d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820262:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312946d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820268:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312946d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820272:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303873.820275:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312946d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820281:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312946d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820288:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff9e2c2e92af00) 00010000:00010000:2.0:1789303873.820290:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303873.820292:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312946d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820305:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312946d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820338:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312946c3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffee8 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820346:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:2.0:1789303873.820349:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303873.820352:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312946c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffee8 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303873.820360:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecca00, rc 0) 00000100:00100000:2.0:1789303873.820423:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:35076:x1876219765377024:12345-192.168.202.29@tcp:101:touch.0 Request processed in 539us (684us total) trans 0 rc 301/301 00000100:00100000:2.0:1789303873.820443:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 393 00000100:00080000:1.0:1789303874.847698:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1789303875.584058:0:59078:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd688ed060 20000000:00000080:1.0:1789303875.584078:0:59078:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c38468400 uarg=0000000000000000 00010000:00010000:1.0:1789303875.584892:0:59078:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789303875.584929:0:59078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:1.0:1789303875.584933:0:59078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789303875.584944:0:59078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312946a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffeda expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303875.584969:0:59078:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789303875.584986:0:59078:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789303875.585000:0:59078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8f400/0xefc0bb72312946ed lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 59078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303875.585014:0:59078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129468b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294684 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303875.585022:0:59078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8f400/0xefc0bb72312946ed lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 59078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303875.585059:0:59078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129468b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294684 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303875.585073:0:59078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129468b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294684 expref: 18 pid: 5846 timeout: 1475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303875.585444:0:59078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59078:1876219785466112:0@lo:104: 00000100:00100000:1.0:1789303875.585507:0:59078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303875.585612:0:59078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c079789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789303875.585664:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785466112 00000100:00100000:2.0:1789303875.585672:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785466112 00000100:00100000:2.0:1789303875.585758:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789303875.585770:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:59078:x1876219785466112:12345-0@lo:104: 00010000:00010000:2.0:1789303875.585785:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231294684 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129468b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303875.585865:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303875.585872:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:59078:x1876219785466112:12345-0@lo:104: Request processed in 105us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303875.585879:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00010000:2.0:1789303875.860530:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303876.887114:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303876.947692:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785466368 00000100:00100000:2.0:1789303876.947701:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785466368 00000100:00100000:2.0:1789303876.947785:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:2.0:1789303876.947796:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785466368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303876.947808:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303876.947823:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312946fb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312946f4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303876.947847:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312946fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312946f4 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303876.947858:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312946fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312946f4 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303876.947867:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd600, rc 0) 00000100:00100000:2.0:1789303876.947927:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785466368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303876.947934:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00080000:1.0:1789303877.414066:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789303877.479793:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765377280 00000100:00100000:1.0:1789303877.479804:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765377280 00000100:00100000:1.0:1789303877.479851:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 825 00000100:00100000:1.0:1789303877.479859:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765377280:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303877.479933:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765377280:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303877.479941:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 825 00000100:00080000:1.0:1789303877.479981:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789303877.480011:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789303878.300811:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765377664 00000100:00100000:1.0:1789303878.300824:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765377664 00000100:00100000:1.0:1789303878.300894:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 395 00000100:00100000:1.0:1789303878.300905:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:35163:x1876219765377664:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789303878.300926:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789303878.300949:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860ffef6 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303878.301015:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303878.301030:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303878.301054:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789303878.301105:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:1.0:1789303878.301109:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789303878.301130:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303878.301156:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffef6 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303878.301176:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffef6 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303878.301185:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c03db3900) 00010000:00010000:1.0:1789303878.301187:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789303878.301191:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e600, rc 0) 00000100:00100000:1.0:1789303878.301248:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:35163:x1876219765377664:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 346us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303878.301318:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 395 00000100:00100000:1.0:1789303878.303051:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303878.303226:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 396 00000100:00100000:1.0:1789303878.303238:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:35163:x1876219765377920:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789303878.303296:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789303878.303319:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294709 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffef6 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303878.303342:0:5852:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312946a7) 00010000:00010000:1.0:1789303878.303346:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c03db3900) 00010000:00010000:1.0:1789303878.303356:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789303878.303377:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303878.303397:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303878.303407:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789303878.303823:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dab21be reply state 000000006092a63a transno 4294967456 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303878.303834:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789303878.303842:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000100:00100000:1.0:1789303878.304072:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:35163:x1876219765377920:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 835us (1028us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789303878.304080:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 396 00010000:00010000:2.0:1789303878.305992:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.306008:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.306015:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.306022:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303878.306026:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.306042:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.306057:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c03db3100) 00010000:00010000:2.0:1789303878.306060:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789303878.306066:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.306072:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294710 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303878.419268:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785466624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303878.419343:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789303878.419779:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789303878.423049:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785466624:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1789303878.810732:0:59274:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff9f0d17c0 20000000:00000080:2.0:1789303878.810749:0:59274:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c062a7c00 uarg=0000000000000000 00010000:00010000:2.0:1789303878.810967:0:59274:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789303878.810983:0:59274:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789303878.810996:0:59274:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789303878.811016:0:59274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294717 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 59274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.811034:0:59274:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312946fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312946f4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.811042:0:59274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294717 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 59274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.811079:0:59274:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312946fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312946f4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.811291:0:59274:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312946fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312946f4 expref: 18 pid: 5845 timeout: 1478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303878.811427:0:59274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59274:1876219785466752:0@lo:104: 00000100:00100000:2.0:1789303878.811489:0:59274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303878.811579:0:59274:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c411e9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789303878.813789:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785466880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789303878.814904:0:59274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312946fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312946f4 expref: 18 pid: 5845 timeout: 1478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303878.814920:0:59274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59274:1876219785466752:0@lo:104: 00010000:00010000:2.0:1789303878.814934:0:59274:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294717 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.814942:0:59274:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294717 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.814947:0:59274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294717 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.814953:0:59274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294717 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303878.930433:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303879.955690:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785467008:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.955760:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303879.955811:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785467520:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.955837:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303879.955865:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789303879.955882:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785467136:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.955907:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303879.955925:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785467648:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.955946:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303879.955972:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785467392:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.955992:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303879.956010:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789303879.956015:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785467264:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956036:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303879.956066:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785467008 00000100:00100000:1.0:1789303879.956074:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785467008 00000100:00100000:1.0:1789303879.956146:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1789303879.956165:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785467008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956217:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785467008:12345-0@lo:400:kworker.0 Request processed in 63us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303879.956224:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1789303879.956255:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785467520 00000100:00100000:1.0:1789303879.956258:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785467520 00000100:00100000:1.0:1789303879.956291:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785467136 00000100:00100000:1.0:1789303879.956295:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785467136 00000100:00100000:1.0:1789303879.956310:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785467392 00000100:00100000:1.0:1789303879.956313:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785467392 00000100:00100000:1.0:1789303879.956329:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1789303879.956335:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785467520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956365:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785467520:12345-0@lo:400:kworker.0 Request processed in 30us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303879.956385:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1789303879.956406:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1789303879.956412:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785467136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956619:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785467136:12345-0@lo:400:kworker.0 Request processed in 207us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303879.956627:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1789303879.956640:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1789303879.956646:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785467392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956676:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785467392:12345-0@lo:400:kworker.0 Request processed in 31us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303879.956682:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1789303879.956704:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785467648 00000100:00100000:1.0:1789303879.956707:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785467648 00000100:00100000:1.0:1789303879.956734:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785467264 00000100:00100000:1.0:1789303879.956737:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785467264 00000100:00100000:1.0:1789303879.956754:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1789303879.956760:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785467648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956788:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785467648:12345-0@lo:400:kworker.0 Request processed in 29us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303879.956794:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1789303879.956803:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:1.0:1789303879.956808:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785467264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956833:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785467264:12345-0@lo:400:kworker.0 Request processed in 25us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303879.956838:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00080000:1.0:1789303879.956862:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789303879.956866:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789303879.956904:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785467264:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956925:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785467392:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956954:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785467136:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956963:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785467648:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956970:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785467008:0@lo:400:kworker.0 00000100:00100000:1.0:1789303879.956978:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785467520:0@lo:400:kworker.0 00000100:00100000:1.0:1789303881.274021:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:1.0:1789303881.275550:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789303881.284331:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765378176 00000100:00100000:1.0:1789303881.284342:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765378176 00000100:00100000:1.0:1789303881.284419:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 197 00000100:00100000:1.0:1789303881.284429:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:35247:x1876219765378176:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789303881.284790:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:35247:x1876219765378176:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 361us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303881.284798:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 197 00000100:00100000:1.0:1789303881.287042:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765378304 00000100:00100000:1.0:1789303881.287051:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765378304 00000100:00100000:1.0:1789303881.287153:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 198 00000100:00100000:1.0:1789303881.287161:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876219765378304:12345-192.168.202.29@tcp:8:lfs.0 00010000:00080000:1.0:1789303881.287194:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1330 last 0 00000020:00000080:1.0:1789303881.287225:0:17212:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb723129472c 00002000:00100000:1.0:1789303881.287236:0:17212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b02d15800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789303881.287257:0:17212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789303881.287491:0:17212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789303881.287524:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2b02d16000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789303881.287588:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765378304:12345-192.168.202.29@tcp:8:lfs.0 Request processed in 425us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303881.287596:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 198 00000100:00100000:1.0:1789303881.288937:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303881.293494:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765378560 00000100:00100000:1.0:1789303881.293504:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765378560 00000100:00100000:1.0:1789303881.293560:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 398 00000100:00100000:1.0:1789303881.293571:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:35247:x1876219765378560:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789303881.294011:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:35247:x1876219765378560:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 441us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303881.294018:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 398 00000100:00100000:1.0:1789303881.298980:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765378688 00000100:00100000:1.0:1789303881.298990:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765378688 00000100:00100000:1.0:1789303881.299038:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 399 00000100:00100000:1.0:1789303881.299047:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:35247:x1876219765378688:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789303881.299158:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:35247:x1876219765378688:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303881.299165:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 399 00000100:00100000:2.0:1789303881.305325:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303881.305522:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765378944 00000100:00100000:1.0:1789303881.305531:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765378944 00000100:00100000:1.0:1789303881.305614:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 201 00000100:00100000:1.0:1789303881.305623:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:35247:x1876219765378944:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789303881.305907:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:35247:x1876219765378944:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 286us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303881.305922:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 201 00000100:00100000:2.0:1789303881.307199:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303881.351702:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765379200 00000100:00100000:1.0:1789303881.351711:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765379200 00000100:00100000:1.0:1789303881.351762:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 401 00000100:00100000:1.0:1789303881.351769:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:35251:x1876219765379200:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:1.0:1789303881.351792:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789303881.351812:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294733 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860ffefd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.351870:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129473a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.351882:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129473a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.351892:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129473a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.351900:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294741 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.351904:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.351909:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352207:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294748 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352227:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352234:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789303881.352256:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:1.0:1789303881.352260:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789303881.352277:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352288:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129473a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352294:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129473a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352301:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129473a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352305:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303881.352309:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129473a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352316:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129473a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352327:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c03db3b00) 00010000:00010000:1.0:1789303881.352329:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303881.352334:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129473a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352351:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129473a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352376:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352382:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294741 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352388:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352393:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303881.352396:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352521:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294741 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352533:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c03db3400) 00010000:00010000:1.0:1789303881.352535:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303881.352538:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294741 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352544:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294741 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352573:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294733 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffefd expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352584:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffefd expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.352593:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c03db3200) 00010000:00010000:1.0:1789303881.352595:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789303881.352597:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ee00, rc 0) 00000100:00100000:1.0:1789303881.352675:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:35251:x1876219765379200:12345-192.168.202.29@tcp:101:dd.0 Request processed in 906us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303881.352680:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 401 00000100:00100000:2.0:1789303881.356466:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:1.0:1789303881.363697:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129475d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.363718:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129475d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.363726:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129475d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.363732:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303881.363737:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129475d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.363745:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129475d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.363762:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff9e2c2ea19c00) 00010000:00010000:1.0:1789303881.363765:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303881.363772:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129475d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303881.363777:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129475d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303881.363857:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765379584 00000100:00100000:2.0:1789303881.363866:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765379584 00000100:00100000:2.0:1789303881.363908:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 202 00000100:00100000:2.0:1789303881.363919:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:35251:x1876219765379584:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:2.0:1789303881.363936:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303881.363951:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5d7944e/0xefc0bb7231294772 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff0b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789303881.363970:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789303881.363988:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=1331s v=(0 0) 00010000:00010000:2.0:1789303881.363991:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789303881.363998:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d7944e/0xefc0bb7231294772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff0b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303881.364010:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5d7944e/0xefc0bb7231294772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff0b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303881.364017:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecde00, rc 0) 00000100:00100000:2.0:1789303881.364067:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:35251:x1876219765379584:12345-192.168.202.29@tcp:101:dd.0 Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303881.364071:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 202 00000100:00100000:1.0:1789303881.381917:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303881.383350:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765379712 00000100:00100000:2.0:1789303881.383376:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765379712 00002000:00100000:2.0:1789303881.383445:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (0->1048575) req@ffff9e2c03619f80 x1876219765379712/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:702/0 lens 488/0 e 0 to 0 dl 1789303892 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789303881.383457:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c03619f80 with x1876219765379712 ext(0->1048575) 00002000:00010000:2.0:1789303881.383463:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c03619f80 00000100:00100000:2.0:1789303881.383552:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:2.0:1789303881.383562:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765379712:12345-192.168.202.29@tcp:4:dd.0 00000001:00100000:2.0:1789303881.444855:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:1.0:1789303881.447144:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765379712:12345-192.168.202.29@tcp:4:dd.0 Request processed in 63573us (65223us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789303881.447158:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00002000:00100000:1.0:1789303881.447171:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xd:0x0] (0->1048575) req@ffff9e2c03619f80 x1876219765379712/t4294967321(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:702/0 lens 488/448 e 0 to 0 dl 1789303892 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789303881.447181:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c03619f80 with x1876219765379712 ext(0->1048575) 00002000:00010000:1.0:1789303881.447187:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c03619f80 00000100:00100000:1.0:1789303881.449370:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303881.449509:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765379840 00000100:00100000:2.0:1789303881.449519:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765379840 00000100:00100000:2.0:1789303881.449591:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 403 00000100:00100000:2.0:1789303881.449603:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:35251:x1876219765379840:12345-192.168.202.29@tcp:44:dd.0 00000100:00100000:1.0:1789303881.467616:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:35251:x1876219765379840:12345-192.168.202.29@tcp:44:dd.0 Request processed in 18011us (18260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303881.467626:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 403 00000100:00100000:1.0:1789303881.469376:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765379968 00000100:00100000:1.0:1789303881.469387:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765379968 00000100:00100000:1.0:1789303881.469546:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 203 00000100:00100000:1.0:1789303881.469557:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2357:x1876219765379968:12345-192.168.202.29@tcp:16:dd.0 00000001:00080000:2.0:1789303881.512116:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1789303881.512307:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765379968:12345-192.168.202.29@tcp:16:dd.0 Request processed in 42745us (43024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303881.512318:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 203 00000100:00100000:1.0:1789303881.514550:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765380224 00000100:00100000:1.0:1789303881.514559:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765380224 00000100:00100000:1.0:1789303881.514606:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00100000:1.0:1789303881.514615:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:35251:x1876219765380224:12345-192.168.202.29@tcp:35:dd.0 00000100:00100000:1.0:1789303881.515008:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:35251:x1876219765380224:12345-192.168.202.29@tcp:35:dd.0 Request processed in 393us (590us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789303881.515037:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 45 00010000:00010000:2.0:1789303882.002575:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789303882.484744:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000100:00100000:1.0:1789303882.596505:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303882.596561:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303882.596565:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765380352 00000100:00100000:2.0:1789303882.596577:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765380352 00000100:00100000:1.0:1789303882.596602:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303882.596627:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 828 00000100:00100000:2.0:1789303882.596650:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765380352:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303882.596661:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303882.596687:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765380480 00000100:00100000:1.0:1789303882.596692:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765380480 00000100:00100000:2.0:1789303882.596728:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765380352:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303882.596732:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 903 00000100:00100000:2.0:1789303882.596744:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 828 00000100:00100000:1.0:1789303882.596746:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765380480:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303882.596788:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765380480:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 46us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303882.596794:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 903 00000100:00100000:1.0:1789303882.596818:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765380608 00000100:00100000:1.0:1789303882.596821:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765380608 00000100:00100000:1.0:1789303882.596841:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765380736 00000100:00100000:1.0:1789303882.596844:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765380736 00000100:00100000:1.0:1789303882.596862:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 606 00000100:00100000:1.0:1789303882.596868:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765380608:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303882.596896:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765380608:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303882.596902:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 606 00000100:00100000:1.0:1789303882.596914:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 607 00000100:00100000:1.0:1789303882.596920:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765380736:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303882.596942:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765380736:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303882.596958:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 607 00010000:00010000:1.0:1789303883.028324:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303883.539318:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789303883.539352:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785468032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789303883.539418:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303883.539479:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785468032 00000100:00100000:1.0:1789303883.539487:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785468032 00000100:00100000:1.0:1789303883.539539:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1789303883.539549:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785468032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789303883.539582:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303883.539637:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785468032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303883.539644:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00080000:1.0:1789303883.539664:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789303883.539700:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785468032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303885.085793:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785468288 00000100:00100000:2.0:1789303885.085797:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785468288 00000100:00100000:2.0:1789303885.085832:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785468544 00000100:00100000:2.0:1789303885.085835:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785468544 00000100:00100000:2.0:1789303885.085863:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:2.0:1789303885.085870:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785468288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303885.085904:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785468288:12345-0@lo:400:kworker.0 Request processed in 35us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303885.085910:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:2.0:1789303885.085922:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1789303885.085927:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785468544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303885.085955:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785468544:12345-0@lo:400:kworker.0 Request processed in 27us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303885.085968:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1789303885.086434:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785468672 00000100:00100000:2.0:1789303885.086438:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785468672 00000100:00100000:2.0:1789303885.086466:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1789303885.086472:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785468672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303885.086502:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785468672:12345-0@lo:400:kworker.0 Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303885.086507:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1789303885.128270:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765381120 00000100:00100000:2.0:1789303885.128281:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765381120 00000100:00100000:2.0:1789303885.128416:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 205 00000100:00100000:2.0:1789303885.128431:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:35444:x1876219765381120:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789303885.128807:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:35444:x1876219765381120:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 380us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303885.128815:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 205 00000100:00100000:1.0:1789303885.152468:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765381632 00000100:00100000:1.0:1789303885.152479:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765381632 00000100:00100000:1.0:1789303885.152562:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 207 00000100:00100000:1.0:1789303885.152575:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:35444:x1876219765381632:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789303885.153262:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:35444:x1876219765381632:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 517us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303885.153272:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 207 00000100:00100000:1.0:1789303885.156496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303885.231944:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765382016 00000100:00100000:2.0:1789303885.231954:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765382016 00000100:00100000:2.0:1789303885.232018:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 408 00000100:00100000:2.0:1789303885.232028:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:35448:x1876219765382016:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789303885.232114:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303885.232145:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231294764 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff04 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.232163:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:2.0:1789303885.232176:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789303885.232212:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294779 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.232233:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294779 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.232245:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294779 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.232260:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.232268:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.232275:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.232597:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294787 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.232607:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294787 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.232614:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294787 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789303885.233490:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 64 off9024 00000004:00080000:2.0:1789303885.233500:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1334911409235ns, next at 1335911407360ns, rc = 0 00010000:00010000:2.0:1789303885.233580:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233592:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233610:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233619:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233626:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233632:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233656:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789303885.233676:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294787 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233683:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294787 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233690:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294787 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303885.233691:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789303885.233700:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303885.233702:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233705:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294787 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233715:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294787 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303885.233724:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789303885.233732:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9e2c2e92a600) 00010000:00010000:1.0:1789303885.233732:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.233738:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789303885.233750:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294787 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.234871:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294787 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.234899:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294779 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.234906:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294779 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.234912:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294779 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.234918:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303885.234921:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294779 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.234927:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294779 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.234939:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c03db3200) 00010000:00010000:2.0:1789303885.234942:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303885.234946:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294779 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.234952:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294779 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789303885.234963:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070b6275a reply state 0000000092cf4964 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303885.234984:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789303885.235721:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:35448:x1876219765382016:12345-192.168.202.29@tcp:36:rm.0 Request processed in 3687us (3899us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789303885.235731:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 408 00010000:00010000:1.0:1789303885.236754:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303885.236777:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9e2c2e92a600) 00010000:00010000:1.0:1789303885.236781:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789303885.236786:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303885.236793:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129478e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303885.236819:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303885.236821:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303885.236823:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303885.240334:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.240352:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.240360:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.240372:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303885.240377:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.240384:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.240399:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff9e2c2e92a700) 00010000:00010000:2.0:1789303885.240402:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303885.240408:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303885.240413:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294780 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303887.634830:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785468928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789303887.634910:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789303887.635333:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789303887.635387:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785468928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789303887.647131:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765382144 00000100:00100000:2.0:1789303887.647142:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765382144 00010000:00010000:2.0:1789303887.647242:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d7944e/0xefc0bb7231294772 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff0b expref: 6 pid: 6692 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303887.647289:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 273 00000100:00100000:2.0:1789303887.647311:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765382144:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789303887.647327:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303887.647333:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5d7944e/0xefc0bb7231294772 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff0b expref: 6 pid: 6692 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303887.647360:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5d7944e/0xefc0bb7231294772 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff0b expref: 6 pid: 6692 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303887.647388:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5d7944e/0xefc0bb7231294772 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff0b expref: 6 pid: 6692 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303887.647409:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789303887.647413:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789303887.647419:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294795 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303887.647429:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294795 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303887.647467:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789303887.647529:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765382144:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 231us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303887.647537:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 273 00000100:00080000:1.0:1789303887.649185:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789303887.650115:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789303887.650127:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303887.650141:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789303887.650146:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303887.650158:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294795 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303887.650180:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294795 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303887.650188:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294795 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303887.650211:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303887.650213:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303887.650215:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789303887.720692:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789303887.720704:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789303888.673322:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785469312 00000100:00100000:2.0:1789303888.673343:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785469312 00000100:00100000:2.0:1789303888.673419:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1789303888.673429:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785469312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789303888.673465:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789303888.673518:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785469312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303888.673525:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1789303888.673595:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785469312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789303890.207426:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785469440:0@lo:400:kworker.0 00010000:00010000:2.0:1789303891.222279:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303892.754478:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789303892.754502:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785470208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789303892.754575:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303892.754647:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785470208 00000100:00100000:2.0:1789303892.754656:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785470208 00000100:00100000:2.0:1789303892.754711:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1789303892.754721:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785470208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789303892.754763:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789303892.754811:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785470208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303892.754818:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1789303892.754855:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789303892.754860:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b011f4e00, transno 4294967322 00000100:00100000:2.0:1789303892.754876:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785470208:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789303892.838065:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789303892.860377:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765382912 00000100:00100000:1.0:1789303892.860398:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765382912 00000100:00100000:1.0:1789303892.860477:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765383040 00000100:00100000:1.0:1789303892.860480:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765383040 00000100:00100000:1.0:1789303892.860524:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 613 00000100:00100000:1.0:1789303892.860534:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765382912:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303892.860620:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765382912:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 88us (25245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303892.860628:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 613 00000100:00100000:1.0:1789303892.860644:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 614 00000100:00100000:1.0:1789303892.860650:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765383040:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303892.860672:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765383040:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 23us (24784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303892.860677:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 614 00000100:00080000:2.0:1789303892.862325:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789303892.862333:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789303893.275207:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303893.778709:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785470336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789303893.778787:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789303893.779271:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789303893.779316:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785470336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789303894.293523:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303895.318491:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785470720:0@lo:400:kworker.0 00000100:00100000:2.0:1789303895.318567:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303895.318639:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789303895.318646:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785470592:0@lo:400:kworker.0 00000100:00100000:2.0:1789303895.318672:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303895.318691:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785471104:0@lo:400:kworker.0 00000100:00100000:2.0:1789303895.318729:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303895.318765:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785470720 00000100:00100000:2.0:1789303895.318776:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785470720 00000100:00100000:2.0:1789303895.318845:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785471104 00000100:00100000:2.0:1789303895.318848:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785471104 00000100:00100000:2.0:1789303895.318867:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1789303895.318878:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785470720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303895.318955:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785470720:12345-0@lo:400:kworker.0 Request processed in 79us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303895.318963:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1789303895.318980:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1789303895.318986:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785471104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303895.319011:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785471104:12345-0@lo:400:kworker.0 Request processed in 25us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303895.319017:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1789303895.319033:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785470592 00000100:00100000:2.0:1789303895.319036:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785470592 00000100:00100000:2.0:1789303895.319059:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1789303895.319065:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785470592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303895.319140:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785470592:12345-0@lo:400:kworker.0 Request processed in 75us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303895.319147:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00080000:2.0:1789303895.319162:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789303895.319165:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789303895.319196:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785470592:0@lo:400:kworker.0 00000100:00100000:2.0:1789303895.319206:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785471104:0@lo:400:kworker.0 00000100:00100000:2.0:1789303895.319237:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785470720:0@lo:400:kworker.0 00000100:00100000:2.0:1789303895.321570:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785470464 00000100:00100000:2.0:1789303895.321575:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785470464 00000100:00100000:2.0:1789303895.321601:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:2.0:1789303895.321605:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785470464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303895.321638:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785470464:12345-0@lo:400:kworker.0 Request processed in 33us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303895.321642:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00080000:2.0:1789303895.321661:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303895.321674:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785470464:0@lo:400:kworker.0 00010000:00010000:2.0:1789303896.339223:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303897.363572:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303897.874473:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789303897.874497:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785471232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789303897.874562:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303897.874659:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785471232 00000100:00100000:2.0:1789303897.874668:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785471232 00000100:00100000:2.0:1789303897.874720:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1789303897.874730:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785471232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789303897.874763:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789303897.874985:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789303897.890594:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785471232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15857us (16022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303897.890610:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1789303897.895158:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785471232:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789303897.962983:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789303897.969715:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789303897.969719:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789303898.901343:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785471360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303898.901432:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789303898.903811:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789303899.410463:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303900.434726:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785471616:0@lo:400:kworker.0 00000100:00100000:1.0:1789303900.434824:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303900.434890:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785472128:0@lo:400:kworker.0 00000100:00100000:1.0:1789303900.434919:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303900.434947:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789303900.434967:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785471744:0@lo:400:kworker.0 00000100:00100000:1.0:1789303900.434990:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303900.435025:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785471616 00000100:00100000:1.0:1789303900.435032:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785471616 00000100:00100000:1.0:1789303900.435117:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1789303900.435127:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785471616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303900.435196:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785471616:12345-0@lo:400:kworker.0 Request processed in 70us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303900.435204:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1789303900.435243:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785472128 00000100:00100000:1.0:1789303900.435247:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785472128 00000100:00100000:1.0:1789303900.435280:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785471744 00000100:00100000:1.0:1789303900.435283:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785471744 00000100:00100000:1.0:1789303900.435306:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1789303900.435313:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785472128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303900.435356:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785472128:12345-0@lo:400:kworker.0 Request processed in 43us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303900.435363:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1789303900.435375:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1789303900.435381:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785471744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303900.435408:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785471744:12345-0@lo:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303900.435413:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00080000:1.0:1789303900.435442:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789303900.435446:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789303900.438370:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785471744:0@lo:400:kworker.0 00000100:00100000:1.0:1789303900.438392:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785471616:0@lo:400:kworker.0 00000100:00100000:1.0:1789303900.438403:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785472128:0@lo:400:kworker.0 00010000:00010000:2.0:1789303902.484877:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303902.994679:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785472256 00000100:00100000:2.0:1789303902.994688:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785472256 00000100:00100000:2.0:1789303902.994773:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1789303902.994783:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785472256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789303902.994823:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789303902.994872:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785472256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303902.994879:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1789303903.079928:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765383680 00000100:00100000:1.0:1789303903.079940:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765383680 00000100:00100000:1.0:1789303903.080005:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 836 00000100:00100000:1.0:1789303903.080015:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765383680:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303903.080081:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765383680:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 68us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303903.080087:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 836 00000100:00100000:1.0:1789303903.080704:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765383808 00000100:00100000:1.0:1789303903.080708:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765383808 00000100:00100000:1.0:1789303903.080763:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 919 00000100:00100000:1.0:1789303903.080770:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765383808:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303903.080814:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765383808:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303903.080820:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 919 00000100:00080000:2.0:1789303903.080941:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789303903.082564:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789303903.082569:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789303904.019079:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785472384 00000100:00100000:1.0:1789303904.019124:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785472384 00000100:00080000:2.0:1789303904.019226:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789303904.019243:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1789303904.019255:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785472384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789303904.019299:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303904.019361:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785472384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303904.019378:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1789303904.130792:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303904.136651:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303904.136688:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765384320 00000100:00100000:2.0:1789303904.136697:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765384320 00000100:00100000:2.0:1789303904.136816:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 209 00000100:00100000:2.0:1789303904.136829:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:35666:x1876219765384320:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789303904.139297:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:35666:x1876219765384320:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 2462us (2645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303904.139310:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 209 00010000:00010000:1.0:1789303904.562440:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303905.575859:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785472896:0@lo:400:kworker.0 00000100:00100000:2.0:1789303905.575911:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303905.575948:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785472896 00000100:00100000:2.0:1789303905.575954:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785472896 00000100:00100000:2.0:1789303905.575996:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:2.0:1789303905.576004:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785472896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303905.576051:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785472896:12345-0@lo:400:kworker.0 Request processed in 48us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303905.576058:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00080000:2.0:1789303905.576109:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789303905.576385:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789303905.576398:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785473152:0@lo:400:kworker.0 00000100:00100000:1.0:1789303905.576429:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303905.577643:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785473152 00000100:00100000:2.0:1789303905.577647:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785473152 00000100:00100000:2.0:1789303905.577679:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:2.0:1789303905.577686:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785473152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303905.577736:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785473152:12345-0@lo:400:kworker.0 Request processed in 51us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303905.577742:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1789303905.579632:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785472896:0@lo:400:kworker.0 00010000:00010000:2.0:1789303905.618536:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789303906.923372:0:59932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe00fdecc0 20000000:00000080:1.0:1789303906.923388:0:59932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3846b400 uarg=0000000000000000 00010000:00010000:1.0:1789303906.923831:0:59932:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789303906.923864:0:59932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c03db3200) 00010000:00010000:1.0:1789303906.923868:0:59932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789303906.923880:0:59932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffefd expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303906.923901:0:59932:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789303906.923918:0:59932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789303906.923934:0:59932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303906.923946:0:59932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294725 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129471e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303906.923954:0:59932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303906.923989:0:59932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294725 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129471e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303906.924014:0:59932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294725 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129471e expref: 18 pid: 5847 timeout: 1506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303906.924028:0:59932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38463480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59932:1876219785473280:0@lo:104: 00000100:00100000:1.0:1789303906.924115:0:59932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303906.928545:0:59932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c079789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789303906.936556:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789303906.936587:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785473280 00000100:00100000:2.0:1789303906.936598:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785473280 00000100:00100000:2.0:1789303906.936669:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789303906.936680:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c412e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:59932:x1876219785473280:12345-0@lo:104: 00010000:00010000:2.0:1789303906.936700:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129471e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294725 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.937582:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303906.937589:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c412e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:59932:x1876219785473280:12345-0@lo:104: Request processed in 911us (13499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303906.937597:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789303906.937714:0:59932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38463480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59932:1876219785473280:0@lo:104: 00010000:00010000:1.0:1789303906.937739:0:59932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303906.939392:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785473408 00000100:00100000:2.0:1789303906.939404:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785473408 00010000:00010000:2.0:1789303906.939437:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294725 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129471e expref: 19 pid: 5847 timeout: 1506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303906.939474:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789303906.939483:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785473408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789303906.939497:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303906.939513:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294725 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129471e expref: 19 pid: 5847 timeout: 1506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.939527:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294725 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129471e expref: 19 pid: 5847 timeout: 1506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.939545:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294725 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129471e expref: 19 pid: 5847 timeout: 1506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.939560:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.939569:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.939584:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.939591:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.939599:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.939606:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.939612:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789303906.939617:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.939625:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303906.946441:0:59932:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303906.946463:0:59932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.949207:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.949227:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129479c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303906.949253:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789303906.949355:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785473408:12345-0@lo:103:ldlm_bl.0 Request processed in 9869us (11332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303906.949367:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00010000:2.0:1789303907.678564:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303908.200805:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303908.200873:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303908.200915:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765385600 00000100:00100000:1.0:1789303908.200925:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765385600 00000100:00100000:1.0:1789303908.201241:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 625 00000100:00100000:1.0:1789303908.201253:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765385600:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303908.201327:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765385600:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303908.201334:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 625 00000100:00080000:1.0:1789303908.201357:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789303908.202220:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765385344 00000100:00100000:2.0:1789303908.202229:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765385344 00000100:00100000:2.0:1789303908.202294:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 923 00000100:00100000:2.0:1789303908.202304:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765385344:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303908.202354:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765385344:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 54us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303908.202360:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 923 00000100:00080000:2.0:1789303908.202380:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1789303908.562264:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789303908.562272:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789303908.562277:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789303908.562333:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303908.562346:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303908.562358:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303908.562398:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785473664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789303908.562464:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303908.562836:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110ea180 going to sleep for 11 seconds 00000100:00100000:2.0:1789303908.564989:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785473664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303908.565007:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303908.565017:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303908.565037:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789303908.565042:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303908.565049:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303909.138928:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789303909.138965:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785473792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789303909.139037:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789303909.140245:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789303910.677724:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785473920:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.677806:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303910.677856:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785474432:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.677885:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303910.677914:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789303910.677921:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785474048:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.677941:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303910.677959:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785474560:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.677992:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303910.678023:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785474176:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678048:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303910.678070:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789303910.678076:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785474304:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678262:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303910.678300:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785473920 00000100:00100000:2.0:1789303910.678308:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785473920 00000100:00100000:2.0:1789303910.678357:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:2.0:1789303910.678367:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785473920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678420:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785473920:12345-0@lo:400:kworker.0 Request processed in 54us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303910.678427:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:2.0:1789303910.678458:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785474432 00000100:00100000:2.0:1789303910.678462:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785474432 00000100:00100000:2.0:1789303910.678497:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785474048 00000100:00100000:2.0:1789303910.678500:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785474048 00000100:00100000:2.0:1789303910.678515:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785474304 00000100:00100000:2.0:1789303910.678517:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785474304 00000100:00100000:2.0:1789303910.678533:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1789303910.678538:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785474432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678570:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785474432:12345-0@lo:400:kworker.0 Request processed in 32us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303910.678576:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1789303910.678587:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1789303910.678592:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785474048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678618:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785474048:12345-0@lo:400:kworker.0 Request processed in 25us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303910.678636:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1789303910.678648:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:2.0:1789303910.678654:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785474304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678693:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785474304:12345-0@lo:400:kworker.0 Request processed in 40us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303910.678698:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:2.0:1789303910.678718:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785474560 00000100:00100000:2.0:1789303910.678722:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785474560 00000100:00100000:2.0:1789303910.678744:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785474176 00000100:00100000:2.0:1789303910.678747:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785474176 00000100:00100000:2.0:1789303910.678764:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1789303910.678770:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785474560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678801:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785474560:12345-0@lo:400:kworker.0 Request processed in 32us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303910.678806:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1789303910.678817:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1789303910.678824:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785474176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678848:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785474176:12345-0@lo:400:kworker.0 Request processed in 25us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303910.678853:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1789303910.678906:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785474304:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678916:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785474176:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678943:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785474048:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678954:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785474560:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678970:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785473920:0@lo:400:kworker.0 00000100:00100000:2.0:1789303910.678978:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785474432:0@lo:400:kworker.0 00000100:00080000:1.0:1789303910.679259:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789303910.679264:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789303910.746557:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303910.907391:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:1.0:1789303910.909693:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789303910.974930:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:2.0:1789303911.725313:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785474688 00000100:00100000:2.0:1789303911.725327:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785474688 00000100:00100000:2.0:1789303911.725400:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789303911.725412:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3709a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:60129:x1876219785474688:12345-0@lo:104: 00010000:00010000:2.0:1789303911.725429:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303911.725522:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303911.725528:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3709a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:60129:x1876219785474688:12345-0@lo:104: Request processed in 120us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303911.725535:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00010000:00010000:1.0:1789303911.726251:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303911.726258:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726266:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789303911.726270:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726279:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789303911.726286:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789303911.726292:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789303911.726338:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726346:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789303911.726373:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726381:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312947a3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312947aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726416:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303911.726418:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303911.726420:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303911.726500:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785474816 00000100:00100000:1.0:1789303911.726506:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785474816 00010000:00010000:1.0:1789303911.726528:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312947aa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312947a3 expref: 19 pid: 5845 timeout: 1511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303911.726562:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789303911.726574:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785474816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789303911.726586:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303911.726591:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312947aa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312947a3 expref: 19 pid: 5845 timeout: 1511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726602:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312947aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312947a3 expref: 19 pid: 5845 timeout: 1511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726615:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312947aa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312947a3 expref: 19 pid: 5845 timeout: 1511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726628:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312947c6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726636:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312947c6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726653:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312947c6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726668:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312947c6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726673:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312947c6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726678:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312947c6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726681:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303911.726683:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312947c6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726689:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312947c6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726710:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312947c6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303911.726720:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789303911.726795:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785474816:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303911.726802:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789303911.737069:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785474816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789303911.763556:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303912.787012:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303913.234310:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789303913.234335:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785474944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789303913.234409:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789303913.242047:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789303913.317636:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765386240 00000100:00100000:2.0:1789303913.317648:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765386240 00000100:00100000:2.0:1789303913.317721:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 927 00000100:00100000:2.0:1789303913.317732:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765386240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303913.317834:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765386240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 104us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303913.317842:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 927 00000100:00100000:2.0:1789303913.317883:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765386496 00000100:00100000:2.0:1789303913.317887:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765386496 00000100:00100000:2.0:1789303913.317915:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765386368 00000100:00100000:2.0:1789303913.317917:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765386368 00000100:00100000:2.0:1789303913.317937:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 629 00000100:00100000:2.0:1789303913.317943:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765386496:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303913.317969:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765386496:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303913.317975:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 629 00000100:00100000:2.0:1789303913.317986:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 630 00000100:00100000:2.0:1789303913.317992:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765386368:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303913.318033:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765386368:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303913.318039:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 630 10000000:01000000:2.0:1789303913.747261:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789303913.747272:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789303913.747279:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789303913.747329:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303913.747343:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303913.747355:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303913.747384:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785475072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789303913.747465:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303913.747524:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05b6a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789303913.747549:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785475072 00000100:00100000:2.0:1789303913.747556:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785475072 00000100:00100000:2.0:1789303913.747607:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1789303913.747616:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785475072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303913.747630:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303913.747643:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312947d4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312947cd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303913.747669:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312947d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312947cd expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303913.747682:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312947d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312947cd expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303913.747692:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc200, rc 0) 00000100:00100000:2.0:1789303913.747734:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785475072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303913.747741:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1789303913.747808:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785475072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303913.747822:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303913.747832:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303913.747854:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789303913.747860:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303913.747878:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303914.260689:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789303914.260735:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785475200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789303914.260832:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789303914.263237:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789303914.556896:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303914.564948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303914.569283:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303914.577554:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303914.585302:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303914.586697:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:35831:x1876219765387648:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 895us (1402us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1789303914.586706:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00100000:2.0:1789303914.634809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303914.644835:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303914.655791:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303914.660251:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765388160 00000100:00100000:2.0:1789303914.660271:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765388160 00000100:00100000:2.0:1789303914.660486:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 420 00000100:00100000:2.0:1789303914.660702:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:35835:x1876219765388160:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:2.0:1789303914.660760:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789303914.660791:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129483d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff2e expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.660816:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231294821 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff27 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.660826:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:2.0:1789303914.660837:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789303914.660875:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129484b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.660889:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129484b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.660899:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129484b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.660914:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231294852 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.660920:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231294852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.660926:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231294852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.661020:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294859 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.661028:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294859 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.661035:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294859 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789303914.663534:0:30980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9088 00000004:00080000:2.0:1789303914.663549:0:30980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1364341457823ns, next at 1365341454263ns, rc = 0 00010000:00010000:2.0:1789303914.663735:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663751:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663769:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663779:0:30980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663785:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663790:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663863:0:30980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789303914.663888:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294859 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663894:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294859 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663899:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294859 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663905:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303914.663910:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294859 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663918:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294859 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663930:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9e2c2e92a200) 00010000:00010000:2.0:1789303914.663933:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789303914.663945:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294859 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663951:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294859 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663970:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129484b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663977:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129484b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663981:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129484b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663986:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303914.663989:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129484b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.663994:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129484b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.664001:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:2.0:1789303914.664004:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303914.664007:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129484b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.664012:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129484b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789303914.664023:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000779b082e reply state 00000000de437947 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231294852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303914.664054:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789303914.664191:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:35835:x1876219765388160:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 3690us (8407us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1789303914.664201:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 420 00010000:00010000:1.0:1789303914.666262:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303914.666275:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303914.666285:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303914.666289:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303914.666297:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303914.666373:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9e2c2e92a200) 00010000:00010000:1.0:1789303914.666377:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789303914.666382:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303914.666388:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294860 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303914.839255:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303915.799462:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785475712:0@lo:400:kworker.0 00000100:00100000:2.0:1789303915.799531:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303915.799584:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789303915.799590:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785475328:0@lo:400:kworker.0 00000100:00100000:2.0:1789303915.799617:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303915.799639:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785475840:0@lo:400:kworker.0 00000100:00100000:2.0:1789303915.799657:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303915.799681:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785475584:0@lo:400:kworker.0 00000100:00100000:2.0:1789303915.799705:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303915.799722:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789303915.799727:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785475456:0@lo:400:kworker.0 00000100:00100000:2.0:1789303915.799745:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303915.799762:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785475968:0@lo:400:kworker.0 00000100:00100000:2.0:1789303915.799782:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303915.803650:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785475328 00000100:00100000:2.0:1789303915.803658:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785475328 00000100:00100000:2.0:1789303915.803705:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1789303915.803713:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785475328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303915.803794:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785475328:12345-0@lo:400:kworker.0 Request processed in 81us (4175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303915.803807:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1789303915.803845:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785475584 00000100:00100000:2.0:1789303915.803849:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785475584 00000100:00100000:2.0:1789303915.803873:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785475968 00000100:00100000:2.0:1789303915.803876:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785475968 00000100:00100000:2.0:1789303915.803900:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1789303915.803906:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785475584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303915.807277:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785475584:12345-0@lo:400:kworker.0 Request processed in 3370us (7569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303915.807285:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1789303916.343064:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785476096 00000100:00100000:2.0:1789303916.343080:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785476096 00000100:00100000:2.0:1789303916.343139:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789303916.343149:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:60374:x1876219785476096:12345-0@lo:104: 00010000:00010000:2.0:1789303916.343173:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.343233:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303916.343238:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:60374:x1876219785476096:12345-0@lo:104: Request processed in 92us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303916.343245:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00010000:2.0:1789303916.343266:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789303916.343272:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.343279:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789303916.343284:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.343305:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789303916.343312:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303916.343318:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789303916.343343:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.343350:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789303916.343374:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.343382:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb72312947cd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312947d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.343397:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303916.343399:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303916.343400:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303916.343882:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785476224 00000100:00100000:2.0:1789303916.343888:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785476224 00010000:00010000:2.0:1789303916.343907:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312947d4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312947cd expref: 19 pid: 5845 timeout: 1516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303916.344002:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789303916.344010:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785476224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789303916.344020:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303916.344026:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312947d4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312947cd expref: 19 pid: 5845 timeout: 1516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344054:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312947d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312947cd expref: 19 pid: 5845 timeout: 1516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344067:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312947d4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312947cd expref: 19 pid: 5845 timeout: 1516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344213:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231294867 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344223:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231294867 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344238:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231294867 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344245:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231294867 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344252:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231294867 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344260:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231294867 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344266:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789303916.344270:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231294867 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344277:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231294867 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344302:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231294867 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.344312:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789303916.344345:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785476224:12345-0@lo:103:ldlm_bl.0 Request processed in 336us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303916.344352:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000001:00080000:2.0:1789303916.385706:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000001:00080000:2.0:1789303916.385727:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967464 is committed 00000004:00080000:2.0:1789303916.385733:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 33 committed 00000100:00100000:1.0:1789303916.386783:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785476352 00000100:00100000:1.0:1789303916.386792:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785476352 00000100:00100000:1.0:1789303916.386856:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789303916.386866:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785476352:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1789303916.386876:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1789303916.386893:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:14 count 1 00010000:00010000:1.0:1789303916.386920:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.386958:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231294844 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff35 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.386968:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789303916.387061:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789303916.387068:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.387133:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231294844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff35 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.387149:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231294844 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff35 expref: 5 pid: 6693 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303916.387161:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785476480:192.168.202.29@tcp:104: 00000100:00100000:1.0:1789303916.387574:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789303916.389507:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785476480:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789303916.389539:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303916.390023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303916.390151:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765388288 00000100:00100000:1.0:1789303916.390159:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765388288 00010000:00010000:1.0:1789303916.390203:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231294844 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff35 expref: 6 pid: 6693 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789303916.390247:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789303916.390285:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 277 00000100:00100000:1.0:1789303916.390296:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765388288:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789303916.390310:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303916.390324:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231294844 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff35 expref: 6 pid: 6693 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.390336:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231294844 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff35 expref: 6 pid: 6693 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.390360:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231294844 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff35 expref: 6 pid: 6693 timeout: 1466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.390374:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789303916.390379:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789303916.390385:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.390395:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.390522:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789303916.390584:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765388288:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 290us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303916.390591:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 277 00010000:00010000:2.0:1789303916.390632:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.390642:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.390652:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.390660:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303916.390719:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789303916.391390:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303916.391398:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.391408:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303916.391413:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.391430:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.391524:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.391532:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d250c52b/0xefc0bb723129486e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303916.391553:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303916.391556:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303916.391558:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303916.391845:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785476352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4979us (5165us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789303916.391855:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000004:00080000:1.0:1789303916.391978:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c38460000/2, rc 0, transno 4294967324 00000100:00100000:1.0:1789303916.391985:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785476352:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789303917.715225:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785476608 00000100:00100000:2.0:1789303917.715233:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785476608 00000100:00100000:2.0:1789303917.715283:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:2.0:1789303917.715293:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785476608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303917.715307:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303917.715321:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129487c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294875 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303917.715344:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129487c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294875 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303917.715356:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129487c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294875 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303917.715365:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc400, rc 0) 00000100:00100000:2.0:1789303917.715407:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785476608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303917.715413:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00010000:00010000:2.0:1789303917.906493:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303918.354984:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789303918.355007:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785476736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789303918.355272:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303918.438517:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765388416 00000100:00100000:2.0:1789303918.438522:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765388416 00000100:00100000:2.0:1789303918.438588:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 845 00000100:00100000:1.0:1789303918.438597:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765388672 00000100:00100000:2.0:1789303918.438602:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765388416:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303918.438604:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765388672 00000100:00100000:1.0:1789303918.438651:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765388800 00000100:00100000:1.0:1789303918.438656:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765388800 00000100:00100000:2.0:1789303918.438692:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765388416:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 94us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303918.438701:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 633 00000100:00100000:2.0:1789303918.438704:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 845 00000100:00100000:1.0:1789303918.438715:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765388672:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303918.438755:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765388672:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 44us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303918.438774:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 633 00000100:00100000:1.0:1789303918.438792:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 634 00000100:00100000:1.0:1789303918.438800:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765388800:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303918.438831:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765388800:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303918.438838:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 634 00010000:00010000:2.0:1789303918.937418:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303919.381819:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789303919.381851:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785476864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303919.381950:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303919.930468:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303919.939576:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765389184 00000100:00100000:1.0:1789303919.939593:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765389184 00000100:00100000:1.0:1789303919.939757:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 422 00000100:00100000:1.0:1789303919.939771:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3709a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:35923:x1876219765389184:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789303919.939992:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789303919.940040:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129488a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff3c expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303919.940254:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312947f0) 00010000:00010000:1.0:1789303919.940259:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:1.0:1789303919.940273:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789303919.940310:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303919.940327:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303919.940351:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303919.956799:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1789303920.085733:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028cd44ba reply state 000000000ed5bade transno 4294967465 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303920.085762:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789303920.085785:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000001:00080000:2.0:1789303920.086186:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967465 is committed 00010000:00080000:1.0:1789303920.086422:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789303920.086446:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3709a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:35923:x1876219765389184:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 146671us (147392us total) trans 4294967465 rc 0/0 00000100:00100000:1.0:1789303920.086457:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 422 00010000:00010000:2.0:1789303920.086547:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.086558:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.086568:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.086576:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303920.086582:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.086592:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.086611:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c03db3300) 00010000:00010000:2.0:1789303920.086614:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789303920.086620:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.086705:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294891 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303920.925753:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785477120:0@lo:400:kworker.0 00000100:00100000:2.0:1789303920.925801:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785476992:0@lo:400:kworker.0 00000100:00100000:2.0:1789303920.925968:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785477248:0@lo:400:kworker.0 00000100:00100000:2.0:1789303920.926049:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303920.926125:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789303920.926131:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785477632:0@lo:400:kworker.0 00000100:00100000:2.0:1789303920.926158:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303920.926191:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785477632 00000100:00100000:2.0:1789303920.926197:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785477632 00000100:00100000:2.0:1789303920.926246:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1789303920.926258:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785477632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303920.928856:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785477632:12345-0@lo:400:kworker.0 Request processed in 2598us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303920.928866:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000020:00000080:2.0:1789303920.990608:0:60572:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff300a05b0 20000000:00000080:2.0:1789303920.990626:0:60572:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02056c00 uarg=0000000000000000 00010000:00010000:2.0:1789303920.992318:0:60572:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789303920.992343:0:60572:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789303920.992360:0:60572:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789303920.992379:0:60572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.992395:0:60572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129487c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294875 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.992402:0:60572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.992445:0:60572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129487c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294875 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.992459:0:60572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129487c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294875 expref: 18 pid: 5846 timeout: 1520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303920.992472:0:60572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60572:1876219785477760:0@lo:104: 00000100:00100000:2.0:1789303920.992539:0:60572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303920.992582:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785477760 00000100:00100000:2.0:1789303920.992590:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785477760 00000100:00100000:2.0:1789303920.992629:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789303920.992637:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:60572:x1876219785477760:12345-0@lo:104: 00010000:00010000:2.0:1789303920.992649:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294875 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129487c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.992691:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303920.992697:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:60572:x1876219785477760:12345-0@lo:104: Request processed in 61us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303920.992704:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00010000:00010000:2.0:1789303920.992726:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789303920.992732:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294875 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129487c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.992739:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789303920.992743:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294875 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129487c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.992750:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294875 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129487c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789303920.992765:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294875 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129487c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303920.992771:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789303920.992801:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294875 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129487c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.992808:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789303920.992828:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294875 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129487c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.992834:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294875 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129487c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.992848:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303920.992850:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303920.992851:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303920.992859:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789303920.992871:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785477888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789303920.994528:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303920.994601:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785477888 00000100:00100000:2.0:1789303920.994611:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785477888 00010000:00010000:2.0:1789303920.994649:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129487c lrc: 6/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294875 expref: 19 pid: 5846 timeout: 1520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303920.994682:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789303920.994690:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03869050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785477888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789303920.994704:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303920.994718:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129487c lrc: 6/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294875 expref: 19 pid: 5846 timeout: 1520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994728:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129487c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294875 expref: 19 pid: 5846 timeout: 1520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994749:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994757:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994770:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994777:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994783:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994789:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994795:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789303920.994799:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994806:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994815:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303920.994831:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789303920.994876:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03869050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785477888:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303920.994883:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789303920.994958:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785477888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789303921.003846:0:60572:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7900 going to sleep for 10 seconds 00010000:00010000:2.0:1789303921.003898:0:60572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc400/0xefc0bb723129487c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294875 expref: 18 pid: 5846 timeout: 1520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303921.003915:0:60572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60572:1876219785477760:0@lo:104: 00010000:00010000:2.0:1789303921.003940:0:60572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303921.003949:0:60572:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303921.003955:0:60572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303921.003961:0:60572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231294898 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303922.514744:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785478016 00000100:00100000:2.0:1789303922.514753:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785478016 00000100:00100000:2.0:1789303922.514810:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1789303922.514821:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785478016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303922.514834:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303922.514856:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312948a6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129489f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303922.514878:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312948a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129489f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303922.514889:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312948a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129489f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303922.514898:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd000, rc 0) 00000100:00100000:2.0:1789303922.514946:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785478016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303922.514954:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1789303923.480376:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785478144 00000100:00100000:1.0:1789303923.480387:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785478144 00000100:00100000:1.0:1789303923.480468:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1789303923.480479:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3709aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785478144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789303923.480518:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789303923.480806:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789303923.486240:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3709aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785478144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5751us (6049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303923.486257:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:2.0:1789303923.554730:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765389696 00000100:00100000:2.0:1789303923.554735:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765389696 00000100:00100000:2.0:1789303923.554774:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 638 00000100:00100000:2.0:1789303923.554780:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765389696:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303923.555480:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765389696:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 696us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303923.555488:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 638 00000100:00080000:2.0:1789303923.555508:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789303923.555512:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789303923.555515:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789303924.052279:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303924.504929:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785478272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303924.505031:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303924.507655:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785478272 00000100:00100000:2.0:1789303924.507731:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785478272 00000100:00100000:2.0:1789303924.507927:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789303924.507937:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785478272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789303924.507987:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789303924.508081:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785478272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (3050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303924.508113:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789303924.508159:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789303924.508165:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c38460000, transno 4294967324 00000100:00100000:2.0:1789303924.508184:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785478272:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1789303925.904345:0:60817:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc24cb0040 20000000:00000080:2.0:1789303925.904372:0:60817:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02054000 uarg=0000000000000000 00010000:00010000:2.0:1789303925.904916:0:60817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789303925.904961:0:60817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c14afeb00) 00010000:00010000:2.0:1789303925.904965:0:60817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789303925.904976:0:60817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312948c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff43 expref: 5 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303925.907420:0:60817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789303925.907478:0:60817:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789303925.907501:0:60817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312948c9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303925.907520:0:60817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312948a6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129489f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303925.907529:0:60817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312948c9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303925.907591:0:60817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312948a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129489f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303925.907608:0:60817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312948a6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129489f expref: 18 pid: 5846 timeout: 1525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303925.907623:0:60817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60817:1876219785478400:0@lo:104: 00000100:00100000:2.0:1789303925.907701:0:60817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303925.907762:0:60817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c07978cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789303926.038542:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789303926.038556:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785478912:0@lo:400:kworker.0 00000100:00100000:0.0:1789303926.038580:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303926.038611:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785478656 00000100:00100000:0.0:1789303926.038619:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785478656 00000100:00100000:0.0:1789303926.038662:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785479040 00000100:00100000:0.0:1789303926.038665:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785479040 00000100:00100000:0.0:1789303926.038689:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785478912 00000100:00100000:0.0:1789303926.038693:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785478912 00000100:00100000:0.0:1789303926.038712:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:0.0:1789303926.038721:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785478656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303926.038770:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785478656:12345-0@lo:400:kworker.0 Request processed in 51us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303926.038777:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:0.0:1789303926.038793:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:0.0:1789303926.038799:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785479040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303926.038825:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785479040:12345-0@lo:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303926.038831:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:0.0:1789303926.038843:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1789303926.038849:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785478912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303926.038880:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785478912:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303926.038886:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1789303926.038903:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785479168 00000100:00100000:0.0:1789303926.038906:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785479168 00000100:00100000:0.0:1789303926.038931:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785478784 00000100:00100000:0.0:1789303926.038934:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785478784 00000100:00100000:0.0:1789303926.038965:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1789303926.038981:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785479168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303926.039011:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785479168:12345-0@lo:400:kworker.0 Request processed in 32us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303926.039017:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1789303926.039028:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1789303926.039033:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785478784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303926.039059:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785478784:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303926.039064:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00080000:0.0:1789303926.039117:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789303926.039121:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789303926.039124:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789303926.039159:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785478912:0@lo:400:kworker.0 00000100:00100000:0.0:1789303926.039170:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785478784:0@lo:400:kworker.0 00000100:00100000:0.0:1789303926.039197:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785479040:0@lo:400:kworker.0 00000100:00100000:0.0:1789303926.039206:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785478656:0@lo:400:kworker.0 00000100:00100000:0.0:1789303926.039215:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785479168:0@lo:400:kworker.0 00010000:00010000:2.0:1789303927.127108:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789303927.250330:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789303927.250338:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789303927.250343:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789303927.250402:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303927.250415:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303927.250450:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303927.250478:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785479296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789303927.250557:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303927.250614:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c2042b780 going to sleep for 11 seconds 00000100:00100000:1.0:1789303927.251011:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785479296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789303927.251027:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303927.251036:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789303927.251055:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789303927.251061:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303927.251075:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303928.594554:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785479424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789303928.594640:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303928.594762:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785479424 00000100:00100000:0.0:1789303928.594771:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785479424 00000100:00100000:0.0:1789303928.594843:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1789303928.594854:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785479424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789303928.594889:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789303928.594951:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785479424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303928.594958:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00080000:2.0:1789303928.595080:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789303928.595145:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785479424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789303928.674848:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765389952 00000100:00100000:0.0:1789303928.674853:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765389952 00000100:00100000:0.0:1789303928.674885:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 850 00000100:00100000:0.0:1789303928.674892:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765389952:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303928.674934:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765389952:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 42us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303928.674940:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 850 00000100:00100000:2.0:1789303928.692650:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303928.693287:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765390336 00000100:00100000:1.0:1789303928.693298:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765390336 00000100:00100000:1.0:1789303928.693381:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 216 00000100:00100000:1.0:1789303928.693392:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765390336:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:1.0:1789303928.693421:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb723129472c 00000100:00080000:1.0:1789303928.693430:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2b02d16000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789303928.693465:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967322 00000100:00080000:2.0:1789303928.693573:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789303928.694840:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765390336:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 1444us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303928.694852:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 216 00010000:00010000:1.0:1789303928.694888:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303929.280214:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303929.280259:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765390464 00000100:00100000:2.0:1789303929.280271:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765390464 00000100:00100000:2.0:1789303929.280323:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 424 00000100:00100000:2.0:1789303929.280333:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:36086:x1876219765390464:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789303929.280354:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303929.280377:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312948de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff4a expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303929.280447:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312948e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303929.280474:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312948e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303929.280489:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312948e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789303929.280527:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:2.0:1789303929.280531:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789303929.280551:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312948e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303929.280580:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312948de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff4a expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303929.280605:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312948e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff4a expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303929.280614:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c2e92a100) 00010000:00010000:2.0:1789303929.280618:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789303929.280622:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789303929.280684:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:36086:x1876219765390464:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 352us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303929.280692:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 424 00000100:00100000:0.0:1789303929.294107:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303929.294151:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765390720 00000100:00100000:0.0:1789303929.294163:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765390720 00000100:00100000:0.0:1789303929.294224:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 425 00000100:00100000:0.0:1789303929.294235:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:36086:x1876219765390720:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789303929.294306:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789303929.294336:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312948e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff4a expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303929.294354:0:7654:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312948c2) 00010000:00010000:0.0:1789303929.294358:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c2e92a100) 00010000:00010000:0.0:1789303929.294370:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789303929.294398:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303929.294412:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303929.294422:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789303929.294762:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009243608a reply state 0000000037508382 transno 4294967466 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303929.294773:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789303929.296879:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000100:00100000:0.0:1789303929.297018:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:36086:x1876219765390720:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 2779us (2936us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1789303929.297029:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 425 00010000:00010000:0.0:1789303929.308046:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303929.308065:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303929.308170:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303929.308177:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789303929.308182:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303929.308190:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303929.308206:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c14afe000) 00010000:00010000:0.0:1789303929.308209:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789303929.308214:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303929.308220:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312948ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303929.630134:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785479552 00000100:00100000:1.0:1789303929.630144:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785479552 00000100:00100000:1.0:1789303929.630218:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789303929.630227:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785479552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789303929.630260:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789303929.630345:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789303929.638824:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785479552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8577us (9004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303929.638840:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000020:00000080:0.0:1789303930.072868:0:61012:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3032e210 20000000:00000080:0.0:1789303930.072888:0:61012:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f666400 uarg=0000000000000000 00010000:00010000:0.0:1789303930.073584:0:61012:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789303930.073603:0:61012:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789303930.073617:0:61012:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789303930.073639:0:61012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303930.073658:0:61012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860fa00/0xefc0bb72312948d7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312948d0 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303930.073667:0:61012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303930.073719:0:61012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860fa00/0xefc0bb72312948d7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312948d0 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303930.073734:0:61012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb72312948d7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312948d0 expref: 18 pid: 5847 timeout: 1529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303930.073749:0:61012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61012:1876219785479680:0@lo:104: 00000100:00100000:0.0:1789303930.073815:0:61012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303930.073922:0:61012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c04c22840 going to sleep for 11 seconds 00000100:00100000:2.0:1789303930.074084:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785479680 00000100:00100000:2.0:1789303930.075165:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785479680 00000100:00100000:0.0:1789303930.075396:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789303930.075407:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:61012:x1876219785479680:12345-0@lo:104: 00010000:00010000:0.0:1789303930.075423:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303930.075569:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789303930.075576:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:61012:x1876219785479680:12345-0@lo:104: Request processed in 171us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303930.075582:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00010000:00010000:2.0:1789303930.075645:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789303930.075654:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.075678:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789303930.075682:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.075691:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789303930.075698:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303930.075703:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789303930.075746:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.075753:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789303930.075777:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.075785:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312948d0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312948d7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.075805:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303930.075807:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303930.075808:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303930.075822:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785479808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789303930.075861:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303930.075923:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785479808 00000100:00100000:2.0:1789303930.075927:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785479808 00010000:00010000:2.0:1789303930.076082:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860fa00/0xefc0bb72312948d7 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312948d0 expref: 19 pid: 5847 timeout: 1529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303930.076147:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789303930.076155:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785479808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789303930.076166:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303930.076172:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860fa00/0xefc0bb72312948d7 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312948d0 expref: 19 pid: 5847 timeout: 1529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076182:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860fa00/0xefc0bb72312948d7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312948d0 expref: 19 pid: 5847 timeout: 1529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076200:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076207:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076222:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076230:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076237:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076243:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076248:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789303930.076252:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076266:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076274:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303930.076284:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789303930.076319:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785479808:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303930.076326:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789303930.076366:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785479808:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789303930.076572:0:61012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fa00/0xefc0bb72312948d7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312948d0 expref: 18 pid: 5847 timeout: 1529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303930.076585:0:61012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61012:1876219785479680:0@lo:104: 00010000:00010000:1.0:1789303930.076607:0:61012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303930.076642:0:61012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303930.076650:0:61012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303930.076656:0:61012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312948f3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789303930.185973:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967466 is committed 00010000:00010000:1.0:1789303930.197222:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303931.155997:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785480704 00000100:00100000:0.0:1789303931.156002:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785480704 00000100:00100000:0.0:1789303931.156026:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785479936 00000100:00100000:0.0:1789303931.156028:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785479936 00000100:00100000:0.0:1789303931.156038:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1789303931.156044:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785480704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789303931.156053:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789303931.156069:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294901 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312948fa expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303931.156120:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294901 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312948fa expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303931.156130:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294901 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312948fa expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303931.156140:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789303931.156172:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+20:5849:x1876219785480704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303931.156177:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1789303931.156198:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1789303931.156204:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785479936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303931.156231:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785479936:12345-0@lo:400:kworker.0 Request processed in 27us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303931.156236:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1789303931.156272:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785479936:0@lo:400:kworker.0 00000100:00100000:0.0:1789303931.156291:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785480704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789303931.156304:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303931.156314:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789303931.156328:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789303931.156333:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303931.156346:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1789303931.273312:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:2.0:1789303931.273321:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2b02d15800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:2.0:1789303931.273347:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b02d15800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:2.0:1789303931.273392:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b02d16000 for lustre-OST0001 00000100:00100000:0.0:1789303933.184191:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:2.0:1789303933.184996:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303933.187337:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:2.0:1789303933.188686:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789303933.190991:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303933.200799:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:2.0:1789303933.202011:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789303933.204693:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303933.206644:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:36171:x1876219765391360:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 1645us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303933.206656:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 427 00000100:00100000:1.0:1789303933.213803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303933.214119:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765391488 00000100:00100000:0.0:1789303933.214136:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765391488 00000100:00100000:0.0:1789303933.214198:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 428 00000100:00100000:0.0:1789303933.214209:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:36171:x1876219765391488:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789303933.214308:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:36171:x1876219765391488:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 101us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303933.214317:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 428 00000100:00100000:0.0:1789303933.216388:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303933.216483:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765391616 00000100:00100000:2.0:1789303933.216494:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765391616 00000100:00100000:2.0:1789303933.216551:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 220 00000100:00100000:2.0:1789303933.216561:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:36171:x1876219765391616:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789303933.216989:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:36171:x1876219765391616:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 428us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303933.216997:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 220 00000100:00100000:2.0:1789303933.219486:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303933.232825:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303933.237007:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765391872 00000100:00100000:0.0:1789303933.237025:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765391872 00000100:00100000:0.0:1789303933.237139:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 429 00000100:00100000:0.0:1789303933.237150:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:36171:x1876219765391872:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789303933.237582:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:36171:x1876219765391872:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 432us (4765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303933.237591:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 429 00010000:00010000:1.0:1789303933.268639:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303933.351851:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303933.352119:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765392000 00000100:00100000:0.0:1789303933.352142:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765392000 00000100:00100000:0.0:1789303933.352212:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 430 00000100:00100000:0.0:1789303933.352223:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:36175:x1876219765392000:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789303933.352246:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789303933.352286:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb723129490f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff51 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352354:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294916 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352369:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294916 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352384:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294916 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352397:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129491d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352404:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129491d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352411:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129491d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352709:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352718:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352725:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789303933.352747:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:0.0:1789303933.352750:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789303933.352771:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352791:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294916 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352797:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294916 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352804:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294916 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352809:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789303933.352813:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294916 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352821:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294916 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352833:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14afe100) 00010000:00010000:0.0:1789303933.352836:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789303933.352842:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294916 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352848:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294916 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352860:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129491d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352866:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129491d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352887:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129491d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352898:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789303933.352901:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129491d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352907:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129491d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352927:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c14afef00) 00010000:00010000:0.0:1789303933.352930:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789303933.352934:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129491d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352940:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129491d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352971:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb723129490f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff51 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352987:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff51 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.352995:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c14afe900) 00010000:00010000:0.0:1789303933.352997:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789303933.352999:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789303933.353072:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:36175:x1876219765392000:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 851us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303933.353078:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 430 00000100:00100000:2.0:1789303933.358597:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303933.358669:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765392256 00000100:00100000:1.0:1789303933.358681:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765392256 00000100:00100000:1.0:1789303933.358790:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 431 00000100:00100000:1.0:1789303933.358802:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:36175:x1876219765392256:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:1.0:1789303933.358825:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789303933.358845:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129492b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff58 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.359670:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294932 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.359693:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294932 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.359722:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294932 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.359749:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.359758:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.359766:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789303933.360761:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe:0x0], index 1: 0 00010000:00010000:1.0:1789303933.361382:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361399:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361412:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361456:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294932 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361463:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294932 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361469:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294932 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361475:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303933.361486:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294932 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361493:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294932 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361505:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c14afe900) 00010000:00010000:1.0:1789303933.361508:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303933.361513:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294932 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361519:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294932 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789303933.361537:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7c736cc reply state 00000000bac11d76 transno 4294967467 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303933.361546:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789303933.361583:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129492b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff58 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361599:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff58 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303933.361607:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9e2c03db3e00) 00010000:00010000:1.0:1789303933.361609:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789303933.361612:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8f400, rc 0) 00000100:00100000:1.0:1789303933.361693:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:36175:x1876219765392256:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 2892us (3106us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789303933.361701:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 431 00010000:00010000:2.0:1789303933.365400:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303933.365418:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303933.365426:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303933.365433:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303933.365437:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303933.365445:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303933.365461:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff9e2c03db3800) 00010000:00010000:2.0:1789303933.365465:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303933.365471:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303933.365476:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294939 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303933.373803:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303933.373985:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765392384 00000100:00100000:0.0:1789303933.374011:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765392384 00000100:00100000:0.0:1789303933.374070:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 222 00000100:00100000:0.0:1789303933.374081:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:36175:x1876219765392384:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789303933.374142:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789303933.374164:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb723129494e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff5f expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789303933.374192:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789303933.374215:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=1383s v=(0 0) 00010000:00010000:0.0:1789303933.374220:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789303933.374232:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb723129494e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff5f expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.374248:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb723129494e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff5f expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303933.374262:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa400, rc 0) 00000100:00100000:0.0:1789303933.374322:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:36175:x1876219765392384:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 243us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303933.374328:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 222 00000100:00100000:1.0:1789303933.409543:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303933.414436:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765392512 00000100:00100000:2.0:1789303933.414454:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765392512 00002000:00100000:2.0:1789303933.414520:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe:0x0] (0->1048575) req@ffff9e2c02f2d180 x1876219765392512/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:754/0 lens 488/0 e 0 to 0 dl 1789303944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789303933.414532:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c02f2d180 with x1876219765392512 ext(0->1048575) 00002000:00010000:2.0:1789303933.414539:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c02f2d180 00000100:00100000:2.0:1789303933.414581:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:2.0:1789303933.414592:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765392512:12345-192.168.202.29@tcp:4:dd.60003 00000100:00100000:2.0:1789303933.492506:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303933.559306:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:36175:x1876219765392640:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 66521us (66804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303933.559326:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 432 00000100:00100000:2.0:1789303933.563558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303933.664028:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765392768:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 100056us (100472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303933.664041:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 223 00000100:00100000:2.0:1789303933.672206:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765393024 00000100:00100000:2.0:1789303933.672219:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765393024 00000100:00100000:2.0:1789303933.672343:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00100000:2.0:1789303933.672355:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:36175:x1876219765393024:12345-192.168.202.29@tcp:35:dd.60003 00000100:00100000:2.0:1789303933.674047:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:36175:x1876219765393024:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 1687us (2100us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789303933.674059:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00100000:1.0:1789303933.714544:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789303933.714569:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785480832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789303933.714651:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303933.714940:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785480832 00000100:00100000:2.0:1789303933.714949:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785480832 00000100:00100000:2.0:1789303933.715026:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789303933.715037:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785480832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789303933.715060:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789303933.715133:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785480832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303933.715156:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00080000:0.0:1789303933.715286:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789303933.715373:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785480832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789303933.823083:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303933.823184:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303933.823327:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765393152 00000100:00100000:0.0:1789303933.823337:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765393152 00000100:00100000:0.0:1789303933.823398:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 853 00000100:00100000:0.0:1789303933.823419:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765393152:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303933.823503:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765393152:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303933.823511:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 853 00000001:00080000:1.0:1789303934.732820:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967468 is committed 00000004:00080000:2.0:1789303935.920494:0:61259:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1385598400881ns, next at 1365341454263ns, rc = 0 00000004:00080000:2.0:1789303935.920718:0:61259:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1385598627010ns, next at 1338312659610ns, rc = 0 00000004:00080000:1.0:1789303935.923873:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 37 committed 00000004:00080000:1.0:1789303935.923909:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 34 committed 00000100:00100000:2.0:1789303936.279199:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785481472:0@lo:400:kworker.0 00000100:00100000:2.0:1789303936.279279:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303936.279291:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785481216:0@lo:400:kworker.0 00000100:00100000:0.0:1789303936.279319:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303936.279339:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785481728:0@lo:400:kworker.0 00000100:00100000:2.0:1789303936.279348:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789303936.279353:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785481088:0@lo:400:kworker.0 00000100:00100000:0.0:1789303936.279360:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303936.279376:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789303936.279380:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303936.279380:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785481344:0@lo:400:kworker.0 00000100:00100000:0.0:1789303936.279399:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303936.279400:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785481600:0@lo:400:kworker.0 00000100:00100000:2.0:1789303936.279420:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303936.279426:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785481472 00000100:00100000:0.0:1789303936.279434:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785481472 00000100:00100000:2.0:1789303936.279440:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785481216 00000100:00100000:2.0:1789303936.279443:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785481216 00000100:00100000:1.0:1789303936.279584:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785481600 00000100:00100000:1.0:1789303936.279588:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785481600 00000100:00100000:0.0:1789303936.279607:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1789303936.280144:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785481472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303936.280210:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785481472:12345-0@lo:400:kworker.0 Request processed in 72us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303936.286001:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1789303936.286026:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785481216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303936.286172:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785481216:12345-0@lo:400:kworker.0 Request processed in 158us (6850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303936.286180:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1789303936.286207:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785481088 00000100:00100000:2.0:1789303936.286215:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785481088 00000100:00100000:2.0:1789303936.286248:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1789303936.286256:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785481088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303936.286289:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785481088:12345-0@lo:400:kworker.0 Request processed in 34us (6908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303936.286313:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1789303936.286351:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785481088:0@lo:400:kworker.0 00000100:00100000:2.0:1789303936.286364:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785481472:0@lo:400:kworker.0 00000100:00080000:2.0:1789303936.286409:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303936.286424:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785481728 00000100:00100000:2.0:1789303936.286428:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785481728 00000100:00100000:2.0:1789303936.286468:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785481344 00000100:00100000:2.0:1789303936.286472:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785481344 00000100:00100000:2.0:1789303936.286496:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1789303936.286501:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785481344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303936.286719:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785481344:12345-0@lo:400:kworker.0 Request processed in 216us (7318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303936.286726:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1789303936.286896:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:1.0:1789303936.287973:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1789303936.288332:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785481600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303936.288416:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785481600:12345-0@lo:400:kworker.0 Request processed in 434us (8994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303936.288423:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1789303936.288451:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785481600:0@lo:400:kworker.0 00010000:00010000:1.0:1789303936.338941:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303937.088141:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765393408 00000100:00100000:0.0:1789303937.088153:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765393408 00000100:00100000:0.0:1789303937.088245:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 433 00000100:00100000:0.0:1789303937.088256:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:36368:x1876219765393408:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789303937.088360:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:36368:x1876219765393408:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 105us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303937.088366:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 433 00000100:00100000:2.0:1789303937.091505:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:2.0:1789303937.092475:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789303937.096510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303937.096609:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765393664 00000100:00100000:2.0:1789303937.096621:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765393664 00000100:00100000:2.0:1789303937.096699:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 225 00000100:00100000:2.0:1789303937.096709:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:36368:x1876219765393664:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789303937.097119:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:36368:x1876219765393664:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 381us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303937.097128:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 225 00000100:00100000:0.0:1789303937.100310:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765393792 00000100:00100000:0.0:1789303937.100321:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765393792 00000100:00100000:0.0:1789303937.100367:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 434 00000100:00100000:0.0:1789303937.100374:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:36368:x1876219765393792:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789303937.100702:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:36368:x1876219765393792:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 328us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303937.100708:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 434 00000100:00100000:0.0:1789303937.109056:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303937.115984:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303937.119874:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765394176 00000100:00100000:2.0:1789303937.119884:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765394176 00000100:00100000:2.0:1789303937.119956:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 227 00000100:00100000:2.0:1789303937.119967:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02edb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:36368:x1876219765394176:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789303937.120378:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02edb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:36368:x1876219765394176:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 412us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303937.120387:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 227 00000100:00100000:2.0:1789303937.122274:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303937.122343:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765394304 00000100:00100000:1.0:1789303937.122353:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765394304 00000100:00100000:1.0:1789303937.122409:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 436 00000100:00100000:1.0:1789303937.122418:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:36368:x1876219765394304:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789303937.122870:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:36368:x1876219765394304:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 451us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303937.122877:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 436 00000100:00100000:0.0:1789303937.198038:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765394560 00000100:00100000:0.0:1789303937.198050:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765394560 00000100:00100000:0.0:1789303937.198131:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 437 00000100:00100000:0.0:1789303937.198142:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:36372:x1876219765394560:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:0.0:1789303937.198194:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789303937.198224:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff58 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.198247:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9e2c03db3e00) 00010000:00010000:0.0:1789303937.198258:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789303937.198282:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294955 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.198296:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294955 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.198306:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294955 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.198336:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129495c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.198343:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129495c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.198350:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129495c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.198652:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294963 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.198662:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294963 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.198669:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294963 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789303937.199602:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 64 off9088 00000004:00080000:0.0:1789303937.199614:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1386877522611ns, next at 1387877520234ns, rc = 0 00010000:00010000:0.0:1789303937.199710:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb723129496a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199722:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb723129496a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199730:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb723129496a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199737:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb723129496a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199754:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb723129496a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199760:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb723129496a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199786:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789303937.199808:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294963 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199815:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294963 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199821:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294963 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199826:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789303937.199841:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294963 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199849:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294963 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.199862:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9e2c14afee00) 00010000:00010000:0.0:1789303937.199865:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789303937.202747:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294963 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.202766:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294963 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.202802:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294955 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.202828:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294955 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.202843:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294955 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.202848:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789303937.202853:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294955 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.202861:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294955 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.202877:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c14afe900) 00010000:00010000:0.0:1789303937.202881:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789303937.202884:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294955 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303937.202890:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294955 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789303937.202901:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000917df93c reply state 000000007dcf0692 transno 4294967469 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129495c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303937.202911:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789303937.203015:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:36372:x1876219765394560:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 4870us (5035us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789303937.203025:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 437 00010000:00010000:1.0:1789303938.386797:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789303938.835717:0:8095:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1388513622989ns, next at 1389513620500ns, rc = 0 00000100:00100000:2.0:1789303938.835747:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789303938.835779:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785481856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789303938.835886:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303938.836640:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785481856 00000100:00100000:1.0:1789303938.836649:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785481856 00000100:00100000:1.0:1789303938.836725:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789303938.836737:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785481856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789303938.836770:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789303938.836846:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785481856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303938.836853:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1789303938.836956:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785481856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789303938.913898:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765394688 00000100:00100000:0.0:1789303938.913917:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765394688 00000100:00100000:0.0:1789303938.913960:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 855 00000100:00100000:2.0:1789303938.913965:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 648 00000100:00100000:0.0:1789303938.913973:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765394688:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303938.913980:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3695a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765395072:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303938.914039:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3695a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765395072:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 64us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303938.914047:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 648 00000100:00100000:1.0:1789303938.915170:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765394816 00000100:00100000:1.0:1789303938.915179:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765394816 00000100:00100000:0.0:1789303938.915489:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765394688:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1514us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303938.915498:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 855 00000100:00100000:1.0:1789303938.916382:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 946 00000100:00100000:1.0:1789303938.916398:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765394816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303938.916466:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765394816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 74us (2743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303938.916473:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 946 00000004:00080000:2.0:1789303939.397594:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 39 committed 00000001:00080000:2.0:1789303939.397624:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967469 is committed 00000004:00080000:2.0:1789303939.397628:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 38 committed 00000100:00100000:2.0:1789303939.397957:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785481984:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789303939.398124:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789303939.399562:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 40 committed 00000004:00080000:2.0:1789303939.399582:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 35 committed 00000100:00100000:2.0:1789303939.400630:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02edb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785482112:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789303939.400659:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ffff804/0xefc0bb7231294971 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303939.401938:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303939.402045:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765395200 00000100:00100000:2.0:1789303939.402054:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765395200 00010000:00010000:2.0:1789303939.402142:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb723129494e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff5f expref: 6 pid: 17212 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303939.402206:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 281 00000100:00100000:2.0:1789303939.402222:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765395200:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789303939.402249:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303939.402262:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb723129494e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff5f expref: 6 pid: 17212 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303939.402286:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb723129494e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff5f expref: 6 pid: 17212 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303939.402323:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb723129494e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff5f expref: 6 pid: 17212 timeout: 1489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303939.402360:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789303939.402367:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789303939.402375:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ffff804/0xefc0bb7231294971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303939.402528:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ffff804/0xefc0bb7231294971 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303939.402584:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789303939.402702:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765395200:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 482us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303939.402715:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 281 00010000:00010000:1.0:1789303939.402933:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303939.402942:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ffff804/0xefc0bb7231294971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303939.402953:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303939.402958:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffff804/0xefc0bb7231294971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303939.402968:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffff804/0xefc0bb7231294971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303939.402997:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ffff804/0xefc0bb7231294971 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303939.403005:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ffff804/0xefc0bb7231294971 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303939.403025:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303939.403027:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303939.403029:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789303939.403985:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b02ed8700/2, rc 0, transno 4294967324 00000100:00100000:2.0:1789303939.404006:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785481984:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789303939.414026:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303939.868645:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785482240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303939.868717:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303939.870755:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785482240 00000100:00100000:0.0:1789303939.870771:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785482240 00000100:00100000:0.0:1789303939.870854:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1789303939.870865:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785482240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789303939.870903:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789303939.870977:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785482240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303939.870983:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1789303939.871009:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785482240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789303940.437317:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303940.965247:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765395328 00000100:00100000:2.0:1789303940.965263:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765395328 00000100:00100000:2.0:1789303940.965351:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 438 00000100:00100000:2.0:1789303940.965361:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765395328:12345-192.168.202.29@tcp:17:kworker.0 00000100:00100000:2.0:1789303940.965489:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765395328:12345-192.168.202.29@tcp:17:kworker.0 Request processed in 129us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303940.965496:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 438 00000100:00100000:2.0:1789303941.394396:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785482752:0@lo:400:kworker.0 00000100:00100000:0.0:1789303941.394500:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785482624:0@lo:400:kworker.0 00000100:00100000:1.0:1789303941.394583:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785482496:0@lo:400:kworker.0 00000100:00100000:0.0:1789303941.401415:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789303941.402502:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789303941.402693:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785482624:0@lo:400:kworker.0 00000100:00100000:2.0:1789303941.404461:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303941.404586:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303941.404621:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785483008:0@lo:400:kworker.0 00000100:00100000:1.0:1789303941.404660:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303941.404702:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1789303941.404710:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785482496:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789303941.404812:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303941.405122:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785483008 00000100:00100000:2.0:1789303941.405127:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785483008 00000100:00100000:2.0:1789303941.405346:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1789303941.405355:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785483008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303941.405401:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785483008:12345-0@lo:400:kworker.0 Request processed in 48us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303941.405421:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1789303941.405464:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785482752:0@lo:400:kworker.0 00000100:00100000:1.0:1789303941.405575:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785482496:12345-0@lo:400:kworker.0 Request processed in 865us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303941.405582:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1789303941.405611:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785482496:0@lo:400:kworker.0 00000100:00100000:1.0:1789303941.405621:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785483008:0@lo:400:kworker.0 00000100:00080000:0.0:1789303941.405664:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789303941.462086:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789303942.482633:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789303942.485223:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1789303943.506347:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303943.954558:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785483136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789303943.954640:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303943.954913:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785483136 00000100:00100000:0.0:1789303943.954922:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785483136 00000100:00100000:0.0:1789303943.954988:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1789303943.954997:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785483136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789303943.955032:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789303943.955119:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785483136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303943.955127:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1789303943.955162:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789303943.955167:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b02ed8700, transno 4294967324 00000100:00100000:0.0:1789303943.955184:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785483136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789303944.037983:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765395456 00000100:00100000:0.0:1789303944.037988:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765395456 00000100:00100000:0.0:1789303944.038023:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 857 00000100:00100000:0.0:1789303944.038031:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765395456:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303944.038063:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765395456:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 34us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303944.038070:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 857 00000100:00100000:0.0:1789303944.982233:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789303944.982259:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785483264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789303944.982350:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789303944.983906:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789303945.554390:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303946.515622:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785483520:0@lo:400:kworker.0 00000100:00100000:1.0:1789303946.515650:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785483776:0@lo:400:kworker.0 00000100:00100000:2.0:1789303946.515704:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303946.515723:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785483648:0@lo:400:kworker.0 00000100:00100000:1.0:1789303946.515769:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303946.515805:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785483648 00000100:00100000:1.0:1789303946.515814:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785483648 00000100:00100000:1.0:1789303946.515872:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1789303946.515882:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785483648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303946.515938:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785483648:12345-0@lo:400:kworker.0 Request processed in 57us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303946.515946:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1789303946.515981:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303946.516038:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785484032:0@lo:400:kworker.0 00000100:00100000:0.0:1789303946.516049:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785483392:0@lo:400:kworker.0 00000100:00100000:2.0:1789303946.516070:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303946.516121:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303946.516138:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785484032 00000100:00100000:2.0:1789303946.516143:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785484032 00000100:00100000:0.0:1789303946.516156:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785483904:0@lo:400:kworker.0 00000100:00100000:2.0:1789303946.516182:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1789303946.516193:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785484032:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789303946.516194:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789303946.516200:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789303946.516245:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785483648:0@lo:400:kworker.0 00000100:00100000:2.0:1789303946.516247:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785484032:12345-0@lo:400:kworker.0 Request processed in 54us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303946.516258:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1789303946.516288:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785484032:0@lo:400:kworker.0 00000100:00100000:0.0:1789303946.516292:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785483392 00000100:00100000:0.0:1789303946.516297:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785483392 00000100:00100000:0.0:1789303946.516342:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1789303946.516349:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785483392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303946.516414:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785483392:12345-0@lo:400:kworker.0 Request processed in 65us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303946.516420:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1789303946.524799:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303946.524883:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785483392:0@lo:400:kworker.0 00000100:00100000:1.0:1789303946.524922:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785483904 00000100:00100000:1.0:1789303946.524927:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785483904 00000100:00100000:1.0:1789303946.524981:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:1.0:1789303946.524989:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785483520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303946.525168:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785483520:12345-0@lo:400:kworker.0 Request processed in 180us (9464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303946.525176:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:1.0:1789303946.525194:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1789303946.525200:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785483904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303946.525237:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785483904:12345-0@lo:400:kworker.0 Request processed in 37us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303946.525242:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1789303946.525288:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785483904:0@lo:400:kworker.0 00000100:00080000:1.0:1789303946.525328:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789303946.525358:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785483520:0@lo:400:kworker.0 00000100:00080000:1.0:1789303946.528720:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789303946.581671:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789303948.627773:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303949.074817:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785484160 00000100:00100000:2.0:1789303949.074825:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785484160 00000100:00100000:2.0:1789303949.074927:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1789303949.074936:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785484160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789303949.074969:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789303949.075034:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785484160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303949.075041:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1789303949.075135:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785484160:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789303949.075357:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789303949.159551:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765396096 00000100:00100000:0.0:1789303949.159555:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765396096 00000100:00100000:0.0:1789303949.159594:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 954 00000100:00100000:0.0:1789303949.159601:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765396096:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303949.159632:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765396096:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303949.159638:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 954 00010000:00010000:1.0:1789303949.653884:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303950.098376:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789303950.098401:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785484288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789303950.098485:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303950.098668:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785484288 00000100:00100000:2.0:1789303950.098678:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785484288 00000100:00100000:2.0:1789303950.098779:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1789303950.098789:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c4112b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785484288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789303950.098822:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789303950.098878:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c4112b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785484288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303950.098886:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1789303950.099166:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785484288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303951.634511:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785484800:0@lo:400:kworker.0 00000100:00100000:1.0:1789303951.634551:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785484416:0@lo:400:kworker.0 00000100:00100000:0.0:1789303951.634622:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785484672:0@lo:400:kworker.0 00000100:00100000:1.0:1789303951.641262:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303951.641341:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785484928:0@lo:400:kworker.0 00000100:00100000:1.0:1789303951.641378:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303951.641434:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785484928 00000100:00100000:1.0:1789303951.641443:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785484928 00000100:00100000:1.0:1789303951.642612:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1789303951.642624:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785484928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303951.642710:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785484928:12345-0@lo:400:kworker.0 Request processed in 76us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303951.642717:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00080000:1.0:1789303951.642742:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789303951.642776:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785484928:0@lo:400:kworker.0 00000100:00100000:1.0:1789303951.642818:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785484416 00000100:00100000:1.0:1789303951.642824:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785484416 00000100:00100000:1.0:1789303951.642849:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:1.0:1789303951.642855:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785484416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303951.642904:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785484416:12345-0@lo:400:kworker.0 Request processed in 49us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303951.642911:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:1.0:1789303951.642948:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785484416:0@lo:400:kworker.0 00000100:00100000:2.0:1789303951.643462:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303951.643862:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785484800 00000100:00100000:1.0:1789303951.643868:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785484800 00000100:00100000:1.0:1789303951.643913:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1789303951.643919:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785484800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303951.643962:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785484800:12345-0@lo:400:kworker.0 Request processed in 43us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303951.643968:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00080000:2.0:1789303951.644604:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303951.644637:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785484800:0@lo:400:kworker.0 00000100:00100000:0.0:1789303951.650803:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303951.650948:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785484544 00000100:00100000:0.0:1789303951.650958:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785484544 00000100:00100000:0.0:1789303951.651013:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1789303951.651023:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785484544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303951.651073:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785484544:12345-0@lo:400:kworker.0 Request processed in 51us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303951.651080:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:1.0:1789303951.653964:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785484672 00000100:00100000:1.0:1789303951.653984:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785484672 00000100:00100000:1.0:1789303951.654066:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785485056 00000100:00100000:1.0:1789303951.654070:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785485056 00000100:00100000:1.0:1789303951.654121:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:1.0:1789303951.654130:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785484672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303951.655548:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1789303951.655564:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785485056:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789303951.655655:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789303951.660102:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785485056:12345-0@lo:400:kworker.0 Request processed in 4519us (9171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303951.660118:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1789303951.660689:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785484672:12345-0@lo:400:kworker.0 Request processed in 6556us (9889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303951.660708:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1789303951.662046:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785484672:0@lo:400:kworker.0 00010000:00010000:0.0:1789303951.698545:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303952.723309:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303954.197295:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785485184 00000100:00100000:0.0:1789303954.197309:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785485184 00000100:00100000:0.0:1789303954.197400:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1789303954.197411:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785485184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789303954.197447:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789303954.197535:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785485184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303954.197542:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00080000:2.0:1789303954.198616:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789303954.275500:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765396480 00000100:00100000:0.0:1789303954.275510:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765396480 00000100:00100000:0.0:1789303954.275563:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 861 00000100:00100000:0.0:1789303954.275573:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765396480:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303954.275658:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765396480:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303954.275666:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 861 00000100:00100000:1.0:1789303954.276425:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765396608 00000100:00100000:1.0:1789303954.276433:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765396608 00000100:00100000:1.0:1789303954.276499:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 958 00000100:00100000:1.0:1789303954.276509:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765396608:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303954.276559:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765396608:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 52us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303954.276581:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 958 00000100:00080000:0.0:1789303954.277514:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303954.287878:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765396864 00000100:00100000:2.0:1789303954.287893:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765396864 00000100:00100000:2.0:1789303954.287994:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765396736 00000100:00100000:2.0:1789303954.287998:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765396736 00000100:00100000:2.0:1789303954.288029:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 659 00000100:00100000:2.0:1789303954.288039:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765396864:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303954.288157:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765396864:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 118us (12860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303954.288165:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 659 00000100:00100000:2.0:1789303954.288183:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 660 00000100:00100000:2.0:1789303954.288206:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765396736:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303954.288233:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765396736:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (12785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303954.288238:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 660 00000100:00100000:0.0:1789303954.680950:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303954.681034:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765396992 00000100:00100000:2.0:1789303954.681044:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765396992 00000100:00100000:2.0:1789303954.681111:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 439 00000100:00100000:2.0:1789303954.681120:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:36589:x1876219765396992:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789303954.681201:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:36589:x1876219765396992:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 83us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303954.681207:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 439 00000100:00100000:2.0:1789303954.689855:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303954.689933:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765397120 00000100:00100000:1.0:1789303954.689946:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765397120 00000100:00100000:1.0:1789303954.690009:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 229 00000100:00100000:1.0:1789303954.690019:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:36589:x1876219765397120:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789303954.690419:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:36589:x1876219765397120:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 400us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303954.690427:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 229 00000100:00100000:2.0:1789303954.695989:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303954.696080:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765397248 00000100:00100000:1.0:1789303954.696174:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765397248 00000100:00100000:1.0:1789303954.696246:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 230 00000100:00100000:1.0:1789303954.696258:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:36589:x1876219765397248:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789303954.696719:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:36589:x1876219765397248:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 462us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303954.696727:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 230 00000100:00100000:1.0:1789303954.699171:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303954.699253:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765397376 00000100:00100000:2.0:1789303954.699264:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765397376 00000100:00100000:2.0:1789303954.699319:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 440 00000100:00100000:2.0:1789303954.699329:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:36589:x1876219765397376:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789303954.699782:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:36589:x1876219765397376:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 452us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303954.699791:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 440 00000100:00100000:1.0:1789303954.702790:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765397504 00000100:00100000:1.0:1789303954.702802:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765397504 00000100:00100000:1.0:1789303954.702871:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 441 00000100:00100000:1.0:1789303954.702882:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:36589:x1876219765397504:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789303954.702999:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:36589:x1876219765397504:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 119us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303954.703007:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 441 00000100:00100000:1.0:1789303954.707870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303954.707905:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765397632 00000100:00100000:1.0:1789303954.707926:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765397632 00000100:00100000:1.0:1789303954.707978:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 231 00000100:00100000:1.0:1789303954.707989:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:36589:x1876219765397632:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789303954.708343:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:36589:x1876219765397632:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 355us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303954.708351:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 231 00000100:00100000:1.0:1789303954.714344:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303954.728754:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765397888 00000100:00100000:1.0:1789303954.728771:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765397888 00000100:00100000:1.0:1789303954.728827:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 442 00000100:00100000:1.0:1789303954.728838:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:36589:x1876219765397888:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789303954.729318:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:36589:x1876219765397888:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 480us (5355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303954.729326:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 442 00000100:00100000:1.0:1789303954.774113:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303954.774155:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765398016 00000100:00100000:1.0:1789303954.774164:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765398016 00000100:00100000:1.0:1789303954.774214:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 443 00000100:00100000:1.0:1789303954.774223:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:36590:x1876219765398016:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789303954.774244:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789303954.774266:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294978 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff66 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303954.774335:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129497f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303954.774349:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129497f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303954.774375:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129497f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789303954.774413:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:1.0:1789303954.774417:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789303954.774434:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129497f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303954.774458:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294978 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff66 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303954.774481:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129497f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff66 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303954.774489:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c14afe900) 00010000:00010000:1.0:1789303954.774492:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789303954.774496:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ee00, rc 0) 00000100:00100000:1.0:1789303954.774546:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:36590:x1876219765398016:12345-192.168.202.29@tcp:101:rm.0 Request processed in 324us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303954.774552:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 443 00010000:00010000:0.0:1789303954.775175:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303954.783452:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303954.799445:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303954.814975:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303954.826253:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303955.218615:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789303955.218638:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785485312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303955.218716:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303955.219259:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785485312 00000100:00100000:1.0:1789303955.219268:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785485312 00000100:00100000:1.0:1789303955.219334:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1789303955.219343:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785485312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789303955.219379:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303955.219445:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785485312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303955.219452:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1789303955.219500:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785485312:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789303955.219550:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789303955.799958:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303956.755962:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785485440:0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.756039:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303956.756105:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785485952:0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.756133:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303956.756158:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789303956.756164:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785485568:0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.756184:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303956.756202:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785486080:0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.756224:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303956.756248:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785485696:0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.756270:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303956.756286:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789303956.756291:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785485824:0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.756311:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303956.756344:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785485440 00000100:00100000:1.0:1789303956.756352:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785485440 00000100:00100000:1.0:1789303956.756396:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:1.0:1789303956.756404:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785485440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.756453:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785485440:12345-0@lo:400:kworker.0 Request processed in 50us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303956.756460:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:1.0:1789303956.756504:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785485952 00000100:00100000:1.0:1789303956.756507:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785485952 00000100:00100000:1.0:1789303956.756540:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785485568 00000100:00100000:1.0:1789303956.756542:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785485568 00000100:00100000:1.0:1789303956.756572:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785485824 00000100:00100000:1.0:1789303956.756576:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785485824 00000100:00100000:1.0:1789303956.756592:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1789303956.756598:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785485952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.756631:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785485952:12345-0@lo:400:kworker.0 Request processed in 33us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303956.756637:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1789303956.756658:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1789303956.756664:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785485568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.756690:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785485568:12345-0@lo:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303956.757476:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1789303956.757503:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1789303956.757512:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785485824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.757571:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785485824:12345-0@lo:400:kworker.0 Request processed in 61us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303956.757577:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1789303956.757603:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785486080 00000100:00100000:1.0:1789303956.757607:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785486080 00000100:00100000:1.0:1789303956.757638:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785485696 00000100:00100000:1.0:1789303956.757641:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785485696 00000100:00100000:1.0:1789303956.757670:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1789303956.757677:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785486080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.758234:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785486080:12345-0@lo:400:kworker.0 Request processed in 556us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303956.758251:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1789303956.758266:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1789303956.758272:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785485696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.758307:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785485696:12345-0@lo:400:kworker.0 Request processed in 37us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303956.758313:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1789303956.758369:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785485568:0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.758383:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785486080:0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.758393:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785485440:0@lo:400:kworker.0 00000100:00100000:1.0:1789303956.758403:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785485952:0@lo:400:kworker.0 00000100:00080000:1.0:1789303956.758438:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789303956.758442:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303956.758553:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785485824:0@lo:400:kworker.0 00000100:00100000:2.0:1789303956.758575:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785485696:0@lo:400:kworker.0 00010000:00010000:0.0:1789303956.820075:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303957.843112:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303957.968552:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785486208 00000100:00100000:2.0:1789303957.968568:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785486208 00000100:00100000:2.0:1789303957.968688:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789303957.968700:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:61718:x1876219785486208:12345-0@lo:104: 00010000:00010000:2.0:1789303957.968720:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303957.968824:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303957.968830:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:61718:x1876219785486208:12345-0@lo:104: Request processed in 134us (3345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303957.968837:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00010000:00010000:1.0:1789303957.970085:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303957.970116:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970127:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789303957.970131:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970141:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789303957.970149:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789303957.970171:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789303957.970217:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970223:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789303957.970249:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970255:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312948fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294901 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970275:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303957.970277:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303957.970278:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303957.970287:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789303957.970310:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785486336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789303957.970361:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303957.970413:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785486336 00000100:00100000:1.0:1789303957.970420:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785486336 00010000:00010000:1.0:1789303957.970447:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294901 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312948fa expref: 19 pid: 5845 timeout: 1557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303957.970474:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789303957.970482:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785486336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789303957.970495:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303957.970500:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294901 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312948fa expref: 19 pid: 5845 timeout: 1557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970522:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294901 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312948fa expref: 19 pid: 5845 timeout: 1557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970536:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294901 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312948fa expref: 19 pid: 5845 timeout: 1557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970550:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312949a9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 61718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970558:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312949a9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 61718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970574:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312949a9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970581:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312949a9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970587:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312949a9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970594:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312949a9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970599:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303957.970603:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312949a9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970611:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312949a9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970653:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312949a9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303957.970664:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789303957.970698:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785486336:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303957.970705:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789303957.970746:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785486336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789303958.867253:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303959.399917:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303959.400228:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303959.400259:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303959.400283:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303959.400323:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765399296 00000100:00100000:0.0:1789303959.400339:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765399296 00000100:00100000:0.0:1789303959.400415:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765399424 00000100:00100000:0.0:1789303959.400418:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765399424 00000100:00100000:0.0:1789303959.400445:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 663 00000100:00100000:0.0:1789303959.400457:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765399296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303959.400574:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765399296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303959.400583:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 663 00000100:00100000:0.0:1789303959.400605:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 664 00000100:00100000:0.0:1789303959.400611:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765399424:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303959.400652:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765399424:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303959.400660:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 664 00000100:00100000:0.0:1789303959.400682:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765399168 00000100:00100000:0.0:1789303959.400686:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765399168 00000100:00100000:0.0:1789303959.400728:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 962 00000100:00100000:0.0:1789303959.400736:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765399168:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303959.400769:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765399168:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303959.400776:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 962 00000100:00080000:0.0:1789303959.400958:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789303959.400965:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789303959.400980:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789303959.401603:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765399040 00000100:00100000:1.0:1789303959.404395:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765399040 00000100:00100000:1.0:1789303959.404482:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 863 00000100:00100000:1.0:1789303959.404494:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765399040:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303959.404590:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765399040:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 99us (4688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303959.404598:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 863 10000000:01000000:0.0:1789303959.702356:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789303959.702369:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789303959.702377:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789303959.702447:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303959.702462:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303959.702478:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303959.702515:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785486592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789303959.702620:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303959.702714:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c36a87c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789303959.702811:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785486592 00000100:00100000:2.0:1789303959.702824:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785486592 00000100:00100000:2.0:1789303959.702902:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1789303959.702913:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785486592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303959.702931:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303959.702950:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312949be lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312949b7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303959.702982:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312949be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312949b7 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303959.702998:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312949be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312949b7 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303959.703009:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd600, rc 0) 00000100:00100000:2.0:1789303959.703065:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785486592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303959.703120:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1789303959.703180:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785486592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303959.703201:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303959.703223:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303959.703248:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789303959.703253:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303959.703263:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789303959.907605:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967471 is committed 00000100:00100000:0.0:1789303960.342693:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785486720 00000100:00100000:0.0:1789303960.342707:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785486720 00000100:00100000:0.0:1789303960.342817:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1789303960.342829:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785486720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789303960.342881:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789303960.342950:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785486720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303960.342958:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1789303960.343025:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785486720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789303960.916358:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303961.876816:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789303961.876898:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785487232:0@lo:400:kworker.0 00000100:00100000:1.0:1789303961.876959:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303961.877002:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785486848:0@lo:400:kworker.0 00000100:00100000:1.0:1789303961.877023:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303961.877068:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785487232 00000100:00100000:1.0:1789303961.877076:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785487232 00000100:00100000:1.0:1789303961.877148:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1789303961.877155:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785487232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303961.877208:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785487232:12345-0@lo:400:kworker.0 Request processed in 54us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303961.877214:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1789303961.877233:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785486848 00000100:00100000:1.0:1789303961.877236:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785486848 00000100:00100000:1.0:1789303961.877256:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1789303961.877261:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785486848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303961.877280:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785486848:12345-0@lo:400:kworker.0 Request processed in 20us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303961.877283:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1789303961.877320:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785487232:0@lo:400:kworker.0 00000100:00100000:1.0:1789303961.877326:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785486848:0@lo:400:kworker.0 00000100:00100000:1.0:1789303961.877749:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789303961.877757:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785487360:0@lo:400:kworker.0 00000100:00100000:1.0:1789303961.877781:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303961.877963:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785487360:0@lo:400:kworker.0 00010000:00010000:0.0:1789303961.938927:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303962.142332:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303962.142706:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765399552 00000100:00100000:2.0:1789303962.142721:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765399552 00000100:00100000:2.0:1789303962.142837:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 446 00000100:00100000:2.0:1789303962.142855:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:36704:x1876219765399552:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789303962.142887:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303962.142922:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb72312949c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff74 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.143012:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb72312949cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.143032:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb72312949cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.143070:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb72312949cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789303962.143155:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789303962.143159:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789303962.143186:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb72312949cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.143216:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb72312949c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff74 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.143240:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb72312949cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff74 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.143250:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2e92a800) 00010000:00010000:2.0:1789303962.143253:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789303962.143257:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd800, rc 0) 00000100:00100000:2.0:1789303962.143353:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:36704:x1876219765399552:12345-192.168.202.29@tcp:101:rm.0 Request processed in 505us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303962.143360:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 446 00000100:00100000:1.0:1789303962.146585:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303962.146662:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765399680 00000100:00100000:2.0:1789303962.146680:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765399680 00000100:00100000:2.0:1789303962.146787:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 447 00000100:00100000:2.0:1789303962.146800:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:36704:x1876219765399680:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789303962.146832:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303962.146861:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312949d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff7b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.146975:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312949da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.146994:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312949da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.147008:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312949da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.147027:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312949e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.147034:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312949e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.147043:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312949e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149622:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312949e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149649:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312949e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149665:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312949e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789303962.149735:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:2.0:1789303962.149740:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789303962.149768:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312949e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149804:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312949da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149812:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312949da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149820:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312949da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149827:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303962.149832:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312949da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149841:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312949da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149856:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2e92a800) 00010000:00010000:2.0:1789303962.149859:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303962.149865:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312949da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149872:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312949da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149889:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312949e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149896:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312949e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149901:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312949e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.149913:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303962.150243:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312949e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.150251:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312949e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.150262:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c2e92aa00) 00010000:00010000:2.0:1789303962.150264:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303962.150267:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312949e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.150272:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312949e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.150323:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312949d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff7b expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.151202:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312949e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff7b expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.151216:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c2e92a100) 00010000:00010000:2.0:1789303962.151219:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789303962.151224:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd400, rc 0) 00000100:00100000:2.0:1789303962.151435:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:36704:x1876219765399680:12345-192.168.202.29@tcp:101:rm.0 Request processed in 4636us (4856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303962.151447:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 447 00000100:00100000:0.0:1789303962.161773:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303962.168210:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303962.179131:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:36704:x1876219765400064:12345-192.168.202.29@tcp:37:rm.0 Request processed in 10546us (10882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303962.179163:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 50 00000100:00100000:1.0:1789303962.185234:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303962.195622:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303962.195931:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765400576 00000100:00100000:1.0:1789303962.195942:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765400576 00000100:00100000:1.0:1789303962.196004:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 449 00000100:00100000:1.0:1789303962.196015:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:36704:x1876219765400576:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:1.0:1789303962.196068:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789303962.196129:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312949e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff7b expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.196177:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c2e92a100) 00010000:00010000:1.0:1789303962.196198:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb72312949cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff74 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.196207:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2e92a800) 00010000:00010000:1.0:1789303962.196213:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789303962.196237:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312949fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.196250:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312949fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.196259:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312949fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.196270:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.196277:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.196284:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.196587:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.196596:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.196977:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789303962.198534:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00010000:00010000:1.0:1789303962.198558:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.198569:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.198577:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.198583:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303962.198588:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.198596:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.198629:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff9e2c03db3d00) 00010000:00010000:1.0:1789303962.198632:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789303962.198637:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.199084:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.199145:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312949fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.199152:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312949fd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.199322:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312949fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.199328:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303962.199331:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312949fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.199337:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312949fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.199348:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c03db3800) 00010000:00010000:1.0:1789303962.199351:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303962.199354:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312949fd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.199360:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312949fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789303962.199375:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc9427d9 reply state 0000000003fc1d8b transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303962.199385:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789303962.199544:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:36704:x1876219765400576:12345-192.168.202.29@tcp:36:rm.0 Request processed in 3526us (3926us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789303962.199553:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 449 00010000:00010000:2.0:1789303962.218221:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.218245:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.218254:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.218260:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303962.218266:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.218274:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.218293:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c03db3300) 00010000:00010000:2.0:1789303962.218297:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303962.218302:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.218308:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294a04 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303962.243202:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303962.243302:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765400704 00000100:00100000:2.0:1789303962.243313:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765400704 00000100:00100000:2.0:1789303962.243382:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 450 00000100:00100000:2.0:1789303962.243393:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:36708:x1876219765400704:12345-192.168.202.29@tcp:101:mkdir.0 00010000:00010000:2.0:1789303962.243420:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303962.243454:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231294a12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff89 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.243516:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294a19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.243532:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.243545:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789303962.243584:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789303962.243587:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789303962.243618:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294a19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.243638:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231294a12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff89 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.243665:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294a19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff89 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.243671:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2e92aa00) 00010000:00010000:2.0:1789303962.243673:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789303962.243676:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789303962.243807:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:36708:x1876219765400704:12345-192.168.202.29@tcp:101:mkdir.0 Request processed in 417us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303962.243813:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 450 00000100:00100000:1.0:1789303962.247076:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303962.247316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303962.250833:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 452 00000100:00100000:1.0:1789303962.250851:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:36708:x1876219765401088:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:1.0:1789303962.250918:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303962.250946:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294a19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff89 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.250968:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2e92aa00) 00010000:00010000:1.0:1789303962.250980:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789303962.251054:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.251080:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.251107:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.251122:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a27 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.251129:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.251146:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789303962.252034:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:1.0:1789303962.252049:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.252057:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a20 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.252064:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.252079:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303962.252083:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.252115:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a20 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.252128:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c03db3800) 00010000:00010000:1.0:1789303962.252131:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303962.252135:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.252142:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789303962.252159:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac5de1b9 reply state 0000000060088705 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294a27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303962.252168:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789303962.252275:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:36708:x1876219765401088:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 1430us (4957us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789303962.252285:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 452 00000100:00100000:2.0:1789303962.316299:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303962.316578:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765401216 00000100:00100000:1.0:1789303962.316590:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765401216 00000100:00100000:1.0:1789303962.316725:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 453 00000100:00100000:1.0:1789303962.316738:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:36712:x1876219765401216:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:1.0:1789303962.316769:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789303962.316798:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff90 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.316881:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294a35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.316897:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.316911:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789303962.316949:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789303962.316953:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789303962.316974:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.316998:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff90 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.317017:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294a35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff90 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.317025:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c03db3800) 00010000:00010000:1.0:1789303962.317028:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789303962.317032:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8fa00, rc 0) 00000100:00100000:1.0:1789303962.317141:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:36712:x1876219765401216:12345-192.168.202.29@tcp:101:chown.0 Request processed in 356us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303962.317149:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 453 00000100:00100000:0.0:1789303962.329432:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303962.329594:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765401344 00000100:00100000:2.0:1789303962.329618:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765401344 00000100:00100000:2.0:1789303962.329916:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 454 00000100:00100000:2.0:1789303962.329928:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:36712:x1876219765401344:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:2.0:1789303962.329956:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303962.329983:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231294a3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff97 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330051:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294a43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330069:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294a43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330085:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294a43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330146:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294a4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330154:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330161:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330264:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294a51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330273:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330302:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789303962.330343:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789303962.330347:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789303962.330380:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294a51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330393:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294a43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330400:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294a43 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330407:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294a43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330413:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303962.330417:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294a43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330425:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294a43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330437:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c03db3800) 00010000:00010000:2.0:1789303962.330439:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303962.330445:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294a43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330450:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294a43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330473:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330479:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294a4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330494:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294a4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330499:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303962.330502:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294a4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330509:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294a4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330516:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c2e92af00) 00010000:00010000:2.0:1789303962.330518:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303962.330521:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294a4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330526:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294a4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330553:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231294a3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff97 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330566:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294a51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff97 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.330583:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92a600) 00010000:00010000:2.0:1789303962.330585:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789303962.330588:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd200, rc 0) 00000100:00100000:2.0:1789303962.331009:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:36712:x1876219765401344:12345-192.168.202.29@tcp:101:chown.0 Request processed in 1079us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303962.331016:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 454 00000100:00100000:1.0:1789303962.339573:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765401600 00000100:00100000:1.0:1789303962.339587:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765401600 00000100:00100000:1.0:1789303962.339975:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 455 00000100:00100000:1.0:1789303962.339987:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:36712:x1876219765401600:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:1.0:1789303962.340040:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303962.340079:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294a51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff97 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.340117:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92a600) 00010000:00010000:1.0:1789303962.340128:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789303962.340168:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.340181:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303962.340199:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789303962.401757:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967476 is committed 00000004:00010000:1.0:1789303962.401951:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000201be489 reply state 00000000442afb3b transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303962.401968:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789303962.401987:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00080000:1.0:1789303962.402141:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789303962.402158:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:36712:x1876219765401600:12345-192.168.202.29@tcp:36:chown.0 Request processed in 62169us (63733us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789303962.402168:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 455 00010000:00010000:2.0:1789303962.402814:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.402826:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.402835:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.402841:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303962.402846:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.402854:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.402870:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c03db3100) 00010000:00010000:2.0:1789303962.402873:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789303962.402878:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303962.402884:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294a58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789303963.400061:0:61964:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc9615bc0 20000000:00000080:1.0:1789303963.400080:0:61964:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e76800 uarg=0000000000000000 00010000:00010000:1.0:1789303963.401900:0:61964:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789303963.401940:0:61964:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c03db3800) 00010000:00010000:1.0:1789303963.402068:0:61964:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789303963.402081:0:61964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294a35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff90 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303963.402495:0:61964:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789303963.402516:0:61964:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789303963.402533:0:61964:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303963.402547:0:61964:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312949be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312949b7 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303963.402556:0:61964:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303963.402604:0:61964:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312949be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312949b7 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303963.402618:0:61964:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312949be lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312949b7 expref: 18 pid: 5845 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303963.402631:0:61964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61964:1876219785487616:0@lo:104: 00000100:00100000:1.0:1789303963.402818:0:61964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303963.402919:0:61964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789303963.403014:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789303963.403028:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785487616 00000100:00100000:2.0:1789303963.403035:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785487616 00000100:00100000:1.0:1789303963.403483:0:61964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61964:1876219785487616:0@lo:104: 00010000:00010000:1.0:1789303963.403501:0:61964:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403603:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789303963.403610:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403617:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789303963.403622:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403630:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789303963.403650:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303963.403656:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789303963.403689:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403696:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789303963.403719:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403725:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312949b7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312949be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403740:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303963.403751:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303963.403753:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303963.403766:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785487744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789303963.403801:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303963.403854:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785487744 00000100:00100000:2.0:1789303963.403858:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785487744 00010000:00010000:2.0:1789303963.403876:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312949be lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312949b7 expref: 19 pid: 5845 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303963.403896:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789303963.403902:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785487744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789303963.403912:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303963.403916:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312949be lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312949b7 expref: 19 pid: 5845 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403925:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312949be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312949b7 expref: 19 pid: 5845 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403935:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312949be lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312949b7 expref: 19 pid: 5845 timeout: 1563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403957:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403965:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403978:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403984:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.403995:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.404001:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.404006:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789303963.404009:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.404016:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.404026:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303963.404034:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789303963.404062:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785487744:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303963.404069:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789303963.404117:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785487744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789303963.405170:0:61964:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303963.405195:0:61964:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303963.405201:0:61964:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294a5f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61964 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303963.986319:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789303964.215566:0:62012:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffffb340c30 20000000:00000080:1.0:1789303964.217185:0:62012:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e74800 uarg=0000000000000000 10000000:01000000:1.0:1789303964.217246:0:62012:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789303964.217271:0:62012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303964.217290:0:62012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303964.217303:0:62012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303964.217311:0:62012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303964.217318:0:62012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303964.217326:0:62012:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303964.217333:0:62012:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303964.217338:0:62012:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303964.217361:0:62012:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303964.217377:0:62012:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303964.217386:0:62012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303964.217393:0:62012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294a66 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303964.440557:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789303964.440592:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785487872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789303964.440682:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789303964.443561:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789303964.443739:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785487872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789303964.522764:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765401728 00000100:00100000:1.0:1789303964.522769:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765401728 00000100:00100000:1.0:1789303964.522806:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 866 00000100:00100000:1.0:1789303964.522814:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765401728:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303964.522853:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765401728:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303964.522860:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 866 00000100:00100000:1.0:1789303964.522890:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765401856 00000100:00100000:1.0:1789303964.522893:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765401856 00000100:00100000:1.0:1789303964.522924:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 966 00000100:00100000:1.0:1789303964.522931:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765401856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303964.522957:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765401856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303964.522964:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 966 00000100:00080000:2.0:1789303964.523065:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789303964.523070:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789303964.523071:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789303965.011735:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789303965.333210:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789303965.333219:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789303965.333225:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789303965.333277:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303965.333297:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303965.333307:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303965.333331:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785488000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789303965.333393:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303965.333439:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c36d60780 going to sleep for 11 seconds 00000100:00100000:1.0:1789303965.333519:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785488000 00000100:00100000:1.0:1789303965.333527:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785488000 00000100:00100000:1.0:1789303965.333591:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1789303965.333601:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785488000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789303965.333616:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789303965.333628:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294a74 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294a6d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303965.333651:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294a74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294a6d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303965.333662:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294a74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294a6d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303965.333672:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e600, rc 0) 00000100:00100000:1.0:1789303965.333720:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785488000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303965.333727:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1789303965.333857:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785488000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303965.333878:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303965.333888:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303965.333914:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789303965.333920:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303965.333927:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303965.461483:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785488128 00000100:00100000:2.0:1789303965.461503:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785488128 00000100:00100000:2.0:1789303965.461583:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1789303965.461596:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785488128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789303965.461660:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789303965.461716:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785488128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303965.461723:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1789303965.461780:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785488128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789303966.035519:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303966.994579:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785488256:0@lo:400:kworker.0 00000100:00100000:2.0:1789303966.994661:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303966.994773:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785488384:0@lo:400:kworker.0 00000100:00100000:1.0:1789303966.994813:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303966.995430:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785488512:0@lo:400:kworker.0 00000100:00100000:0.0:1789303966.995446:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785488640:0@lo:400:kworker.0 00000100:00100000:1.0:1789303966.995463:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303966.995489:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303966.995515:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785488512 00000100:00100000:1.0:1789303966.995521:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785488512 00000100:00100000:0.0:1789303966.995543:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785488384 00000100:00100000:0.0:1789303966.995549:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785488384 00000100:00100000:1.0:1789303966.995568:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1789303966.995577:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785488512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303966.995593:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785488640 00000100:00100000:0.0:1789303966.995598:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785488640 00000100:00100000:1.0:1789303966.995622:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785488512:12345-0@lo:400:kworker.0 Request processed in 46us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303966.995636:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:0.0:1789303966.995647:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785488384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303966.995654:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1789303966.995688:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785488384:12345-0@lo:400:kworker.0 Request processed in 43us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303966.995692:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1789303966.995703:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1789303966.995704:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785488640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303966.995749:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785488640:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303966.995755:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1789303966.995774:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785488512:0@lo:400:kworker.0 00000100:00100000:1.0:1789303966.995801:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785488640:0@lo:400:kworker.0 00000100:00100000:0.0:1789303966.995807:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785488896:0@lo:400:kworker.0 00000100:00100000:0.0:1789303966.995834:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303966.995867:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785488384:0@lo:400:kworker.0 00000100:00100000:0.0:1789303966.995878:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789303966.995883:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785488768:0@lo:400:kworker.0 00000100:00100000:1.0:1789303966.995901:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785488896 00000100:00100000:1.0:1789303966.995906:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785488896 00000100:00100000:1.0:1789303966.995930:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1789303966.995935:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785488896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303966.995964:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785488896:12345-0@lo:400:kworker.0 Request processed in 29us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303966.995969:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1789303966.996128:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303966.996177:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785488768 00000100:00100000:1.0:1789303966.996181:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785488768 00000100:00100000:1.0:1789303966.996214:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:1.0:1789303966.996221:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785488768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303966.996269:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785488768:12345-0@lo:400:kworker.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303966.996277:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785488768:0@lo:400:kworker.0 00000100:00100000:1.0:1789303966.996278:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1789303966.996295:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785488896:0@lo:400:kworker.0 00000100:00100000:2.0:1789303966.996680:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785488256:0@lo:400:kworker.0 00010000:00010000:0.0:1789303967.058276:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303967.301131:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765402240 00000100:00100000:1.0:1789303967.301142:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765402240 00000100:00100000:1.0:1789303967.301226:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:1.0:1789303967.301237:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:5593:x1876219765402240:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789303967.301272:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303967.301275:0:5838:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231294a35) 00010000:00010000:1.0:1789303967.301277:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789303967.301337:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:5593:x1876219765402240:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 101us (511us total) trans 0 rc 116/116 00000100:00100000:1.0:1789303967.301345:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00010000:00010000:1.0:1789303968.082260:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303969.113764:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789303969.158065:0:62258:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffe191f690 20000000:00000080:1.0:1789303969.158085:0:62258:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c388d7800 uarg=0000000000000000 00010000:00010000:1.0:1789303969.159255:0:62258:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789303969.159266:0:62258:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789303969.159276:0:62258:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789303969.159293:0:62258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303969.159307:0:62258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294a74 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294a6d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303969.159313:0:62258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303969.159347:0:62258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294a74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294a6d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303969.159358:0:62258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294a74 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294a6d expref: 18 pid: 5845 timeout: 1568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303969.159370:0:62258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62258:1876219785489024:0@lo:104: 00000100:00100000:1.0:1789303969.159421:0:62258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303969.159487:0:62258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1789303969.159575:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785489024 00000100:00100000:2.0:1789303969.159583:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785489024 00000100:00100000:2.0:1789303969.159631:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789303969.159639:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:62258:x1876219785489024:12345-0@lo:104: 00010000:00010000:2.0:1789303969.159650:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159701:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303969.159706:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:62258:x1876219785489024:12345-0@lo:104: Request processed in 68us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303969.159711:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00010000:00010000:2.0:1789303969.159728:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789303969.159733:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159739:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789303969.159748:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159755:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789303969.159760:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303969.159764:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789303969.159785:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159788:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789303969.159803:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159808:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231294a6d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294a74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159822:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303969.159823:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303969.159824:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303969.159837:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785489152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789303969.159860:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303969.159886:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785489152 00000100:00100000:2.0:1789303969.159889:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785489152 00010000:00010000:2.0:1789303969.159902:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294a74 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294a6d expref: 19 pid: 5845 timeout: 1568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303969.159916:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789303969.159925:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0386bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785489152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789303969.159933:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303969.159936:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294a74 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294a6d expref: 19 pid: 5845 timeout: 1568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159943:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294a74 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294a6d expref: 19 pid: 5845 timeout: 1568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159954:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159959:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159967:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159972:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159977:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159981:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159983:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789303969.159986:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.159991:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.160000:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303969.160006:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789303969.160026:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0386bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785489152:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303969.160030:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789303969.160077:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785489152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789303969.160897:0:62258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294a74 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294a6d expref: 18 pid: 5845 timeout: 1568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303969.160906:0:62258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62258:1876219785489024:0@lo:104: 00010000:00010000:1.0:1789303969.160917:0:62258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303969.160923:0:62258:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303969.160927:0:62258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303969.160930:0:62258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294a7b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303969.639795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303969.639840:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303969.639872:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303969.639904:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303969.639932:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765402496 00000100:00100000:1.0:1789303969.639942:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765402496 00000100:00100000:1.0:1789303969.640009:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 970 00000100:00100000:1.0:1789303969.640020:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765402496:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303969.640125:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765402496:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 106us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303969.640133:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 970 00000100:00100000:1.0:1789303969.640159:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765402624 00000100:00100000:1.0:1789303969.640177:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765402624 00000100:00100000:1.0:1789303969.640205:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765402752 00000100:00100000:1.0:1789303969.640208:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765402752 00000100:00100000:1.0:1789303969.640230:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 671 00000100:00100000:1.0:1789303969.640236:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765402624:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303969.640266:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765402624:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303969.640272:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 671 00000100:00100000:1.0:1789303969.640284:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 672 00000100:00100000:1.0:1789303969.640291:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765402752:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303969.640317:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765402752:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303969.640323:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 672 00000100:00080000:1.0:1789303969.640339:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789303969.640342:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789303969.640345:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789303969.640887:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765402368 00000100:00100000:0.0:1789303969.640893:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765402368 00000100:00100000:0.0:1789303969.640931:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 869 00000100:00100000:0.0:1789303969.640939:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765402368:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303969.640980:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765402368:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 42us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303969.640987:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 869 00010000:00010000:2.0:1789303970.131447:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303970.581830:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785489408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303970.581905:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303970.582773:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785489408 00000100:00100000:1.0:1789303970.582783:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785489408 00000100:00100000:1.0:1789303970.582849:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1789303970.582859:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785489408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789303970.582893:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303970.598813:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785489408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15946us (16897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303970.598827:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1789303970.598957:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785489408:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789303970.835075:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789303970.835084:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789303970.835119:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789303970.835411:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303970.835424:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303970.835436:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303970.835464:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785489536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789303970.835567:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303970.835688:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789303970.836254:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785489536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303970.836270:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303970.836290:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303970.836308:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789303970.836314:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303970.836322:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303971.154445:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303972.115736:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785489664:0@lo:400:kworker.0 00000100:00100000:2.0:1789303972.115926:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303972.116007:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785489664 00000100:00100000:1.0:1789303972.116016:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785489664 00000100:00100000:1.0:1789303972.116066:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1789303972.116261:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785489664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303972.122190:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785489920:0@lo:400:kworker.0 00000100:00100000:0.0:1789303972.122273:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303972.122324:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789303972.122331:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785489792:0@lo:400:kworker.0 00000100:00100000:0.0:1789303972.122356:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303972.122405:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785489920 00000100:00100000:0.0:1789303972.122412:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785489920 00000100:00100000:0.0:1789303972.122486:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1789303972.122496:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785489920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303972.122564:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785489920:12345-0@lo:400:kworker.0 Request processed in 70us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303972.122572:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1789303972.122596:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785489792 00000100:00100000:0.0:1789303972.122600:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785489792 00000100:00100000:0.0:1789303972.122641:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1789303972.122646:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785489792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789303972.122677:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785489792:12345-0@lo:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303972.122683:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00080000:0.0:1789303972.122699:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789303972.122733:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785489792:0@lo:400:kworker.0 00000100:00100000:0.0:1789303972.122744:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3709a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785489920:0@lo:400:kworker.0 00000100:00100000:1.0:1789303972.123977:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785489664:12345-0@lo:400:kworker.0 Request processed in 7886us (8046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303972.123988:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785489664:0@lo:400:kworker.0 00000100:00100000:1.0:1789303972.123991:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1789303972.124012:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789303972.124022:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785490048:0@lo:400:kworker.0 00000100:00100000:2.0:1789303972.124061:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303972.124123:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785490048 00000100:00100000:2.0:1789303972.124127:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785490048 00000100:00100000:2.0:1789303972.124161:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1789303972.124183:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785490048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303972.124231:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785490048:12345-0@lo:400:kworker.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303972.124249:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00080000:2.0:1789303972.124273:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303972.124296:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785490048:0@lo:400:kworker.0 00000100:00100000:0.0:1789303972.126800:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785490304:0@lo:400:kworker.0 00000100:00100000:0.0:1789303972.126865:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303972.127435:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785490304 00000100:00100000:1.0:1789303972.127445:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785490304 00000100:00100000:1.0:1789303972.127853:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785490176:0@lo:400:kworker.0 00000100:00100000:1.0:1789303972.127890:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789303972.127978:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789303972.128730:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789303972.128807:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785490176:0@lo:400:kworker.0 00010000:00010000:2.0:1789303972.182045:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303972.736831:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303972.736893:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765402880 00000100:00100000:0.0:1789303972.736904:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765402880 00000100:00080000:1.0:1789303972.736968:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789303972.736984:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 456 00000100:00100000:0.0:1789303972.736995:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:36890:x1876219765402880:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789303972.737016:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789303972.737042:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294a90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fff9e expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.737123:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231294a97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.737138:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231294a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.737153:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231294a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789303972.737217:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789303972.737222:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789303972.737241:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231294a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.737266:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294a90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff9e expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.737283:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231294a97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fff9e expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.737291:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14afe400) 00010000:00010000:0.0:1789303972.737294:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789303972.737298:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa600, rc 0) 00000100:00100000:0.0:1789303972.737359:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:36890:x1876219765402880:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 366us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303972.737367:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 456 00000100:00100000:0.0:1789303972.740542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303972.740866:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765403008 00000100:00100000:1.0:1789303972.740876:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765403008 00000100:00100000:0.0:1789303972.741729:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 457 00000100:00100000:0.0:1789303972.741742:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:36890:x1876219765403008:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789303972.741763:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789303972.741782:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231294a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fffa5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.741857:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294aa5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.741883:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.741895:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.741910:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231294aac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.741918:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231294aac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.741924:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231294aac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742356:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742365:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742373:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789303972.742460:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:0.0:1789303972.742465:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789303972.742485:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742496:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294aa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742522:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294aa5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742529:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742535:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789303972.742540:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294aa5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742548:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294aa5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742560:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14afe400) 00010000:00010000:0.0:1789303972.742563:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789303972.742568:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294aa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742574:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294aa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742585:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231294aac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742592:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231294aac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742598:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231294aac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742603:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789303972.742612:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231294aac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742619:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231294aac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742626:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c14afef00) 00010000:00010000:0.0:1789303972.742629:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789303972.742632:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231294aac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742638:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231294aac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742727:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231294a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffa5 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742740:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffa5 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303972.742748:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c14afe600) 00010000:00010000:0.0:1789303972.742750:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789303972.742752:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:0.0:1789303972.743067:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:36890:x1876219765403008:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 1327us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303972.743075:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 457 00000100:00100000:1.0:1789303972.757572:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765403264 00000100:00100000:1.0:1789303972.757586:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765403264 00000100:00100000:1.0:1789303972.757650:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 458 00000100:00100000:1.0:1789303972.757661:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3709aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:36890:x1876219765403264:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789303972.757713:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303972.757741:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffa5 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303972.757758:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c14afe600) 00010000:00010000:1.0:1789303972.757769:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789303972.757794:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294aba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303972.757808:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294aba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303972.757824:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294aba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789303972.832015:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fb9add2 reply state 000000001d7f211d transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294aba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303972.832044:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789303972.832061:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000001:00080000:2.0:1789303972.832205:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967477 is committed 00010000:00080000:1.0:1789303972.832495:0:7654:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789303972.832570:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3709aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:36890:x1876219765403264:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 74906us (77376us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789303972.832580:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 458 00010000:00010000:0.0:1789303973.207892:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303973.744984:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785490432 00000100:00100000:2.0:1789303973.744993:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785490432 00000100:00100000:2.0:1789303973.745081:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789303973.745113:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37098700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:62454:x1876219785490432:12345-0@lo:104: 00010000:00010000:2.0:1789303973.745127:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303973.745206:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303973.745212:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37098700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:62454:x1876219785490432:12345-0@lo:104: Request processed in 124us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303973.745218:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789303973.745297:0:62454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62454:1876219785490432:0@lo:104: 00010000:00010000:0.0:1789303973.745316:0:62454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745541:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303973.745557:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745565:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789303973.745569:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745578:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789303973.745585:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789303973.745591:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789303973.745627:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745644:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789303973.745666:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745673:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231294a82 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294a89 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745689:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303973.745691:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303973.745693:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303973.745704:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785490560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789303973.745749:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303973.745791:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785490560 00000100:00100000:1.0:1789303973.745795:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785490560 00010000:00010000:1.0:1789303973.745814:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231294a89 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294a82 expref: 19 pid: 5847 timeout: 1573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303973.745835:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789303973.745841:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785490560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789303973.745851:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303973.745856:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231294a89 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294a82 expref: 19 pid: 5847 timeout: 1573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745865:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231294a89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294a82 expref: 19 pid: 5847 timeout: 1573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745877:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231294a89 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294a82 expref: 19 pid: 5847 timeout: 1573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745901:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745908:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745921:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745927:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745934:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745941:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745946:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303973.745950:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745956:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745966:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303973.745976:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789303973.746006:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785490560:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303973.746019:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789303973.746049:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785490560:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789303973.746356:0:62454:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303973.746372:0:62454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303973.746378:0:62454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231294ac1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303974.226206:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303974.688851:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789303974.688878:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785490688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789303974.688975:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303974.689337:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785490688 00000100:00100000:1.0:1789303974.689347:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785490688 00000100:00100000:1.0:1789303974.689447:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1789303974.689456:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785490688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789303974.689504:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303974.689565:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785490688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303974.689572:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00080000:2.0:1789303974.691690:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789303974.757813:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765403648 00000100:00100000:1.0:1789303974.757825:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765403648 00000100:00100000:1.0:1789303974.757899:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765403776 00000100:00100000:1.0:1789303974.757902:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765403776 00000100:00100000:1.0:1789303974.757930:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 233 00000100:00100000:1.0:1789303974.757941:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765403648:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:1.0:1789303974.757974:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231294606 00000100:00080000:1.0:1789303974.757984:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2b02d13000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789303974.758027:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1789303974.758343:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765403648:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 403us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303974.758351:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 233 00000100:00100000:1.0:1789303974.758369:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 234 00000100:00100000:1.0:1789303974.758376:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765403776:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:1.0:1789303974.758388:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231294908 00000100:00080000:1.0:1789303974.758409:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2b01e8b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789303974.758430:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1789303974.758581:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765403776:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 204us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303974.758587:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 234 00010000:00010000:1.0:1789303974.758613:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303974.758699:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303974.763298:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303974.763355:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303974.763391:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765403520 00000100:00100000:1.0:1789303974.763401:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765403520 00000100:00100000:1.0:1789303974.763457:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 974 00000100:00100000:1.0:1789303974.763467:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765403520:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303974.763564:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765403520:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303974.763571:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 974 00000100:00100000:2.0:1789303974.763885:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765403392 00000100:00100000:2.0:1789303974.763890:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765403392 00000100:00100000:2.0:1789303974.763930:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 872 00000100:00100000:2.0:1789303974.763939:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765403392:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303974.763980:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765403392:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 43us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303974.764001:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 872 00010000:00010000:0.0:1789303975.250248:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303975.705275:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785490944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303975.705354:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303975.705814:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785490944 00000100:00100000:0.0:1789303975.705822:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785490944 00000100:00100000:0.0:1789303975.705886:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1789303975.705896:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785490944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789303975.705930:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789303975.709853:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785490944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3949us (4489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303975.709869:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00080000:0.0:1789303975.709908:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789303976.275222:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303977.254416:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785491200:0@lo:400:kworker.0 00000100:00100000:2.0:1789303977.254496:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303977.254652:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785491072:0@lo:400:kworker.0 00000100:00100000:1.0:1789303977.254690:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303977.254737:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785491584:0@lo:400:kworker.0 00000100:00100000:1.0:1789303977.254768:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785491072 00000100:00100000:1.0:1789303977.254774:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785491072 00000100:00100000:1.0:1789303977.254814:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:1.0:1789303977.254822:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785491072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303977.254875:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785491072:12345-0@lo:400:kworker.0 Request processed in 52us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303977.254893:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1789303977.255140:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785491712:0@lo:400:kworker.0 00000100:00100000:2.0:1789303977.255165:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303977.255197:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785491328:0@lo:400:kworker.0 00000100:00100000:2.0:1789303977.255218:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303977.255236:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789303977.255242:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785491456:0@lo:400:kworker.0 00000100:00100000:2.0:1789303977.255263:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303977.255291:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785491712 00000100:00100000:2.0:1789303977.255295:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785491712 00000100:00100000:1.0:1789303977.255477:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303977.255525:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785491072:0@lo:400:kworker.0 00000100:00100000:1.0:1789303977.255556:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785491200 00000100:00100000:1.0:1789303977.255560:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785491200 00000100:00100000:1.0:1789303977.255583:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785491456 00000100:00100000:1.0:1789303977.255586:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785491456 00000100:00100000:1.0:1789303977.255600:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785491584 00000100:00100000:1.0:1789303977.255602:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785491584 00000100:00100000:1.0:1789303977.255616:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1789303977.255622:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785491200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303977.255657:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785491200:12345-0@lo:400:kworker.0 Request processed in 35us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303977.255663:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1789303977.255673:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1789303977.255678:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785491456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303977.255701:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785491456:12345-0@lo:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303977.255706:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1789303977.255715:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1789303977.255720:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785491584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303977.255741:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785491584:12345-0@lo:400:kworker.0 Request processed in 21us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303977.255746:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1789303977.255772:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785491456:0@lo:400:kworker.0 00000100:00100000:1.0:1789303977.255802:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785491584:0@lo:400:kworker.0 00000100:00100000:2.0:1789303977.256061:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785491328 00000100:00100000:2.0:1789303977.256065:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785491328 00000100:00100000:2.0:1789303977.256106:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1789303977.256113:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785491712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303977.256142:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785491712:12345-0@lo:400:kworker.0 Request processed in 30us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303977.256147:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1789303977.256158:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1789303977.256163:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785491328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303977.256186:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785491328:12345-0@lo:400:kworker.0 Request processed in 23us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303977.256200:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00080000:2.0:1789303977.256223:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789303977.256227:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789303977.256229:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789303977.256248:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785491200:0@lo:400:kworker.0 00000100:00100000:2.0:1789303977.256257:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785491712:0@lo:400:kworker.0 00000100:00100000:1.0:1789303977.257422:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785491328:0@lo:400:kworker.0 00000100:00100000:1.0:1789303977.257502:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303977.257710:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765403904 00000100:00100000:2.0:1789303977.257723:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765403904 00000100:00100000:2.0:1789303977.257769:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 459 00000100:00100000:2.0:1789303977.257777:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:36967:x1876219765403904:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789303977.257792:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303977.257815:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294ad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fffac expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.257877:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294add lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.257891:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.257904:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.257928:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294ae4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.257935:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.257954:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258667:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294aeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258679:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258687:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789303977.258709:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789303977.258713:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789303977.258732:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294aeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258745:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294add lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258751:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294add lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258758:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294add lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258764:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303977.258769:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294add lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258775:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294add lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258795:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2e92a400) 00010000:00010000:2.0:1789303977.258798:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303977.258802:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294add lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258809:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294add lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258822:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258829:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258835:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258840:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303977.258843:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258849:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258855:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c2e92a900) 00010000:00010000:2.0:1789303977.258857:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303977.258860:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294ae4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258865:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294ae4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.258967:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294ad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffac expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789303977.259113:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789303977.259173:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294aeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffac expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.259180:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92a200) 00010000:00010000:2.0:1789303977.259224:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789303977.259226:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecca00, rc 0) 00000100:00100000:2.0:1789303977.259300:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:36967:x1876219765403904:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1522us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303977.259307:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 459 00000100:00100000:1.0:1789303977.270726:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303977.270819:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765404160 00000100:00100000:0.0:1789303977.270830:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765404160 00000100:00100000:0.0:1789303977.270892:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 460 00000100:00100000:0.0:1789303977.270903:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:36967:x1876219765404160:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789303977.270933:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789303977.270955:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231294af2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fffb3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.271281:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231294af9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.271295:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231294af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.271307:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231294af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.271328:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.271335:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.271341:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789303977.272401:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00010000:00010000:1.0:1789303977.288774:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.288799:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.288813:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.288875:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231294af9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.288883:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231294af9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.288891:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231294af9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.288897:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303977.288901:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231294af9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.289068:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231294af9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.289083:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92a200) 00010000:00010000:1.0:1789303977.289114:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303977.289120:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231294af9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.289127:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231294af9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789303977.289145:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b411446 reply state 000000004c51af2e transno 4294967478 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303977.289155:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789303977.289199:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231294af2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffb3 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.289215:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffb3 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.289223:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9e2c03db3c00) 00010000:00010000:1.0:1789303977.289225:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789303977.289227:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ee00, rc 0) 00000100:00100000:1.0:1789303977.289305:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:36967:x1876219765404160:12345-192.168.202.29@tcp:101:touch.0 Request processed in 18403us (18588us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789303977.289314:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 460 00010000:00010000:2.0:1789303977.294434:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.294450:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.294466:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.294473:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303977.294477:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.294485:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.294500:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff9e2c14afe100) 00010000:00010000:2.0:1789303977.294517:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303977.294522:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.294528:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294b00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303977.300596:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303977.300668:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765404416 00000100:00100000:0.0:1789303977.300677:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765404416 00000100:00100000:0.0:1789303977.300728:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 461 00000100:00100000:0.0:1789303977.300738:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:36967:x1876219765404416:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:0.0:1789303977.300794:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789303977.300819:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231294b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffb3 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.300836:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9e2c03db3c00) 00010000:00010000:0.0:1789303977.300854:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789303977.300895:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.300920:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.300932:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789303977.301068:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065fb8e52 reply state 000000006321e702 transno 4294967479 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303977.301078:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789303977.301184:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:36967:x1876219765404416:12345-192.168.202.29@tcp:36:touch.0 Request processed in 446us (597us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789303977.301191:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 461 00010000:00010000:0.0:1789303977.301214:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303977.312447:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:2.0:1789303977.312490:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.312502:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.312510:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.312517:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303977.312522:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.312531:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.312548:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9e2c14afef00) 00010000:00010000:2.0:1789303977.312551:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303977.312557:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.312563:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231294b15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303977.312610:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765404544 00000100:00100000:2.0:1789303977.312632:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765404544 00000100:00100000:2.0:1789303977.312692:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 462 00000100:00100000:2.0:1789303977.312701:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:36967:x1876219765404544:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789303977.312727:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303977.312746:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294b1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fffba expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.312807:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294b1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffba expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.312821:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294b1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffba expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.312840:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9e2c2e92a400) 00010000:00010000:2.0:1789303977.312843:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789303977.312846:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789303977.312898:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:36967:x1876219765404544:12345-192.168.202.29@tcp:101:touch.0 Request processed in 197us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303977.312905:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 462 00000100:00100000:2.0:1789303977.326523:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303977.326558:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765404672 00000100:00100000:2.0:1789303977.326567:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765404672 00000100:00100000:2.0:1789303977.326607:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 235 00000100:00100000:2.0:1789303977.326616:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876219765404672:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:2.0:1789303977.326649:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1427 last 0 00000020:00000080:2.0:1789303977.326683:0:6693:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231294b23 00002000:00100000:2.0:1789303977.326696:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b01e99800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789303977.326731:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789303977.326821:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789303977.326849:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2b01e9a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789303977.326909:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765404672:12345-192.168.202.29@tcp:8:touch.0 Request processed in 293us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303977.326918:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 235 00000100:00100000:0.0:1789303977.349544:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303977.349663:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765404800 00000100:00100000:2.0:1789303977.349674:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765404800 00000100:00100000:2.0:1789303977.349753:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 236 00000100:00100000:2.0:1789303977.349763:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765404800:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:1.0:1789303977.350056:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789303977.423595:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789303977.423605:0:6723:0:(genops.c:885:class_export_put()) final put ffff9e2b02d12000/99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00080000:0.0:1789303977.423631:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00100000:0.0:1789303977.423638:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:1.0:1789303977.423938:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:0:x1876219765404800:12345-192.168.202.29@tcp:2:touch.0 Request processed in 74171us (74399us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789303977.423950:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 236 00000100:00100000:1.0:1789303977.427063:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303977.427233:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765405056 00000100:00100000:0.0:1789303977.427243:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765405056 00000100:00100000:0.0:1789303977.427290:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 52 00000100:00100000:0.0:1789303977.427300:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:36967:x1876219765405056:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:0.0:1789303977.427659:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:36967:x1876219765405056:12345-192.168.202.29@tcp:35:touch.0 Request processed in 358us (603us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789303977.427682:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 52 00000020:00000080:2.0:1789303977.428233:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b02d12000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0000 00000020:00000080:2.0:1789303977.428283:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b02d13000 for lustre-OST0000 00000100:00100000:1.0:1789303977.502573:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765405184 00000100:00100000:1.0:1789303977.502596:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765405184 00000100:00100000:1.0:1789303977.502662:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 463 00000100:00100000:1.0:1789303977.502672:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:36971:x1876219765405184:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789303977.502699:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789303977.502719:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294b2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fffc1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.502798:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294b31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.502818:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294b31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.502835:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294b31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.502852:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.502860:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.502867:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.502963:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294b3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.502973:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.502980:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789303977.503040:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 0 00000004:00200000:1.0:1789303977.503044:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789303977.503064:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503076:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294b3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503085:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294b31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503136:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294b31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503144:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294b31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503150:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303977.503155:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294b31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503163:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294b31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503174:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92a200) 00010000:00010000:1.0:1789303977.503178:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303977.503183:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294b31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503189:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231294b31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503213:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503220:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503226:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503232:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303977.503235:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503241:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503249:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff9e2c03db3500) 00010000:00010000:1.0:1789303977.503251:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303977.503254:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503260:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503294:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294b2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc1 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503308:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294b3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc1 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.503325:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9e2c2e92a400) 00010000:00010000:1.0:1789303977.503327:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789303977.503330:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e800, rc 0) 00000100:00100000:1.0:1789303977.503389:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:36971:x1876219765405184:12345-192.168.202.29@tcp:101:rm.0 Request processed in 718us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303977.503396:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 463 00000100:00100000:0.0:1789303977.510267:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303977.510359:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765405312 00000100:00100000:2.0:1789303977.510370:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765405312 00000100:00100000:2.0:1789303977.510485:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 237 00000100:00100000:2.0:1789303977.510496:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765405312:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789303977.510515:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303977.510535:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5d7944e/0xefc0bb7231294b46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fffc8 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789303977.510563:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x6aa69ca9, atime: 0x6aa69ca9, ctime: 0x6aa69ca9, blocks: 0x1 00010000:00010000:2.0:1789303977.510583:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=1427s v=(0 0) 00010000:00010000:2.0:1789303977.510588:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789303977.510597:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d7944e/0xefc0bb7231294b46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc8 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.510670:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e5d7944e/0xefc0bb7231294b46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc8 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.510685:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecde00, rc 0) 00000100:00100000:2.0:1789303977.510747:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765405312:12345-192.168.202.29@tcp:101:rm.0 Request processed in 253us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303977.510755:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 237 00000100:00100000:2.0:1789303977.524391:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303977.524513:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765405568 00000100:00100000:0.0:1789303977.524523:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765405568 00000100:00100000:0.0:1789303977.524583:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 464 00000100:00100000:0.0:1789303977.524594:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:36971:x1876219765405568:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:0.0:1789303977.524655:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789303977.524683:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294b3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc1 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.524708:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294b1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffba expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.524721:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9e2c2e92a400) 00010000:00010000:0.0:1789303977.524732:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789303977.524756:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294b4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.524770:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294b4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.524780:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294b4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.524795:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.524803:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.524825:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.524929:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294b5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.524937:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294b5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.524944:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294b5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789303977.525564:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9152 00000004:00080000:0.0:1789303977.525575:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1427203483956ns, next at 1428203481620ns, rc = 0 00010000:00010000:0.0:1789303977.525633:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525643:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525652:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525660:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525666:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525673:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525701:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789303977.525721:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294b5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525727:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294b5b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525733:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294b5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525738:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789303977.525741:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294b5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525748:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294b5b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525757:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9e2c14afee00) 00010000:00010000:0.0:1789303977.525759:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789303977.525763:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294b5b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525768:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231294b5b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525782:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294b4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525788:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294b4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525803:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294b4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525808:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789303977.525811:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294b4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525818:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294b4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525826:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92a200) 00010000:00010000:0.0:1789303977.525829:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789303977.525832:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294b4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303977.525836:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294b4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789303977.525845:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007661c981 reply state 000000009d808080 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303977.525854:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789303977.525937:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:36971:x1876219765405568:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1344us (1554us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789303977.525946:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 464 00010000:00010000:1.0:1789303977.526078:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303977.526085:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.526113:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303977.526116:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.526123:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.526133:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff9e2c14afee00) 00010000:00010000:1.0:1789303977.526135:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789303977.526138:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.526143:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294b62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303977.526169:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303977.526172:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303977.526173:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789303977.530014:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.530033:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.530041:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.530047:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303977.530051:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.530069:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.530086:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff9e2c14afeb00) 00010000:00010000:2.0:1789303977.530122:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303977.530128:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303977.530149:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294b54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303978.323391:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789303978.325397:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967481 is committed 00000004:00080000:0.0:1789303978.325408:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 36 committed 00000001:00100000:0.0:1789303978.326827:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789303978.326833:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2b01e8c000/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789303978.326873:0:490:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b01e8c000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:0.0:1789303978.326922:0:490:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b01e8b000 for lustre-OST0001 00000100:00100000:0.0:1789303978.328931:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785491840 00000100:00100000:0.0:1789303978.328938:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785491840 00000100:00100000:0.0:1789303978.328990:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789303978.328999:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785491840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789303978.329030:0:17212:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:15 count 1 00010000:00010000:0.0:1789303978.329057:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303978.329078:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5d7944e/0xefc0bb7231294b46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc8 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303978.329105:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789303978.329110:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789303978.329116:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303978.329145:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e5d7944e/0xefc0bb7231294b46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc8 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303978.329159:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e5d7944e/0xefc0bb7231294b46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc8 expref: 5 pid: 6693 timeout: 1528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303978.329170:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785491968:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789303978.329300:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03f11a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789303978.344235:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303978.344381:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765405696 00000100:00100000:2.0:1789303978.344390:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765405696 00010000:00010000:2.0:1789303978.344428:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d7944e/0xefc0bb7231294b46 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc8 expref: 6 pid: 6693 timeout: 1528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303978.344475:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 286 00000100:00100000:2.0:1789303978.344486:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765405696:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789303978.344509:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303978.344515:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e5d7944e/0xefc0bb7231294b46 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc8 expref: 6 pid: 6693 timeout: 1528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303978.344530:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e5d7944e/0xefc0bb7231294b46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc8 expref: 6 pid: 6693 timeout: 1528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303978.344556:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789303978.344561:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789303978.344566:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303978.344577:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303978.344597:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789303978.344664:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765405696:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 179us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303978.344673:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 286 00010000:00010000:1.0:1789303978.349554:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5d7944e/0xefc0bb7231294b46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffc8 expref: 5 pid: 6693 timeout: 1528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303978.349584:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785491968:192.168.202.29@tcp:104: 00010000:00010000:1.0:1789303978.349608:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303978.349619:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303978.349626:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303978.349638:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303978.349645:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303978.349666:0:17212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789303978.350284:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789303978.350292:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303978.350301:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789303978.350306:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303978.350316:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303978.350334:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303978.350342:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231294b69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303978.350363:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789303978.350365:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789303978.350367:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303978.350605:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785491840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21605us (21767us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789303978.350615:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000004:00080000:0.0:1789303978.350753:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c02f2e680/2, rc 0, transno 4294967326 00000100:00100000:0.0:1789303978.350760:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785491840:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1789303979.298656:0:62702:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd89b5a160 20000000:00000080:2.0:1789303979.298675:0:62702:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f6b1000 uarg=0000000000000000 00010000:00010000:2.0:1789303979.299200:0:62702:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789303979.299229:0:62702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92a200) 00010000:00010000:2.0:1789303979.299232:0:62702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789303979.299243:0:62702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294aeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffac expref: 5 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303979.299265:0:62702:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789303979.299282:0:62702:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789303979.299298:0:62702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303979.299312:0:62702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294acf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294ac8 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303979.299322:0:62702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303979.299363:0:62702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294acf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294ac8 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303979.299378:0:62702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294acf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294ac8 expref: 18 pid: 5845 timeout: 1578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303979.299392:0:62702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62702:1876219785492096:0@lo:104: 00000100:00100000:2.0:1789303979.299653:0:62702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303979.299718:0:62702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05ad7b40 going to sleep for 11 seconds 00010000:00010000:1.0:1789303979.300119:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303979.300126:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231294ac8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294acf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300134:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789303979.300146:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231294ac8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294acf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300156:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231294ac8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294acf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789303979.300162:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231294ac8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294acf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789303979.300166:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789303979.300196:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231294ac8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294acf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300202:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789303979.300231:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231294ac8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294acf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300238:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231294ac8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294acf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300255:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303979.300257:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303979.300258:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303979.300335:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785492224 00000100:00100000:1.0:1789303979.300339:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785492224 00010000:00010000:1.0:1789303979.300355:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294acf lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294ac8 expref: 19 pid: 5845 timeout: 1578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303979.300377:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789303979.300382:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785492224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789303979.300391:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303979.300400:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294acf lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294ac8 expref: 19 pid: 5845 timeout: 1578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300407:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294acf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294ac8 expref: 19 pid: 5845 timeout: 1578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300419:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300425:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300435:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300452:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300459:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300469:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300475:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303979.300480:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300489:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300497:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303979.300515:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789303979.300556:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785492224:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303979.300563:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00010000:2.0:1789303979.302866:0:62702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294acf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294ac8 expref: 18 pid: 5845 timeout: 1578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303979.302902:0:62702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62702:1876219785492096:0@lo:104: 00010000:00010000:2.0:1789303979.302927:0:62702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303979.302938:0:62702:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303979.302945:0:62702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303979.302950:0:62702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231294b70 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303979.349478:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303979.873692:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303979.873751:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303979.873789:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303979.873998:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765405952 00000100:00100000:1.0:1789303979.874008:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765405952 00000100:00100000:1.0:1789303979.874084:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 978 00000100:00100000:1.0:1789303979.874133:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765405952:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789303979.874206:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765405952:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 77us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303979.874212:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 978 00000100:00080000:0.0:1789303979.874323:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303979.874841:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765406080 00000100:00100000:2.0:1789303979.874847:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765406080 00000100:00100000:2.0:1789303979.874906:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 677 00000100:00100000:2.0:1789303979.874915:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765406080:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1789303979.874939:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789303979.874961:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765406080:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 47us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303979.874968:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 677 00010000:00010000:1.0:1789303980.373305:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303980.818458:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785492480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303980.818533:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303980.818613:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785492480 00000100:00100000:1.0:1789303980.818623:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785492480 00000100:00080000:2.0:1789303980.818651:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789303980.818698:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1789303980.818707:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785492480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789303980.818743:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303980.818805:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785492480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303980.818812:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 10000000:01000000:0.0:1789303981.271786:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789303981.271794:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789303981.271799:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789303981.271853:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303981.271866:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303981.271878:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303981.271905:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785492608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789303981.271976:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303981.272022:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05ad7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789303981.272519:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785492608 00000100:00100000:1.0:1789303981.272529:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785492608 00000100:00100000:1.0:1789303981.272593:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1789303981.272603:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785492608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789303981.272616:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789303981.272640:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294b7e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294b77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303981.272676:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294b7e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294b77 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303981.272689:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294b7e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294b77 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303981.272698:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ee00, rc 0) 00000100:00100000:1.0:1789303981.272755:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785492608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303981.272762:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1789303981.272887:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785492608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789303981.272903:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303981.272913:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789303981.272935:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789303981.272941:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303981.272949:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303981.394315:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303982.356371:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785492864 00000100:00100000:2.0:1789303982.356376:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785492864 00000100:00100000:2.0:1789303982.356433:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785493248 00000100:00100000:2.0:1789303982.356436:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785493248 00000100:00100000:2.0:1789303982.356477:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785493120 00000100:00100000:2.0:1789303982.356481:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785493120 00000100:00100000:2.0:1789303982.356510:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1789303982.356518:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785492864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303982.356559:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785492864:12345-0@lo:400:kworker.0 Request processed in 42us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303982.356565:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1789303982.356578:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1789303982.356584:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785493248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303982.356611:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785493248:12345-0@lo:400:kworker.0 Request processed in 28us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303982.356617:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1789303982.356628:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1789303982.356633:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785493120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303982.356665:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785493120:12345-0@lo:400:kworker.0 Request processed in 31us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303982.356671:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00080000:2.0:1789303982.356686:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789303982.356690:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789303982.356693:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789303982.356721:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785493120:0@lo:400:kworker.0 00000100:00100000:2.0:1789303982.356745:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785493248:0@lo:400:kworker.0 00000100:00100000:2.0:1789303982.356754:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785492864:0@lo:400:kworker.0 00010000:00010000:2.0:1789303982.419341:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303982.556779:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303982.571476:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303982.571526:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765406464 00000100:00100000:1.0:1789303982.571536:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765406464 00000100:00100000:1.0:1789303982.571601:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 466 00000100:00100000:1.0:1789303982.571612:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:37059:x1876219765406464:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789303982.571662:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789303982.571690:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231294b8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffcf expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303982.571705:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231294aeb) 00010000:00010000:1.0:1789303982.571710:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:1.0:1789303982.571720:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789303982.571747:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303982.571775:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303982.571785:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789303982.628035:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967482 is committed 00000004:00010000:1.0:1789303982.628212:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000160b5cbd reply state 0000000022c9cd02 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303982.628226:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789303982.628244:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00080000:1.0:1789303982.628833:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789303982.628859:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:37059:x1876219765406464:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 57243us (57387us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789303982.628869:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 466 00010000:00010000:2.0:1789303982.628949:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303982.628959:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303982.628967:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303982.628973:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303982.628978:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303982.628986:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303982.629000:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c03db3400) 00010000:00010000:2.0:1789303982.629087:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789303982.629135:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303982.629142:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294b93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789303982.956606:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00010000:00010000:1.0:1789303983.447915:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789303983.501761:0:62900:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffef9eab280 20000000:00000080:0.0:1789303983.501783:0:62900:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854d000 uarg=0000000000000000 00010000:00010000:0.0:1789303983.502682:0:62900:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789303983.502698:0:62900:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789303983.502713:0:62900:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789303983.502731:0:62900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.502748:0:62900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294b7e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294b77 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.502757:0:62900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.502795:0:62900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294b7e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294b77 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.502810:0:62900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294b7e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294b77 expref: 18 pid: 5845 timeout: 1583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303983.502824:0:62900:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62900:1876219785493504:0@lo:104: 00000100:00100000:0.0:1789303983.502886:0:62900:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303983.502941:0:62900:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789303983.503075:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785493504 00000100:00100000:2.0:1789303983.503082:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785493504 00000100:00100000:2.0:1789303983.503164:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789303983.503175:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:62900:x1876219785493504:12345-0@lo:104: 00010000:00010000:2.0:1789303983.503186:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303983.503247:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303983.503254:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:62900:x1876219785493504:12345-0@lo:104: Request processed in 81us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303983.503261:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789303983.503530:0:62900:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62900:1876219785493504:0@lo:104: 00010000:00010000:0.0:1789303983.503548:0:62900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303983.503830:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303983.503838:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303983.503845:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789303983.503849:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303983.503858:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789303983.503865:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789303983.503884:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789303983.503926:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303983.503932:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789303983.503962:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303983.503968:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231294b77 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294b7e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303983.503984:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303983.503986:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303983.503987:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303983.504039:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785493632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789303983.504075:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303983.504156:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785493632 00000100:00100000:0.0:1789303983.504161:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785493632 00010000:00010000:0.0:1789303983.504182:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294b7e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294b77 expref: 19 pid: 5845 timeout: 1583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303983.504220:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789303983.504228:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785493632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789303983.504239:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789303983.504244:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294b7e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294b77 expref: 19 pid: 5845 timeout: 1583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.504255:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294b7e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294b77 expref: 19 pid: 5845 timeout: 1583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.504267:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294b7e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294b77 expref: 19 pid: 5845 timeout: 1583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.504288:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.504297:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.504310:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.504318:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.504325:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.504332:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.504347:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789303983.504352:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.504359:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303983.511363:0:62900:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303983.511385:0:62900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.512379:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.512396:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294b9a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303983.512431:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789303983.512852:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785493632:12345-0@lo:103:ldlm_bl.0 Request processed in 8621us (8771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303983.512863:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 10000000:01000000:0.0:1789303984.594436:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789303984.594445:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789303984.594452:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789303984.594498:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303984.594510:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303984.594523:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303984.594548:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785493760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789303984.594615:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303984.594670:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c079363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789303984.914420:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785493888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789303984.914493:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789303984.914757:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789303984.914903:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785493888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789303984.995967:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303984.996061:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303984.996128:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303984.996214:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765406848 00000100:00100000:2.0:1789303984.996226:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765406848 00000100:00100000:2.0:1789303984.996298:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 680 00000100:00100000:2.0:1789303984.996312:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765406848:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303984.996404:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765406848:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 96us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303984.996413:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 680 00000100:00080000:1.0:1789303984.996647:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789303984.997333:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 879 00000100:00100000:2.0:1789303984.997342:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765406592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303984.997403:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765406592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 62us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303984.997410:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 879 00000100:00100000:0.0:1789303984.997549:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765406720 00000100:00100000:0.0:1789303984.997555:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765406720 00000100:00100000:0.0:1789303984.997607:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 982 00000100:00100000:0.0:1789303984.997616:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765406720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303984.997656:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765406720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303984.997662:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 982 00000100:00080000:1.0:1789303984.997812:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789303985.498596:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303985.939318:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785494016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789303985.939401:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303985.942506:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785494016 00000100:00100000:2.0:1789303985.942530:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785494016 00000100:00100000:2.0:1789303985.942611:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:2.0:1789303985.942622:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785494016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789303985.942666:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789303985.943129:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785494016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 508us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303985.943139:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00080000:2.0:1789303985.943165:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789303985.943365:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:1.0:1789303985.943372:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c02f2e680, transno 4294967326 00000100:00100000:1.0:1789303985.943407:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785494016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789303986.515355:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303987.022381:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:2.0:1789303987.023058:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789303987.031699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303987.032351:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765407232 00000100:00100000:2.0:1789303987.032363:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765407232 00000100:00100000:2.0:1789303987.032428:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 468 00000100:00100000:2.0:1789303987.032438:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:37136:x1876219765407232:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789303987.032460:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303987.032481:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294bcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fffdd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032574:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294bd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032589:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032600:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032613:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294bd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032620:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032632:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789303987.032646:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:2.0:1789303987.032667:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294bd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032674:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294bd2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032680:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032686:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303987.032691:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294bd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032698:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294bd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032710:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:2.0:1789303987.032713:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303987.032718:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294bd2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032724:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294bd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032735:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032749:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294bd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032755:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032760:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303987.032763:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294bd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032768:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294bd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032776:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff9e2c2e92ab00) 00010000:00010000:2.0:1789303987.032779:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303987.032782:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294bd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032788:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294bd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032820:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294bcb lrc: 1/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffdd expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032831:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:2.0:1789303987.032833:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303987.032837:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294bcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffdd expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.032857:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecca00, rc 0) 00000100:00100000:2.0:1789303987.032921:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:37136:x1876219765407232:12345-192.168.202.29@tcp:101:touch.0 Request processed in 484us (1231us total) trans 0 rc 301/301 00000100:00100000:2.0:1789303987.032929:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 468 00000100:00100000:1.0:1789303987.037642:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303987.038075:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765407360 00000100:00100000:2.0:1789303987.038088:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765407360 00000100:00100000:2.0:1789303987.038396:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 469 00000100:00100000:2.0:1789303987.038408:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:37136:x1876219765407360:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789303987.038427:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303987.038447:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294be0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fffe4 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038512:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294be7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038527:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038540:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038555:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038563:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038569:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038599:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038607:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294be7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038614:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294be7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038620:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303987.038624:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294be7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038631:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294be7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038642:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:2.0:1789303987.038646:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303987.038651:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294be7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038657:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294be7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038668:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038674:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294bee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038681:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038691:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303987.038694:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038701:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038709:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff9e2c2e92a200) 00010000:00010000:2.0:1789303987.038712:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303987.038714:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294bee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038721:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294bee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038752:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294be0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffe4 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038763:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:2.0:1789303987.038765:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303987.038769:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294be0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffe4 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303987.038779:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc400, rc 0) 00000100:00100000:2.0:1789303987.038848:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:37136:x1876219765407360:12345-192.168.202.29@tcp:101:touch.0 Request processed in 443us (1216us total) trans 0 rc 301/301 00000100:00100000:2.0:1789303987.038855:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 469 00000100:00100000:2.0:1789303987.042763:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303987.045997:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765407488 00000100:00100000:1.0:1789303987.046014:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765407488 00000100:00100000:1.0:1789303987.046082:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 470 00000100:00100000:1.0:1789303987.046115:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:37136:x1876219765407488:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789303987.046138:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789303987.046229:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294bf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860fffeb expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046308:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294bfc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046324:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294bfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046337:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294bfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046351:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046358:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046375:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046397:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294bfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046410:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294bfc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046416:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294bfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046422:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303987.046427:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294bfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046434:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294bfc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046512:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:1.0:1789303987.046516:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303987.046522:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294bfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046529:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231294bfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046542:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046547:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294c03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046552:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046557:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789303987.046566:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046572:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294c03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046580:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff9e2c03db3600) 00010000:00010000:1.0:1789303987.046582:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303987.046585:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294c03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046590:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231294c03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046622:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294bf5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffeb expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046630:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:1.0:1789303987.046632:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789303987.046636:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294bf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffeb expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303987.046644:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e800, rc 0) 00000100:00100000:1.0:1789303987.046712:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:37136:x1876219765407488:12345-192.168.202.29@tcp:101:touch.0 Request processed in 599us (3960us total) trans 0 rc 301/301 00000100:00100000:1.0:1789303987.047711:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 470 00000020:00000080:1.0:1789303988.563765:0:63145:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc25a860a0 20000000:00000080:1.0:1789303988.563782:0:63145:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c38747c00 uarg=0000000000000000 00010000:00010000:2.0:1789303988.564519:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303988.564772:0:63145:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789303988.565083:0:63145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:1.0:1789303988.565147:0:63145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789303988.565160:0:63145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231294bc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860fffd6 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303988.565185:0:63145:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789303988.565205:0:63145:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789303988.565217:0:63145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303988.565314:0:63145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294ba8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294ba1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303988.565321:0:63145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303988.565369:0:63145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294ba8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294ba1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303988.565438:0:63145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294ba8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294ba1 expref: 18 pid: 5846 timeout: 1588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303988.565453:0:63145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63145:1876219785494912:0@lo:104: 00000100:00100000:1.0:1789303988.565611:0:63145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303988.565708:0:63145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c02e47900 going to sleep for 11 seconds 00000100:00100000:2.0:1789303988.565828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789303988.565843:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:63145:x1876219785494912:12345-0@lo:104: 00010000:00010000:2.0:1789303988.565857:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294ba8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303988.565940:0:63145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63145:1876219785494912:0@lo:104: 00010000:00010000:2.0:1789303988.565957:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303988.565964:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:63145:x1876219785494912:12345-0@lo:104: Request processed in 127us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303988.565971:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00010000:00010000:1.0:1789303988.566008:0:63145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.566215:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789303988.566222:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294ba8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.566231:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789303988.566235:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294ba8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.566243:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294ba8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789303988.566249:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294ba8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789303988.566254:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789303988.566282:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294ba8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.566297:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789303988.566323:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294ba8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.566330:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294ba1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294ba8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.566344:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789303988.566346:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789303988.566348:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303988.566987:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785495040 00000100:00100000:0.0:1789303988.566993:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785495040 00010000:00010000:0.0:1789303988.567018:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294ba8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294ba1 expref: 19 pid: 5846 timeout: 1588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303988.567044:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789303988.567052:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785495040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789303988.567064:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789303988.567069:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294ba8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294ba1 expref: 19 pid: 5846 timeout: 1588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567084:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294ba8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294ba1 expref: 19 pid: 5846 timeout: 1588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567136:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294ba8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294ba1 expref: 19 pid: 5846 timeout: 1588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567150:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567169:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567183:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567190:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567195:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567201:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567206:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789303988.567209:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567215:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567229:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303988.567238:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789303988.567281:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785495040:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303988.567289:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00010000:00010000:1.0:1789303988.567567:0:63145:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303988.567580:0:63145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303988.567584:0:63145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294c0a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303990.034275:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789303990.034317:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785495168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789303990.034405:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303990.034966:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785495168 00000100:00100000:1.0:1789303990.034976:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785495168 00000100:00100000:1.0:1789303990.035044:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1789303990.035064:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785495168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789303990.035124:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303990.035194:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785495168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303990.035201:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00080000:1.0:1789303990.035224:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789303990.035277:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785495168:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1789303990.037708:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789303990.037715:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789303990.037720:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789303990.037765:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303990.037778:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303990.037789:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303990.037821:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06236d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785495296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789303990.037885:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303990.037922:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c07936300 going to sleep for 11 seconds 00000100:00100000:2.0:1789303990.038276:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785495296 00000100:00100000:2.0:1789303990.038286:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785495296 00000100:00100000:2.0:1789303990.038335:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1789303990.038354:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785495296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303990.038367:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303990.038381:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231294c18 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294c11 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303990.038404:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231294c18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294c11 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303990.038415:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231294c18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294c11 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303990.038425:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd600, rc 0) 00000100:00100000:2.0:1789303990.038465:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785495296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303990.038472:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1789303990.038538:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06236d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785495296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303990.038553:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303990.038563:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789303990.038582:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789303990.038587:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303990.038607:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303990.121784:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765407744 00000100:00100000:0.0:1789303990.121797:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765407744 00000100:00100000:0.0:1789303990.121891:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 986 00000100:00100000:0.0:1789303990.121902:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765407744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303990.122003:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765407744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 103us (8627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303990.122012:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 986 00010000:00010000:0.0:1789303990.612480:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303991.059249:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785495424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789303991.059325:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303991.059481:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785495424 00000100:00100000:1.0:1789303991.059490:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785495424 00000100:00100000:1.0:1789303991.059556:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1789303991.059567:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785495424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789303991.059603:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789303991.059649:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785495424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303991.059656:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00080000:0.0:1789303991.059783:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789303991.059830:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785495424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789303991.411937:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765408000 00000100:00100000:2.0:1789303991.411945:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765408000 00000100:00100000:2.0:1789303991.411990:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 471 00000100:00100000:2.0:1789303991.411997:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:37223:x1876219765408000:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789303991.412014:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303991.412076:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231294c1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860ffff2 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303991.412191:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303991.412206:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303991.412219:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789303991.412266:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789303991.412270:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789303991.412289:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303991.412315:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231294c1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffff2 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303991.412347:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffff2 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303991.412360:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92ab00) 00010000:00010000:2.0:1789303991.412363:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789303991.412367:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc600, rc 0) 00000100:00100000:2.0:1789303991.412583:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:37223:x1876219765408000:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 585us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303991.412591:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 471 00000100:00100000:1.0:1789303991.415982:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303991.416067:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765408256 00000100:00100000:2.0:1789303991.416075:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765408256 00000100:00100000:2.0:1789303991.416235:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 472 00000100:00100000:2.0:1789303991.416245:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:37223:x1876219765408256:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:2.0:1789303991.416292:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789303991.416314:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffff2 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303991.416342:0:5854:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231294bc4) 00010000:00010000:2.0:1789303991.416352:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92ab00) 00010000:00010000:2.0:1789303991.416363:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789303991.416456:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294c2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303991.416470:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294c2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303991.416481:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294c2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789303991.416789:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bcaa90d reply state 00000000fb15ef5a transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231294c2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303991.416799:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789303991.416806:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000100:00100000:2.0:1789303991.416925:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:37223:x1876219765408256:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 681us (950us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789303991.416932:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 472 00010000:00010000:0.0:1789303991.641508:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789303992.184278:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785495552 00000100:00100000:2.0:1789303992.184286:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785495552 00000100:00100000:2.0:1789303992.184375:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789303992.184385:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:63341:x1876219785495552:12345-0@lo:104: 00010000:00010000:2.0:1789303992.184397:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303992.184469:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789303992.184476:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:63341:x1876219785495552:12345-0@lo:104: Request processed in 93us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303992.184482:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789303992.184567:0:63341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63341:1876219785495552:0@lo:104: 00010000:00010000:0.0:1789303992.184587:0:63341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.184635:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303992.184650:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.184658:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789303992.184662:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.184670:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789303992.184678:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789303992.184684:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789303992.184725:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.184733:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789303992.184758:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.184765:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c11 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294c18 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.184783:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303992.184785:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303992.184786:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789303992.184799:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785495680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789303992.184832:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303992.184925:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785495680 00000100:00100000:1.0:1789303992.184935:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785495680 00010000:00010000:1.0:1789303992.184955:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231294c18 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294c11 expref: 19 pid: 5845 timeout: 1591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303992.184978:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789303992.184985:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785495680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789303992.184996:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789303992.185001:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231294c18 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294c11 expref: 19 pid: 5845 timeout: 1591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185011:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231294c18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294c11 expref: 19 pid: 5845 timeout: 1591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185024:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231294c18 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294c11 expref: 19 pid: 5845 timeout: 1591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185037:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185045:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185059:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185066:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185073:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185079:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185124:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303992.185129:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185137:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185149:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303992.185158:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789303992.185191:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785495680:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303992.185198:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789303992.185232:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785495680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789303992.185327:0:63341:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303992.185335:0:63341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303992.185341:0:63341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231294c34 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303992.595128:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785496192:0@lo:400:kworker.0 00000100:00100000:0.0:1789303992.595156:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303992.595180:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789303992.595184:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785495808:0@lo:400:kworker.0 00000100:00100000:0.0:1789303992.595208:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303992.595225:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785496320:0@lo:400:kworker.0 00000100:00100000:0.0:1789303992.595243:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789303992.595558:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1789303992.595568:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785496192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789303992.595611:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785496192:12345-0@lo:400:kworker.0 Request processed in 45us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303992.595617:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1789303992.595644:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785496192:0@lo:400:kworker.0 00000100:00100000:2.0:1789303992.595862:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785495808 00000100:00100000:2.0:1789303992.595866:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785495808 00000100:00100000:2.0:1789303992.595905:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:2.0:1789303992.595913:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785495808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303992.595951:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785495808:12345-0@lo:400:kworker.0 Request processed in 40us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303992.595958:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:2.0:1789303992.595990:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785495808:0@lo:400:kworker.0 00000100:00080000:0.0:1789303992.596498:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789303992.597449:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785496320:0@lo:400:kworker.0 00010000:00010000:0.0:1789303992.658741:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789303993.683136:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789303993.874193:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789303993.874201:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789303993.874207:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789303993.874250:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303993.874268:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303993.874280:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789303993.874319:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785496576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789303993.874382:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303993.874431:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaa840 going to sleep for 11 seconds 00000100:00100000:2.0:1789303993.874601:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785496576 00000100:00100000:2.0:1789303993.874611:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785496576 00000100:00100000:2.0:1789303993.874674:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1789303993.874684:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785496576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789303993.874700:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303993.874719:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231294c42 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294c3b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303993.874745:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231294c42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294c3b expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303993.874758:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231294c42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294c3b expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303993.874766:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789303993.874807:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785496576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303993.874814:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1789303993.874959:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785496576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789303993.874974:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303993.874983:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789303993.875002:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789303993.875007:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303993.875015:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303994.708520:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303995.155563:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789303995.155590:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785496704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789303995.155660:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303995.155723:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785496704 00000100:00100000:0.0:1789303995.155736:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785496704 00000100:00100000:0.0:1789303995.155793:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1789303995.155801:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785496704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789303995.155834:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789303995.155877:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785496704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303995.155884:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00080000:0.0:1789303995.155902:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789303995.155938:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785496704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789303995.230458:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:0.0:1789303995.230935:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789303995.232770:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765408512 00000100:00100000:0.0:1789303995.232777:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765408512 00000100:00100000:0.0:1789303995.232840:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 239 00000100:00080000:2.0:1789303995.232846:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789303995.232850:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:37307:x1876219765408512:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789303995.233194:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:37307:x1876219765408512:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 345us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303995.233202:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 239 00000100:00100000:2.0:1789303995.234363:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765408640 00000100:00100000:2.0:1789303995.234370:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765408640 00000100:00100000:2.0:1789303995.234417:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 885 00000100:00100000:2.0:1789303995.234427:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765408640:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789303995.234479:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765408640:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 53us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303995.234486:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 885 00000100:00100000:0.0:1789303995.234751:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765408768 00000100:00100000:0.0:1789303995.234755:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765408768 00000100:00100000:0.0:1789303995.234781:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 686 00000100:00100000:0.0:1789303995.234787:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765408768:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789303995.234817:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765408768:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303995.234823:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 686 00000100:00100000:0.0:1789303995.236027:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765408896 00000100:00100000:0.0:1789303995.236033:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765408896 00000100:00100000:0.0:1789303995.236068:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 240 00000100:00100000:0.0:1789303995.236072:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876219765408896:12345-192.168.202.29@tcp:8:lfs.0 00010000:00080000:0.0:1789303995.236127:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1444 last 0 00000020:00000080:0.0:1789303995.236283:0:6692:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231294c49 00002000:00100000:0.0:1789303995.236306:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c3b4cc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789303995.236317:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789303995.236511:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789303995.236537:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9e2c3b4c8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789303995.236590:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765408896:12345-192.168.202.29@tcp:8:lfs.0 Request processed in 515us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303995.236597:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 240 00000100:00100000:1.0:1789303995.237969:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303995.238020:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765409024 00000100:00100000:0.0:1789303995.238027:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765409024 00000100:00080000:2.0:1789303995.238084:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789303995.238164:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 241 00000100:00100000:0.0:1789303995.238172:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:37307:x1876219765409024:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789303995.238506:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:37307:x1876219765409024:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 334us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303995.238511:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 241 00000100:00100000:1.0:1789303995.240167:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303995.240257:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765409152 00000100:00100000:2.0:1789303995.240266:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765409152 00000100:00100000:2.0:1789303995.240326:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 474 00000100:00100000:2.0:1789303995.240337:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:37307:x1876219765409152:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789303995.240690:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:37307:x1876219765409152:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 356us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303995.240696:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 474 00000100:00100000:1.0:1789303995.243634:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303995.245024:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303995.247080:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303995.247478:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 243 00000100:00100000:2.0:1789303995.247492:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:37307:x1876219765409536:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789303995.247828:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:37307:x1876219765409536:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 341us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303995.247834:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 243 00000100:00100000:1.0:1789303995.249163:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303995.285720:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303995.285842:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765409792 00000100:00100000:2.0:1789303995.285854:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765409792 00000100:00100000:2.0:1789303995.285950:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 477 00000100:00100000:2.0:1789303995.285961:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:37311:x1876219765409792:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:2.0:1789303995.285984:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789303995.286025:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294c50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d860ffff9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.286126:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294c57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.286144:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294c57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.286376:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294c57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.286429:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294c5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.286438:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294c5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.286446:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294c5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.286963:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294c65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.286974:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.286983:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789303995.287008:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789303995.287013:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789303995.287034:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287053:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294c57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287059:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294c57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287066:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294c57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287072:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303995.287076:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294c57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287084:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294c57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287481:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2e92a900) 00010000:00010000:2.0:1789303995.287485:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303995.287490:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294c57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287497:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294c57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287513:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294c5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287520:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294c5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287526:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294c5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287539:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303995.287542:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294c5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287687:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294c5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287697:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c2e92a400) 00010000:00010000:2.0:1789303995.287700:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303995.287703:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294c5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287709:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294c5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287747:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294c50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffff9 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287764:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffff9 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.287772:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92a700) 00010000:00010000:2.0:1789303995.287774:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789303995.287777:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd800, rc 0) 00000100:00100000:2.0:1789303995.287901:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:37311:x1876219765409792:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1941us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303995.287910:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 477 00000100:00100000:1.0:1789303995.290731:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:2.0:1789303995.295847:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231294c7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.295876:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231294c7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.295883:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231294c7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.295889:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303995.295893:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231294c7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.295901:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231294c7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.295915:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff9e2c2ea19800) 00010000:00010000:2.0:1789303995.295918:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303995.295923:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231294c7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303995.295929:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231294c7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789303995.304721:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303995.304862:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765410176 00000100:00100000:0.0:1789303995.304873:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765410176 00000100:00100000:0.0:1789303995.304936:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 244 00000100:00100000:0.0:1789303995.304947:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:37311:x1876219765410176:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789303995.304965:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789303995.304985:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231294c8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100007 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789303995.305031:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789303995.305054:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=1444s v=(0 0) 00010000:00010000:0.0:1789303995.305058:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789303995.305068:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231294c8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100007 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303995.305084:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231294c8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100007 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789303995.305137:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afaa00, rc 0) 00000100:00100000:0.0:1789303995.305186:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:37311:x1876219765410176:12345-192.168.202.29@tcp:101:dd.0 Request processed in 242us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303995.305194:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 244 00000100:00100000:1.0:1789303995.319780:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765410304 00000100:00100000:1.0:1789303995.319790:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765410304 00002000:00100000:1.0:1789303995.319845:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xf:0x0] (0->1048575) req@ffff9e2c36eff480 x1876219765410304/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:61/0 lens 488/0 e 0 to 0 dl 1789304006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789303995.319856:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c36eff480 with x1876219765410304 ext(0->1048575) 00002000:00010000:1.0:1789303995.319862:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c36eff480 00000100:00100000:1.0:1789303995.319933:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:1.0:1789303995.319943:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765410304:12345-192.168.202.29@tcp:4:dd.0 00000100:00100000:0.0:1789303995.431889:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765410304:12345-192.168.202.29@tcp:4:dd.0 Request processed in 111941us (112368us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789303995.431903:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00002000:00100000:0.0:1789303995.431917:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xf:0x0] (0->1048575) req@ffff9e2c36eff480 x1876219765410304/t4294967325(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:61/0 lens 488/448 e 0 to 0 dl 1789304006 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789303995.431927:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c36eff480 with x1876219765410304 ext(0->1048575) 00002000:00010000:0.0:1789303995.431934:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c36eff480 00000100:00100000:2.0:1789303995.435612:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303995.489471:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:37311:x1876219765410432:12345-192.168.202.29@tcp:44:dd.0 Request processed in 53641us (53853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303995.489486:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 479 00000100:00100000:0.0:1789303995.497804:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303995.502044:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:0.0:1789303995.730292:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303996.179830:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789303996.179854:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785496832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789303996.179922:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789303996.180383:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789303996.755723:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303997.716248:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785496960:0@lo:400:kworker.0 00000100:00100000:0.0:1789303997.716291:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303997.716331:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785497472:0@lo:400:kworker.0 00000100:00100000:0.0:1789303997.716351:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789303997.716365:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789303997.716370:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785497344:0@lo:400:kworker.0 00000100:00100000:0.0:1789303997.716386:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789303997.718151:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785497472 00000100:00100000:2.0:1789303997.718156:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785497472 00000100:00100000:2.0:1789303997.718216:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785497344 00000100:00100000:2.0:1789303997.718219:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785497344 00000100:00100000:2.0:1789303997.718249:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1789303997.718258:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785497472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303997.718480:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785497472:12345-0@lo:400:kworker.0 Request processed in 223us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303997.718502:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1789303997.718519:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1789303997.718525:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785497344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789303997.718555:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785497344:12345-0@lo:400:kworker.0 Request processed in 31us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303997.718561:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00080000:2.0:1789303997.718577:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789303997.718760:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785497344:0@lo:400:kworker.0 00000100:00100000:0.0:1789303997.718774:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785497472:0@lo:400:kworker.0 00000100:00100000:0.0:1789303997.720855:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785496960:0@lo:400:kworker.0 00000004:00080000:0.0:1789303998.192657:0:63588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1447870562911ns, next at 1428203481620ns, rc = 0 00000004:00080000:0.0:1789303998.192861:0:63588:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1447870769816ns, next at 1389513620500ns, rc = 0 00010000:00010000:0.0:1789303998.802589:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789303999.576613:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:0.0:1789303999.577818:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789303999.590663:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789303999.594713:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765411200 00000100:00100000:2.0:1789303999.594723:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765411200 00000100:00100000:2.0:1789303999.594792:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 247 00000100:00100000:2.0:1789303999.594804:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:37504:x1876219765411200:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789303999.595197:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:37504:x1876219765411200:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 396us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303999.595207:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 247 00000100:00080000:0.0:1789303999.595997:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789303999.605463:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303999.606043:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765411328 00000100:00100000:2.0:1789303999.606055:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765411328 00000100:00100000:2.0:1789303999.606141:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 481 00000100:00100000:2.0:1789303999.606152:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:37504:x1876219765411328:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789303999.606632:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:37504:x1876219765411328:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 480us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303999.606641:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 481 00000100:00100000:0.0:1789303999.619505:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789303999.619700:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765411456 00000100:00100000:1.0:1789303999.619711:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765411456 00000100:00100000:1.0:1789303999.619772:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 482 00000100:00100000:1.0:1789303999.619783:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:37504:x1876219765411456:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789303999.620029:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:37504:x1876219765411456:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 247us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789303999.620038:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 482 00000100:00100000:0.0:1789303999.622844:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765411584 00000100:00100000:0.0:1789303999.622857:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765411584 00000100:00100000:0.0:1789303999.622932:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 248 00000100:00100000:0.0:1789303999.622941:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:37504:x1876219765411584:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789303999.623592:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:37504:x1876219765411584:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 649us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789303999.623601:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 248 00000100:00100000:0.0:1789303999.628494:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303999.628626:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765411712 00000100:00100000:2.0:1789303999.628638:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765411712 00000100:00100000:2.0:1789303999.628731:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 249 00000100:00100000:2.0:1789303999.628744:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:37504:x1876219765411712:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789303999.629169:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:37504:x1876219765411712:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 426us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789303999.629177:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 249 00000100:00100000:0.0:1789303999.632479:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789303999.710493:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789303999.710594:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765412096 00000100:00100000:2.0:1789303999.710604:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765412096 00000100:00100000:2.0:1789303999.710677:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 484 00000100:00100000:2.0:1789303999.710688:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:37508:x1876219765412096:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789303999.710758:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789303999.710788:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231294c81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100000 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.710812:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:2.0:1789303999.710822:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789303999.710859:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.710874:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.710884:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.710898:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231294c9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.710916:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231294c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.710923:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231294c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.711299:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294ca4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.711308:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.711316:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789303999.712055:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].15, 64 off9152 00000004:00080000:2.0:1789303999.712067:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1449389975388ns, next at 1450389973218ns, rc = 0 00010000:00010000:2.0:1789303999.712203:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712214:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712222:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712229:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712236:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712242:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712268:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789303999.712289:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294ca4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712303:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294ca4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712310:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294ca4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712316:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303999.712320:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294ca4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712329:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294ca4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712340:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9e2c2e92a500) 00010000:00010000:2.0:1789303999.712343:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789303999.712348:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294ca4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712354:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294ca4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712374:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712380:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c96 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712385:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712389:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789303999.712398:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712404:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712411:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92a700) 00010000:00010000:2.0:1789303999.712414:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789303999.712416:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789303999.712422:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294c96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789303999.712432:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000285ddfbc reply state 000000002c68de97 transno 4294967486 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231294c9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789303999.712440:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789303999.712522:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:37508:x1876219765412096:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1833us (2037us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789303999.712531:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 484 00010000:00010000:1.0:1789303999.713574:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789303999.713585:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303999.713595:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789303999.713608:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303999.713616:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303999.713629:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9e2c2e92a500) 00010000:00010000:1.0:1789303999.713631:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789303999.713635:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 1/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303999.713640:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294cab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789303999.713657:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303999.713659:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789303999.713660:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304000.279367:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785497728 00000100:00100000:1.0:1789304000.279375:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785497728 00000100:00100000:1.0:1789304000.279428:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1789304000.279436:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785497728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304000.279468:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789304000.285602:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785497728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6156us (6439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304000.285618:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00080000:1.0:1789304000.285659:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304000.357621:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765412352 00000100:00100000:1.0:1789304000.357626:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765412352 00000100:00100000:1.0:1789304000.357656:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 993 00000100:00100000:1.0:1789304000.357663:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765412352:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304000.357726:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765412352:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 63us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304000.357733:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 993 00010000:00010000:1.0:1789304000.851141:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304001.298343:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785497856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304001.298428:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789304001.298923:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304001.298957:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785497856:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789304001.648963:0:63732:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1451326869703ns, next at 1428203481620ns, rc = 0 00000004:00080000:1.0:1789304001.649064:0:63732:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1451326972803ns, next at 1450389973218ns, rc = 0 00000004:00080000:1.0:1789304001.680428:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 43 committed 00000004:00080000:1.0:1789304001.680484:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 38 committed 00000001:00080000:1.0:1789304001.680611:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967486 is committed 00000004:00080000:1.0:1789304001.680617:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 42 committed 00000100:00100000:2.0:1789304001.680829:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785497984:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789304001.680902:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304001.681054:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785497984 00000100:00100000:0.0:1789304001.681063:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785497984 00000100:00100000:0.0:1789304001.681142:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789304001.681152:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785497984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789304001.681178:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:15 count 1 00010000:00010000:0.0:1789304001.681203:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304001.681223:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231294c8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100007 expref: 5 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304001.681243:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xf:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1789304001.681247:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304001.681252:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304001.681459:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231294c8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100007 expref: 5 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304001.681492:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231294c8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100007 expref: 5 pid: 6692 timeout: 1551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304001.681503:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785498112:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304001.681563:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8300 going to sleep for 11 seconds 00000100:00100000:0.0:1789304001.683556:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785498112:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789304001.683585:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304001.685281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:2.0:1789304001.686391:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304001.687446:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304001.687462:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304001.687474:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304001.687483:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304001.687513:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304001.688167:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304001.688175:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304001.688185:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304001.688197:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304001.688207:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304001.688225:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304001.688261:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb7231294cb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304001.688298:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304001.688300:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304001.688302:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304001.688732:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785497984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7579us (7826us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789304001.688752:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000004:00080000:2.0:1789304001.688850:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c08b37b80/2, rc 0, transno 4294967326 00000100:00100000:2.0:1789304001.688869:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785497984:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789304001.875566:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304002.838529:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785498240:0@lo:400:kworker.0 00000100:00100000:0.0:1789304002.838607:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304002.838654:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785498752:0@lo:400:kworker.0 00000100:00100000:0.0:1789304002.838680:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304002.838708:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789304002.838714:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785498368:0@lo:400:kworker.0 00000100:00100000:0.0:1789304002.838736:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304002.838753:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785498880:0@lo:400:kworker.0 00000100:00100000:0.0:1789304002.838777:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304002.838805:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785498624:0@lo:400:kworker.0 00000100:00100000:0.0:1789304002.838829:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304002.838847:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304002.838852:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785498496:0@lo:400:kworker.0 00000100:00100000:0.0:1789304002.838873:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304002.838902:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785498752 00000100:00100000:0.0:1789304002.838909:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785498752 00000100:00100000:0.0:1789304002.838966:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785498368 00000100:00100000:0.0:1789304002.838970:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785498368 00000100:00100000:0.0:1789304002.838986:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785498624 00000100:00100000:0.0:1789304002.838989:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785498624 00000100:00100000:0.0:1789304002.839009:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1789304002.839016:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785498752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304002.839066:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785498752:12345-0@lo:400:kworker.0 Request processed in 51us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304002.839073:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1789304002.842809:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785498368:0@lo:400:kworker.0 00000100:00100000:0.0:1789304002.842827:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785498880:0@lo:400:kworker.0 00000100:00100000:0.0:1789304002.842838:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785498240:0@lo:400:kworker.0 00000100:00100000:0.0:1789304002.842849:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785498752:0@lo:400:kworker.0 00010000:00010000:1.0:1789304002.898424:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304003.924419:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304004.947350:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304005.394348:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304005.394619:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785499008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304005.394809:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304005.394997:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785499008 00000100:00100000:1.0:1789304005.395005:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785499008 00000100:00100000:1.0:1789304005.398338:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1789304005.398362:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785499008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304005.398404:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304005.399295:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785499008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 941us (4482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304005.399305:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1789304005.405525:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:0.0:1789304005.405538:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c08b37b80, transno 4294967326 00000100:00100000:0.0:1789304005.405633:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785499008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304005.473461:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765413120 00000100:00100000:0.0:1789304005.473472:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765413120 00000100:00100000:0.0:1789304005.473534:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765413248 00000100:00100000:0.0:1789304005.473537:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765413248 00000100:00100000:0.0:1789304005.473579:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 694 00000100:00100000:0.0:1789304005.473587:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765413248:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304005.473598:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765412864 00000100:00100000:2.0:1789304005.473601:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765412864 00000100:00100000:2.0:1789304005.473629:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 889 00000100:00100000:2.0:1789304005.473636:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765412864:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304005.473672:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765412864:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304005.473680:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 889 00000100:00080000:2.0:1789304005.473834:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304005.473839:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304005.473882:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02edb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765413248:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 295us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304005.473890:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 694 00000100:00100000:1.0:1789304005.477452:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765412992 00000100:00100000:1.0:1789304005.477482:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765412992 00000100:00100000:1.0:1789304005.477572:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 997 00000100:00100000:1.0:1789304005.477583:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765412992:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304005.478001:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765412992:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 418us (4566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304005.478009:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 997 00000100:00080000:2.0:1789304005.478232:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304005.972902:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304006.419510:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304006.419534:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785499136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304006.419602:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789304006.420011:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304007.006659:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304007.954395:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785499264:0@lo:400:kworker.0 00000100:00100000:2.0:1789304007.954472:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304007.954604:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785499392:0@lo:400:kworker.0 00000100:00100000:1.0:1789304007.954647:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304007.954696:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1789304007.954706:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785499264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304007.957493:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785499648:0@lo:400:kworker.0 00000100:00100000:0.0:1789304007.957551:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304007.957581:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304007.957587:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785499520:0@lo:400:kworker.0 00000100:00100000:0.0:1789304007.957611:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304007.957810:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785499264:12345-0@lo:400:kworker.0 Request processed in 3104us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304007.957820:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1789304007.957873:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785499648 00000100:00100000:1.0:1789304007.957879:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785499648 00000100:00100000:0.0:1789304007.958190:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785499520 00000100:00100000:0.0:1789304007.958195:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785499520 00000100:00100000:0.0:1789304007.958239:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1789304007.958249:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785499520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304007.958317:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785499520:12345-0@lo:400:kworker.0 Request processed in 70us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304007.958324:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1789304007.958343:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304007.958366:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304007.958372:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785499776:0@lo:400:kworker.0 00000100:00100000:0.0:1789304007.958397:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304007.958424:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785499904 00000100:00100000:0.0:1789304007.958428:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785499904 00000100:00100000:0.0:1789304007.958455:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1789304007.958461:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785499904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304007.958492:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785499904:12345-0@lo:400:kworker.0 Request processed in 31us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304007.958498:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1789304007.958513:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785499776 00000100:00100000:0.0:1789304007.958517:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785499776 00000100:00100000:1.0:1789304007.958562:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1789304007.958572:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785499648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304007.958605:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785499648:12345-0@lo:400:kworker.0 Request processed in 36us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304007.958661:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785499264:0@lo:400:kworker.0 00000100:00080000:2.0:1789304007.958702:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304007.958706:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304007.959152:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:0.0:1789304007.959161:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785499776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304007.959207:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785499776:12345-0@lo:400:kworker.0 Request processed in 49us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304007.959435:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1789304007.959519:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1789304007.960074:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785499520:0@lo:400:kworker.0 00000100:00100000:0.0:1789304007.960414:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785499776:0@lo:400:kworker.0 00000100:00100000:1.0:1789304007.960447:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785499648:0@lo:400:kworker.0 00000100:00100000:0.0:1789304007.960520:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785499904:0@lo:400:kworker.0 00010000:00010000:1.0:1789304008.021185:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304009.042899:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304010.069645:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304010.514415:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304010.514443:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785500032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304010.514521:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304010.514772:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785500032 00000100:00100000:1.0:1789304010.514783:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785500032 00000100:00100000:1.0:1789304010.514863:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1789304010.514874:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785500032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304010.514910:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304010.514964:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785500032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304010.514971:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00080000:2.0:1789304010.515032:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304010.515205:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785500032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304010.595806:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 698 00000100:00100000:1.0:1789304010.595820:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765413632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304010.595856:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765413632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304010.595864:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 698 00000100:00100000:2.0:1789304010.595993:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765413376 00000100:00100000:2.0:1789304010.595998:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765413376 00000100:00100000:0.0:1789304010.596022:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765413504 00000100:00100000:0.0:1789304010.596028:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765413504 00000100:00100000:2.0:1789304010.596048:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 891 00000100:00100000:2.0:1789304010.596058:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765413376:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304010.596080:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1001 00000100:00100000:0.0:1789304010.596121:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765413504:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304010.596129:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765413376:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304010.596136:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 891 00000100:00100000:0.0:1789304010.596176:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765413504:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304010.596184:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1001 00000100:00080000:2.0:1789304010.596238:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304010.596244:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304010.596246:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789304011.090564:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304011.538330:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785500160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304011.538405:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304011.538583:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785500160 00000100:00100000:1.0:1789304011.538592:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785500160 00000100:00100000:1.0:1789304011.538672:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1789304011.538682:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785500160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304011.538717:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304011.539402:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785500160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 719us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304011.539411:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1789304011.539816:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785500160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304012.114688:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304013.074444:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785500544:0@lo:400:kworker.0 00000100:00100000:1.0:1789304013.074456:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785500672:0@lo:400:kworker.0 00000100:00100000:0.0:1789304013.074531:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785500288:0@lo:400:kworker.0 00000100:00100000:2.0:1789304013.076316:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304013.076519:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785500544 00000100:00100000:2.0:1789304013.076536:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785500544 00000100:00100000:2.0:1789304013.076601:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1789304013.076614:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785500544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304013.076683:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785500544:12345-0@lo:400:kworker.0 Request processed in 74us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304013.076708:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00080000:2.0:1789304013.076730:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304013.076764:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785500544:0@lo:400:kworker.0 00000100:00100000:1.0:1789304013.076973:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304013.077168:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785500672 00000100:00100000:2.0:1789304013.077173:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785500672 00000100:00100000:2.0:1789304013.077313:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1789304013.077323:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785500672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304013.077364:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785500672:12345-0@lo:400:kworker.0 Request processed in 44us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304013.077371:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00080000:1.0:1789304013.077441:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304013.077465:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785500672:0@lo:400:kworker.0 00000100:00100000:0.0:1789304013.080457:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304013.080515:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785500800:0@lo:400:kworker.0 00000100:00100000:0.0:1789304013.080562:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304013.080726:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785500288 00000100:00100000:1.0:1789304013.080734:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785500288 00000100:00100000:1.0:1789304013.080787:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1789304013.080797:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785500288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304013.080859:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785500288:12345-0@lo:400:kworker.0 Request processed in 63us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304013.080865:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1789304013.083215:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785500288:0@lo:400:kworker.0 00000100:00100000:1.0:1789304013.092664:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785500928 00000100:00100000:1.0:1789304013.092677:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785500928 00000100:00100000:1.0:1789304013.092759:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1789304013.092772:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785500928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304013.092859:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785500928:12345-0@lo:400:kworker.0 Request processed in 91us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304013.092866:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:2.0:1789304013.101305:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785500800 00000100:00100000:0.0:1789304013.101305:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785500416 00000100:00100000:2.0:1789304013.101325:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785500800 00000100:00100000:0.0:1789304013.101325:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785500416 00000100:00100000:2.0:1789304013.106083:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:2.0:1789304013.106131:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785500800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304013.106330:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1789304013.106332:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785500800:12345-0@lo:400:kworker.0 Request processed in 224us (25768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304013.106338:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785500416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304013.106340:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1789304013.106388:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785500416:12345-0@lo:400:kworker.0 Request processed in 50us (21521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304013.106394:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1789304013.109518:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785500800:0@lo:400:kworker.0 00000100:00100000:0.0:1789304013.109616:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785500416:0@lo:400:kworker.0 00010000:00010000:2.0:1789304013.142594:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304014.162336:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304015.199956:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304015.636707:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785501056 00000100:00100000:0.0:1789304015.636716:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785501056 00000100:00100000:0.0:1789304015.636789:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1789304015.636799:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785501056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304015.636836:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304015.636900:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785501056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304015.636907:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1789304015.718270:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765414144 00000100:00100000:2.0:1789304015.718279:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765414144 00000100:00100000:1.0:1789304015.718350:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765414016 00000100:00100000:0.0:1789304015.718352:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765413888 00000100:00100000:0.0:1789304015.718357:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765413888 00000100:00100000:1.0:1789304015.718369:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765414016 00000100:00100000:2.0:1789304015.719124:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 702 00000100:00100000:2.0:1789304015.719137:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765414144:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304015.719172:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765414144:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304015.719180:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 702 00000100:00080000:2.0:1789304015.719212:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304015.719230:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304015.719232:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304015.719788:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1005 00000100:00100000:1.0:1789304015.719798:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765414016:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304015.719832:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765414016:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 36us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304015.719839:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1005 00000100:00100000:0.0:1789304015.719843:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 893 00000100:00100000:0.0:1789304015.719855:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765413888:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304015.719888:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765413888:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304015.719896:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 893 00010000:00010000:2.0:1789304016.211311:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304016.658711:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785501184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304016.659132:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304016.659447:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785501184 00000100:00100000:1.0:1789304016.659672:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785501184 00000100:00100000:1.0:1789304016.659834:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1789304016.659845:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785501184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304016.659884:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304016.659948:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785501184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304016.659955:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1789304016.934520:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765414400 00000100:00100000:1.0:1789304016.934531:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765414400 00000100:00100000:1.0:1789304016.934599:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 485 00000100:00100000:1.0:1789304016.934611:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:37726:x1876219765414400:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304016.934723:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:37726:x1876219765414400:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 114us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304016.934731:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 485 00000100:00100000:0.0:1789304016.943752:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304016.943895:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765414528 00000100:00100000:2.0:1789304016.943907:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765414528 00000100:00100000:2.0:1789304016.943967:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 251 00000100:00100000:2.0:1789304016.943978:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:37726:x1876219765414528:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304016.944410:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:37726:x1876219765414528:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 433us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304016.944418:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 251 00000100:00100000:0.0:1789304016.950581:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304016.951375:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765414656 00000100:00100000:2.0:1789304016.951389:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765414656 00000100:00100000:2.0:1789304016.951458:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 252 00000100:00100000:2.0:1789304016.951468:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:37726:x1876219765414656:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304016.952358:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:37726:x1876219765414656:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 665us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304016.952368:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 252 00000100:00100000:0.0:1789304016.965596:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304016.965662:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765414784 00000100:00100000:2.0:1789304016.965674:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765414784 00000100:00100000:2.0:1789304016.965743:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 486 00000100:00100000:2.0:1789304016.965765:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:37726:x1876219765414784:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304016.966580:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:37726:x1876219765414784:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 814us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304016.966590:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 486 00000100:00100000:0.0:1789304016.970950:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304016.975245:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765415040 00000100:00100000:2.0:1789304016.975260:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765415040 00000100:00100000:2.0:1789304016.975315:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 253 00000100:00100000:2.0:1789304016.975329:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:37726:x1876219765415040:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304016.975668:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:37726:x1876219765415040:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 338us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304016.975675:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 253 00000100:00100000:0.0:1789304016.988394:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304016.988797:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765415168 00000100:00100000:2.0:1789304016.988809:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765415168 00000100:00100000:2.0:1789304016.988876:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 254 00000100:00100000:2.0:1789304016.988887:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:37726:x1876219765415168:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304016.989345:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:37726:x1876219765415168:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 458us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304016.989352:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 254 00000100:00100000:1.0:1789304016.995515:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304016.995551:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765415296 00000100:00100000:1.0:1789304016.995560:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765415296 00000100:00100000:1.0:1789304016.995614:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 488 00000100:00100000:1.0:1789304016.995624:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:37726:x1876219765415296:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304016.999783:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:37726:x1876219765415296:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 4152us (4272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304016.999798:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 488 00010000:00010000:0.0:1789304017.242243:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304018.195798:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785501312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.195869:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304018.195913:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785501824:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.195941:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304018.195967:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789304018.195973:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785501440:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.195996:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304018.196013:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785501952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.196034:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304018.196061:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785501568:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.196110:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304018.196132:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304018.196136:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785501696:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.196154:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304018.198144:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785501312 00000100:00100000:1.0:1789304018.198158:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785501312 00000100:00100000:1.0:1789304018.198212:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1789304018.198223:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785501312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198316:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785501312:12345-0@lo:400:kworker.0 Request processed in 96us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304018.198323:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1789304018.198367:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785501824 00000100:00100000:1.0:1789304018.198377:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785501824 00000100:00100000:1.0:1789304018.198414:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785501440 00000100:00100000:1.0:1789304018.198418:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785501440 00000100:00100000:1.0:1789304018.198433:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785501696 00000100:00100000:1.0:1789304018.198436:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785501696 00000100:00100000:1.0:1789304018.198455:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1789304018.198461:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785501824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198494:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785501824:12345-0@lo:400:kworker.0 Request processed in 33us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304018.198500:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1789304018.198513:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:1.0:1789304018.198518:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785501440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198545:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785501440:12345-0@lo:400:kworker.0 Request processed in 26us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304018.198550:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:1.0:1789304018.198561:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:1.0:1789304018.198566:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785501696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198597:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785501696:12345-0@lo:400:kworker.0 Request processed in 31us (2442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304018.198603:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:1.0:1789304018.198627:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785501952 00000100:00100000:1.0:1789304018.198631:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785501952 00000100:00100000:1.0:1789304018.198655:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785501568 00000100:00100000:1.0:1789304018.198657:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785501568 00000100:00100000:1.0:1789304018.198673:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1789304018.198679:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785501952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198709:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785501952:12345-0@lo:400:kworker.0 Request processed in 30us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304018.198722:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1789304018.198734:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1789304018.198740:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785501568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198768:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785501568:12345-0@lo:400:kworker.0 Request processed in 28us (2657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304018.198773:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00080000:1.0:1789304018.198800:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304018.198804:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304018.198806:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304018.198852:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785501696:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198864:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785501568:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198901:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785501440:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198912:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785501952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198920:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785501312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304018.198930:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785501824:0@lo:400:kworker.0 00010000:00010000:2.0:1789304018.258290:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304019.291392:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304019.354787:0:63998:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe380862a0 20000000:00000080:1.0:1789304019.354808:0:63998:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c10e6a400 uarg=0000000000000000 00010000:00010000:1.0:1789304019.356829:0:63998:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304019.356868:0:63998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92a700) 00010000:00010000:1.0:1789304019.356872:0:63998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304019.356883:0:63998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231294c65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ffff9 expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304019.356909:0:63998:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304019.356936:0:63998:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304019.356951:0:63998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304019.356964:0:63998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231294c42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294c3b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304019.356972:0:63998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304019.357085:0:63998:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231294c42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294c3b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304019.357388:0:63998:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231294c42 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294c3b expref: 18 pid: 5845 timeout: 1619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304019.357404:0:63998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63998:1876219785502080:0@lo:104: 00000100:00100000:1.0:1789304019.357473:0:63998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304019.357560:0:63998:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c07978840 going to sleep for 11 seconds 00000100:00100000:2.0:1789304019.361827:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789304019.361856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785502080 00000100:00100000:2.0:1789304019.361866:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785502080 00000100:00100000:2.0:1789304019.366313:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789304019.366339:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41255850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:63998:x1876219785502080:12345-0@lo:104: 00010000:00010000:2.0:1789304019.366360:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304019.366573:0:63998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63998:1876219785502080:0@lo:104: 00010000:00010000:1.0:1789304019.366611:0:63998:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304019.367201:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304019.367210:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41255850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:63998:x1876219785502080:12345-0@lo:104: Request processed in 884us (9736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304019.367218:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00010000:0.0:1789304019.369464:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304019.369478:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.369520:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304019.369524:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.369535:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304019.369542:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304019.369547:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304019.369641:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.369648:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304019.369684:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.369691:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294c3b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294c42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.369709:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304019.369710:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304019.369712:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304019.369721:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304019.369740:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785502208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304019.369803:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304019.369853:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785502208 00000100:00100000:0.0:1789304019.369860:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785502208 00010000:00010000:0.0:1789304019.369897:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231294c42 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294c3b expref: 19 pid: 5845 timeout: 1619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304019.369925:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789304019.369934:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785502208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304019.369945:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304019.369950:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231294c42 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294c3b expref: 19 pid: 5845 timeout: 1619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.369962:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231294c42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294c3b expref: 19 pid: 5845 timeout: 1619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.369975:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231294c42 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294c3b expref: 19 pid: 5845 timeout: 1619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.369989:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.370311:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.370331:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.370338:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.370346:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.370353:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.370366:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304019.370370:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.370379:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.370393:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294cb9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304019.370406:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304019.370447:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785502208:12345-0@lo:103:ldlm_bl.0 Request processed in 514us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304019.370455:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789304019.370497:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785502208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304020.306593:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304020.756067:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785502336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304020.756298:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304020.756723:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785502336 00000100:00100000:1.0:1789304020.756733:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785502336 00000100:00100000:1.0:1789304020.756846:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1789304020.756857:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785502336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304020.756898:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304020.756964:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785502336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304020.756983:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1789304020.757162:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785502336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304020.834649:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304020.834690:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304020.834720:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304020.834743:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304020.834771:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765415424 00000100:00100000:0.0:1789304020.834783:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765415424 00000100:00100000:0.0:1789304020.834834:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 895 00000100:00100000:0.0:1789304020.834843:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765415424:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304020.834914:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765415424:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304020.834922:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 895 00000100:00080000:0.0:1789304020.836270:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304020.836277:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304020.836352:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765415552 00000100:00100000:1.0:1789304020.836360:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765415552 00000100:00100000:1.0:1789304020.836428:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1009 00000100:00100000:1.0:1789304020.836436:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765415552:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304020.836480:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765415552:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304020.836486:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1009 00000100:00080000:0.0:1789304020.837778:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1789304021.205620:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304021.205627:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304021.205631:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304021.205677:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294cc0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304021.205689:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294cc0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304021.205702:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294cc0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304021.205726:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785502464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304021.205789:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304021.205835:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789304021.205869:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785502464 00000100:00100000:0.0:1789304021.205875:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785502464 00000100:00100000:0.0:1789304021.205923:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1789304021.205931:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785502464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304021.205943:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304021.205956:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231294cc7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294cc0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304021.205978:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231294cc7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294cc0 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304021.205988:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231294cc7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294cc0 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304021.206009:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbc00, rc 0) 00000100:00100000:0.0:1789304021.206058:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785502464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304021.206065:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1789304021.206133:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785502464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304021.206147:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294cc0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294cc7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304021.206156:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294cc0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294cc7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304021.206175:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304021.206181:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294cc0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294cc7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304021.206188:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294cc0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294cc7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304021.331454:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304021.785687:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785502592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304021.785768:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789304021.787461:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304021.801482:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785502592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304022.326425:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304022.326461:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765415936 00000100:00100000:2.0:1789304022.326471:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765415936 00000100:00100000:2.0:1789304022.326536:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 489 00000100:00100000:2.0:1789304022.326548:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:37812:x1876219765415936:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304022.326568:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304022.326589:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294cce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610000e expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304022.326653:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294cd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304022.326667:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304022.326680:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304022.326715:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789304022.326719:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304022.326738:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304022.326779:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294cce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610000e expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304022.326803:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610000e expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304022.326812:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92ad00) 00010000:00010000:2.0:1789304022.326815:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304022.326819:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecde00, rc 0) 00000100:00100000:2.0:1789304022.326876:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:37812:x1876219765415936:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 331us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304022.326884:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 489 00000100:00080000:2.0:1789304022.326905:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304022.332940:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304022.332974:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765416192 00000100:00100000:1.0:1789304022.332983:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765416192 00000100:00100000:1.0:1789304022.333031:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 490 00000100:00100000:1.0:1789304022.333051:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:37812:x1876219765416192:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789304022.333121:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304022.333151:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231294cd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610000e expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304022.333167:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231294c65) 00010000:00010000:1.0:1789304022.333172:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92ad00) 00010000:00010000:1.0:1789304022.333183:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304022.333218:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304022.333233:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304022.333254:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304022.355383:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1789304022.393848:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026052fa0 reply state 000000004b12f271 transno 4294967487 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304022.393870:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304022.393888:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000100:00100000:1.0:1789304022.394221:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:37812:x1876219765416192:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 61165us (61283us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789304022.394231:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 490 00010000:00010000:0.0:1789304022.402595:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304022.402616:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304022.402625:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304022.402648:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304022.402653:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304022.402661:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304022.402680:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c03db3d00) 00010000:00010000:0.0:1789304022.402683:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304022.402689:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304022.402695:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231294cdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789304023.141348:0:64194:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff55428b0 20000000:00000080:1.0:1789304023.141368:0:64194:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f661400 uarg=0000000000000000 00010000:00010000:1.0:1789304023.142403:0:64194:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304023.142428:0:64194:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304023.142444:0:64194:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304023.142479:0:64194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294ce3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304023.142497:0:64194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231294cc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294cc0 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304023.142511:0:64194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294ce3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304023.142639:0:64194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231294cc7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294cc0 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304023.142657:0:64194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231294cc7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294cc0 expref: 18 pid: 5846 timeout: 1622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304023.142680:0:64194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032eea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64194:1876219785502720:0@lo:104: 00000100:00100000:1.0:1789304023.142740:0:64194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304023.142842:0:64194:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20511240 going to sleep for 11 seconds 00000100:00100000:2.0:1789304023.143875:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785502720 00000100:00100000:2.0:1789304023.143898:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785502720 00000100:00100000:2.0:1789304023.143960:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789304023.143969:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:64194:x1876219785502720:12345-0@lo:104: 00010000:00010000:2.0:1789304023.143984:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afae00/0xefc0bb7231294cc0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294cc7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304023.144136:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304023.144143:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:64194:x1876219785502720:12345-0@lo:104: Request processed in 176us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304023.144150:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789304023.144448:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785502848 00000100:00100000:2.0:1789304023.144455:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785502848 00000100:00100000:2.0:1789304023.148411:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785502848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304023.148983:0:64194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231294cc7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294cc0 expref: 18 pid: 5846 timeout: 1622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304023.149000:0:64194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032eea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64194:1876219785502720:0@lo:104: 00010000:00010000:1.0:1789304023.149021:0:64194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294ce3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304023.319730:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785503104:0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.319810:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304023.319876:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789304023.319882:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785502976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.319909:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304023.319926:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785503488:0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.319947:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304023.319971:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785503360:0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.319994:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304023.320013:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304023.320018:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785503232:0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.320054:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304023.320134:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785503104 00000100:00100000:0.0:1789304023.320143:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785503104 00000100:00100000:0.0:1789304023.320211:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785503488 00000100:00100000:0.0:1789304023.320216:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785503488 00000100:00100000:0.0:1789304023.320241:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1789304023.320251:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785503104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.320308:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785503104:12345-0@lo:400:kworker.0 Request processed in 58us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304023.320315:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1789304023.320332:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1789304023.320339:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785503488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.320366:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785503488:12345-0@lo:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304023.320371:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1789304023.320388:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785502976 00000100:00100000:0.0:1789304023.320391:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785502976 00000100:00100000:0.0:1789304023.320415:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785503360 00000100:00100000:0.0:1789304023.320417:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785503360 00000100:00100000:0.0:1789304023.320434:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785503232 00000100:00100000:0.0:1789304023.320437:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785503232 00000100:00100000:0.0:1789304023.320451:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1789304023.320456:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785502976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.320485:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785502976:12345-0@lo:400:kworker.0 Request processed in 29us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304023.320491:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1789304023.320502:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1789304023.320507:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785503360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.320533:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785503360:12345-0@lo:400:kworker.0 Request processed in 27us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304023.320545:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1789304023.320555:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1789304023.320561:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785503232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.320585:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785503232:12345-0@lo:400:kworker.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304023.320590:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00080000:0.0:1789304023.320606:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304023.320610:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304023.320613:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304023.320650:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785503232:0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.320660:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785503360:0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.320686:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785502976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.320695:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785503488:0@lo:400:kworker.0 00000100:00100000:0.0:1789304023.320703:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785503104:0@lo:400:kworker.0 00010000:00010000:2.0:1789304023.382278:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304024.405428:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785503616 00000100:00100000:1.0:1789304024.405438:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785503616 00000100:00100000:1.0:1789304024.405507:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1789304024.405518:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785503616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304024.405531:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304024.405546:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294cf1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294cea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304024.405571:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294cf1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294cea expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304024.405582:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294cf1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294cea expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304024.405591:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ea00, rc 0) 00000100:00100000:1.0:1789304024.405632:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785503616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304024.405651:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00010000:00010000:1.0:1789304024.408182:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304025.426180:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304025.878477:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785503744 00000100:00100000:2.0:1789304025.878491:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785503744 00000100:00100000:2.0:1789304025.878577:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1789304025.878591:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785503744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304025.878631:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304025.878699:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785503744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304025.878708:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:1.0:1789304025.961124:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304025.961174:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304025.961203:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304025.961227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304025.961263:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765416576 00000100:00100000:1.0:1789304025.961274:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765416576 00000100:00100000:1.0:1789304025.961341:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765416704 00000100:00100000:1.0:1789304025.961344:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765416704 00000100:00100000:1.0:1789304025.961378:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 709 00000100:00100000:1.0:1789304025.961390:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765416576:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304025.961471:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765416576:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304025.961480:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 709 00000100:00100000:1.0:1789304025.961500:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 710 00000100:00100000:1.0:1789304025.961508:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765416704:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304025.961531:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765416704:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304025.961538:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 710 00000100:00100000:1.0:1789304025.961556:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765416448 00000100:00100000:1.0:1789304025.961560:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765416448 00000100:00100000:1.0:1789304025.961593:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1013 00000100:00100000:1.0:1789304025.961602:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765416448:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304025.961650:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765416448:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 49us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304025.961664:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1013 00000100:00080000:1.0:1789304025.961685:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304025.961691:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304025.961693:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304025.962034:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765416320 00000100:00100000:0.0:1789304025.962041:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765416320 00000100:00100000:0.0:1789304025.962076:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 898 00000100:00100000:0.0:1789304025.962084:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765416320:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304025.962148:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765416320:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 64us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304025.962154:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 898 00000100:00100000:2.0:1789304026.824598:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765416832 00000100:00100000:2.0:1789304026.824610:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765416832 00000100:00100000:2.0:1789304026.824674:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 491 00000100:00100000:2.0:1789304026.824685:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:37889:x1876219765416832:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:2.0:1789304026.824706:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304026.824752:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294cf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100015 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.824832:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294cff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.824849:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294cff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.824865:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294cff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.824879:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.824896:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.824902:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826587:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231294d0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826608:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231294d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826618:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231294d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304026.826654:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789304026.826658:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304026.826680:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231294d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826695:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294cff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826702:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294cff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826708:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294cff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826714:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304026.826718:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294cff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826733:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294cff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826748:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2e92a200) 00010000:00010000:2.0:1789304026.826751:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304026.826758:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294cff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826763:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294cff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826775:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826781:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826786:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826790:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304026.826793:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826799:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826806:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c2e92a100) 00010000:00010000:2.0:1789304026.826808:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304026.826811:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826827:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826866:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294cf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100015 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826883:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231294d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100015 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.826890:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92af00) 00010000:00010000:2.0:1789304026.826893:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304026.826896:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc200, rc 0) 00000100:00100000:2.0:1789304026.827731:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:37889:x1876219765416832:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 3040us (3211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304026.827743:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 491 00000100:00100000:1.0:1789304026.837733:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304026.837797:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765417088 00000100:00100000:0.0:1789304026.837817:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765417088 00000100:00100000:2.0:1789304026.837930:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 492 00000100:00100000:2.0:1789304026.837947:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:37889:x1876219765417088:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:2.0:1789304026.837975:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304026.838012:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294d14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610001c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.838383:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.838399:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.838419:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.838434:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294d22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.838441:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294d22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.838447:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294d22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789304026.843252:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:2.0:1789304026.843744:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294d29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843767:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843781:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843827:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843834:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843842:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843847:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304026.843860:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843870:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843884:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92af00) 00010000:00010000:2.0:1789304026.843887:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304026.843892:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843898:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231294d1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304026.843912:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029abd8eb reply state 00000000e1150d75 transno 4294967488 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231294d22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304026.843922:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304026.843965:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294d14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610001c expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843982:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610001c expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.843989:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9e2c2e92a100) 00010000:00010000:2.0:1789304026.844003:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304026.844006:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd600, rc 0) 00000100:00100000:2.0:1789304026.844133:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:37889:x1876219765417088:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 6191us (6405us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1789304026.844143:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 492 00000100:00100000:1.0:1789304026.858563:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304026.858623:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765417344 00000100:00100000:0.0:1789304026.858635:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765417344 00000100:00100000:0.0:1789304026.858698:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 493 00000100:00100000:0.0:1789304026.858708:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:37889:x1876219765417344:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:0.0:1789304026.858764:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304026.858791:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231294d29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610001c expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.858810:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9e2c2e92a100) 00010000:00010000:0.0:1789304026.858822:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304026.858867:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231294d37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.858881:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231294d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.858892:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231294d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304026.859066:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f291b534 reply state 00000000de64f903 transno 4294967489 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231294d37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304026.859076:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304026.859577:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:37889:x1876219765417344:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 867us (1023us total) trans 4294967489 rc 0/0 00000100:00100000:0.0:1789304026.859585:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 493 00000100:00100000:1.0:1789304026.862473:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304026.865581:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765417472 00000100:00100000:2.0:1789304026.865596:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765417472 00000100:00100000:2.0:1789304026.865672:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 494 00000100:00100000:2.0:1789304026.865684:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:37889:x1876219765417472:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:2.0:1789304026.865709:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304026.865731:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100023 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.865797:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294d3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100023 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.865812:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294d3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100023 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304026.865831:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9e2c2e92ad00) 00010000:00010000:2.0:1789304026.865834:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789304026.865838:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecce00, rc 0) 00000100:00100000:2.0:1789304026.865912:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:37889:x1876219765417472:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 230us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304026.865919:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 494 00000100:00100000:1.0:1789304026.871232:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304026.874724:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304026.911500:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785503872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304026.911577:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304026.918256:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785503872 00000100:00100000:0.0:1789304026.918273:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785503872 00000100:00100000:0.0:1789304026.918349:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1789304026.918359:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785503872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304026.918399:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304026.918474:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785503872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (6898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304026.918480:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00080000:1.0:1789304026.919142:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304026.921630:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785503872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304026.939832:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304026.945239:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304026.945292:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765418112 00000100:00100000:0.0:1789304026.945302:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765418112 00000100:00100000:0.0:1789304026.945363:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 256 00000100:00100000:0.0:1789304026.945375:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765418112:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:0.0:1789304026.945398:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304026.945423:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231294d61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100031 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304026.945453:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x6aa69cdb, atime: 0x6aa69cdb, ctime: 0x6aa69cdb, blocks: 0x1 00010000:00010000:0.0:1789304026.945476:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=1476s v=(0 0) 00010000:00010000:0.0:1789304026.945481:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304026.945490:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231294d61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100031 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.945509:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231294d61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100031 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.945536:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789304026.945601:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765418112:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 228us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304026.945609:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 256 00000100:00100000:1.0:1789304026.952940:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:0.0:1789304026.955058:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294d76 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.955077:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294d76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.955138:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294d76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789304026.955752:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9216 00000004:00080000:0.0:1789304026.955764:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1476633673375ns, next at 1477633670873ns, rc = 0 00010000:00010000:0.0:1789304026.955830:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.955841:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.955851:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.955858:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.956976:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.957012:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.957037:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789304026.957071:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294d76 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.957078:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294d76 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.957085:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294d76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.957111:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304026.957117:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294d76 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304026.957119:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304026.957124:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294d76 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304026.957126:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304026.958947:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304026.958961:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304026.958974:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304026.959001:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:1.0:1789304026.959004:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304026.959011:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304026.959016:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231294d7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304026.959046:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304026.959049:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304026.959051:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304026.961483:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:0.0:1789304026.961497:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789304026.961510:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294d76 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.961521:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231294d76 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.961567:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231294d68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.961575:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231294d68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.961597:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231294d68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.961603:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304026.961607:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231294d68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.961617:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231294d68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.961632:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92af00) 00010000:00010000:0.0:1789304026.961634:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304026.961637:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231294d68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304026.961644:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231294d68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304026.961658:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e277135 reply state 000000009fd1ad28 transno 4294967491 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231294d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304026.961670:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304026.962768:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:37893:x1876219765418368:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 9631us (9826us total) trans 4294967491 rc 0/0 00000100:00100000:0.0:1789304026.962781:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 496 00010000:00010000:0.0:1789304027.477957:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304027.497966:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785504000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304027.498189:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304027.513363:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38463800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785504128:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789304027.513390:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231294d84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789304027.518025:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304027.530216:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231294d61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100031 expref: 7 pid: 6691 timeout: 1577 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304027.530306:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 294 00000100:00100000:2.0:1789304027.530325:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765418496:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304027.530347:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304027.530352:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231294d61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100031 expref: 7 pid: 6691 timeout: 1577 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304027.530366:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231294d61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100031 expref: 7 pid: 6691 timeout: 1577 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304027.530395:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231294d61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100031 expref: 7 pid: 6691 timeout: 1577 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304027.530415:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304027.530419:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304027.530425:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231294d84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304027.530434:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231294d84 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304027.530470:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304027.530546:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765418496:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 231us (17399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304027.530553:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 294 00010000:00010000:2.0:1789304027.530589:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231294d84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304027.530599:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231294d84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304027.530610:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231294d84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304027.530619:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231294d84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304027.530636:0:17212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789304027.531723:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785504000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33323us (33529us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789304027.531734:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000004:00080000:2.0:1789304027.531804:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c40c77b80/2, rc 0, transno 4294967328 00000100:00100000:2.0:1789304027.531811:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785504000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304028.438376:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785504384:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.438488:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304028.438550:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785504896:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.438575:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304028.438602:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789304028.438609:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785504256:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.438637:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304028.438658:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785504768:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.438680:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304028.438703:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785504512:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.438724:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304028.438743:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304028.438748:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785504640:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.438770:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304028.438802:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785504384 00000100:00100000:0.0:1789304028.438810:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785504384 00000100:00100000:0.0:1789304028.438853:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785504768 00000100:00100000:0.0:1789304028.438857:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785504768 00000100:00100000:0.0:1789304028.438882:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785504640 00000100:00100000:0.0:1789304028.438885:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785504640 00000100:00100000:0.0:1789304028.438902:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1789304028.438910:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785504384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.438964:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785504384:12345-0@lo:400:kworker.0 Request processed in 54us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304028.438972:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1789304028.439008:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1789304028.439014:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785504768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.439547:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785504768:12345-0@lo:400:kworker.0 Request processed in 533us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304028.439555:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1789304028.439571:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1789304028.439580:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785504640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.439621:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785504640:12345-0@lo:400:kworker.0 Request processed in 43us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304028.439626:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1789304028.439648:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785504896 00000100:00100000:0.0:1789304028.439652:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785504896 00000100:00100000:0.0:1789304028.439691:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785504512 00000100:00100000:0.0:1789304028.439694:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785504512 00000100:00100000:0.0:1789304028.439718:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1789304028.439724:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785504896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.439756:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785504896:12345-0@lo:400:kworker.0 Request processed in 33us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304028.439762:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1789304028.439774:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1789304028.439780:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785504512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.439806:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785504512:12345-0@lo:400:kworker.0 Request processed in 26us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304028.439811:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1789304028.439830:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785504256 00000100:00100000:0.0:1789304028.439834:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785504256 00000100:00100000:0.0:1789304028.439858:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:0.0:1789304028.439863:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785504256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.439906:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785504256:12345-0@lo:400:kworker.0 Request processed in 43us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304028.439911:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00080000:0.0:1789304028.439948:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304028.439952:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304028.439954:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304028.440007:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785504640:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.440017:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785504512:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.440720:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785504256:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.440737:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785504768:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.440750:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785504384:0@lo:400:kworker.0 00000100:00100000:0.0:1789304028.440761:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785504896:0@lo:400:kworker.0 00010000:00010000:0.0:1789304028.498177:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304029.187709:0:64440:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd21098060 20000000:00000080:1.0:1789304029.187727:0:64440:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c4131c000 uarg=0000000000000000 00010000:00010000:1.0:1789304029.189001:0:64440:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304029.189775:0:64440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2e92af00) 00010000:00010000:1.0:1789304029.189782:0:64440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304029.189794:0:64440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231294d0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100015 expref: 5 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304029.189817:0:64440:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304029.189841:0:64440:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304029.189856:0:64440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294d8b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304029.189869:0:64440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294cf1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294cea expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304029.189877:0:64440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294d8b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304029.189917:0:64440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294cf1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294cea expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304029.189929:0:64440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294cf1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294cea expref: 18 pid: 5847 timeout: 1628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304029.189957:0:64440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032edc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64440:1876219785505024:0@lo:104: 00000100:00100000:1.0:1789304029.190329:0:64440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304029.190387:0:64440:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c373ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1789304029.190704:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785505024 00000100:00100000:0.0:1789304029.190712:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785505024 00000100:00100000:0.0:1789304029.190767:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789304029.190776:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:64440:x1876219785505024:12345-0@lo:104: 00010000:00010000:0.0:1789304029.190790:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231294cea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294cf1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304029.190846:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304029.190853:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:64440:x1876219785505024:12345-0@lo:104: Request processed in 78us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304029.190860:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00010000:00010000:0.0:1789304029.190889:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304029.190895:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231294cea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294cf1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304029.190903:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304029.190907:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231294cea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294cf1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304029.190915:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231294cea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294cf1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304029.190922:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231294cea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294cf1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304029.190927:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304029.190955:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231294cea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294cf1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304029.190961:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789304029.191216:0:64440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032edc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64440:1876219785505024:0@lo:104: 00010000:00010000:1.0:1789304029.191237:0:64440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294d8b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304029.191308:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231294cea lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294cf1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304029.191316:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231294cea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294cf1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304029.191338:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304029.191341:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304029.191344:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304029.191352:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304029.191363:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785505152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304029.191399:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789304029.191966:0:64440:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294d8b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304029.191985:0:64440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294d8b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304029.191992:0:64440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294d8b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304029.192176:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785505152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304030.556791:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304030.588071:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967328 is committed 00000001:00080000:2.0:1789304030.588120:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967327 is committed 10000000:01000000:0.0:1789304030.802386:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304030.802396:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304030.802402:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304030.802461:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304030.802475:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304030.802487:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304030.802515:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785505280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304030.802604:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304030.802667:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c079789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304030.802785:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785505280 00000100:00100000:1.0:1789304030.802796:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785505280 00000100:00100000:1.0:1789304030.802861:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1789304030.802872:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785505280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304030.802887:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304030.802903:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294d99 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294d92 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304030.802931:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294d99 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294d92 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304030.802944:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294d99 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294d92 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304030.802974:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8fe00, rc 0) 00000100:00100000:0.0:1789304030.803038:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785505280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304030.803040:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785505280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304030.803051:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00010000:00010000:0.0:1789304030.803057:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304030.803069:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304030.803117:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304030.803124:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304030.803132:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304031.003043:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785505408 00000100:00100000:2.0:1789304031.003055:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785505408 00000100:00100000:2.0:1789304031.003141:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1789304031.003157:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785505408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304031.003197:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304031.003347:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785505408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304031.003360:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00080000:2.0:1789304031.003384:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304031.083132:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304031.083592:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765418624 00000100:00100000:0.0:1789304031.083598:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765418624 00000100:00100000:0.0:1789304031.083633:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 901 00000100:00100000:0.0:1789304031.083641:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765418624:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304031.083676:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765418624:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304031.083682:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 901 00000100:00080000:2.0:1789304031.083789:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304031.083793:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304031.572174:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304032.021738:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304032.029414:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785505536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304032.029495:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304032.031245:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785505536 00000100:00100000:0.0:1789304032.031259:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785505536 00000100:00100000:0.0:1789304032.031328:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1789304032.031337:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785505536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304032.031377:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304032.031453:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785505536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304032.031460:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00080000:0.0:1789304032.031483:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304032.031516:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967328 gen 2 00000004:00080000:0.0:1789304032.031522:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c40c77b80, transno 4294967328 00000100:00100000:0.0:1789304032.031540:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785505536:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789304032.589259:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967492 is committed 00010000:00010000:2.0:1789304032.594435:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304033.487800:0:64638:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb05be330 20000000:00000080:2.0:1789304033.487816:0:64638:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02f31800 uarg=0000000000000000 00010000:00010000:2.0:1789304033.488354:0:64638:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304033.488371:0:64638:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304033.488385:0:64638:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304033.488408:0:64638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.488427:0:64638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294d99 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294d92 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.488436:0:64638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.488478:0:64638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294d99 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294d92 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.488493:0:64638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294d99 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294d92 expref: 18 pid: 5847 timeout: 1633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304033.488513:0:64638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64638:1876219785505664:0@lo:104: 00000100:00100000:2.0:1789304033.492527:0:64638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304033.492584:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785505664 00000100:00100000:2.0:1789304033.492593:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785505664 00000100:00100000:2.0:1789304033.492652:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789304033.492661:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:64638:x1876219785505664:12345-0@lo:104: 00010000:00010000:2.0:1789304033.492677:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.492800:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304033.492806:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:64638:x1876219785505664:12345-0@lo:104: Request processed in 147us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304033.492813:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789304033.492860:0:64638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c01254000 going to sleep for 11 seconds 00000100:00100000:2.0:1789304033.492885:0:64638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64638:1876219785505664:0@lo:104: 00010000:00010000:2.0:1789304033.492912:0:64638:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.493286:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304033.493293:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.493300:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304033.493305:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.493313:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304033.493321:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304033.493327:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304033.493408:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.493414:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304033.493440:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.493447:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231294d92 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294d99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.493463:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304033.493465:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304033.493466:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304033.493547:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785505792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304033.493595:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304033.493838:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785505792 00000100:00100000:2.0:1789304033.493844:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785505792 00010000:00010000:2.0:1789304033.493869:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294d99 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294d92 expref: 19 pid: 5847 timeout: 1633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304033.493903:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789304033.493912:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785505792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304033.493924:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304033.493939:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294d99 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294d92 expref: 19 pid: 5847 timeout: 1633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.493950:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294d99 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294d92 expref: 19 pid: 5847 timeout: 1633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.493965:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb7231294d99 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294d92 expref: 19 pid: 5847 timeout: 1633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.493992:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494002:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494017:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494024:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494030:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494036:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494042:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304033.494046:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494053:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494066:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494079:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304033.494140:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785505792:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304033.494147:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00010000:00010000:2.0:1789304033.494170:0:64638:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494178:0:64638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304033.494183:0:64638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294db5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304033.494962:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785505792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304033.556142:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785506176:0@lo:400:kworker.0 00000100:00100000:2.0:1789304033.556201:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304033.556241:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304033.556247:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785506304:0@lo:400:kworker.0 00000100:00100000:2.0:1789304033.556270:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304033.557084:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785506176 00000100:00100000:0.0:1789304033.557122:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785506176 00000100:00100000:0.0:1789304033.557181:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785506304 00000100:00100000:0.0:1789304033.557197:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785506304 00000100:00100000:0.0:1789304033.557227:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1789304033.557237:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785506176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304033.557301:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785506176:12345-0@lo:400:kworker.0 Request processed in 66us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304033.557308:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1789304033.557325:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1789304033.557332:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785506304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304033.557360:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785506304:12345-0@lo:400:kworker.0 Request processed in 29us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304033.557365:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00080000:0.0:1789304033.557385:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304033.557594:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785506304:0@lo:400:kworker.0 00000100:00100000:2.0:1789304033.557605:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785506176:0@lo:400:kworker.0 00000100:00100000:0.0:1789304033.559795:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789304033.559814:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785505920:0@lo:400:kworker.0 00000100:00100000:0.0:1789304033.559882:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304033.559920:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785506432:0@lo:400:kworker.0 00000100:00100000:0.0:1789304033.559958:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304033.560065:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785506048 00000100:00100000:0.0:1789304033.560074:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785506048 00000100:00100000:0.0:1789304033.560140:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785506432 00000100:00100000:0.0:1789304033.560144:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785506432 00000100:00100000:0.0:1789304033.560175:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1789304033.560184:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785506048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304033.560242:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785506048:12345-0@lo:400:kworker.0 Request processed in 59us (3559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304033.560249:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1789304033.560266:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1789304033.560281:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785506432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304033.560310:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785506432:12345-0@lo:400:kworker.0 Request processed in 31us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304033.560316:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00080000:0.0:1789304033.560331:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304033.560360:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785506432:0@lo:400:kworker.0 00000100:00100000:0.0:1789304033.560375:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785506048:0@lo:400:kworker.0 00000100:00100000:0.0:1789304033.560423:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785505920 00000100:00100000:0.0:1789304033.560427:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785505920 00000100:00100000:0.0:1789304033.560451:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1789304033.560457:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785505920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304033.560495:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785505920:12345-0@lo:400:kworker.0 Request processed in 38us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304033.560500:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1789304033.560527:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785505920:0@lo:400:kworker.0 00010000:00010000:0.0:1789304033.633500:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304034.646720:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304035.474152:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304035.474161:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304035.474166:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304035.474219:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304035.474231:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304035.474243:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304035.474282:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785506560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304035.474356:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304035.474410:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b024b5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789304035.474538:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785506560 00000100:00100000:1.0:1789304035.474546:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785506560 00000100:00100000:1.0:1789304035.474608:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1789304035.474626:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785506560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304035.474641:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304035.474655:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294dc3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294dbc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304035.474679:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294dc3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294dbc expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304035.474690:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294dc3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294dbc expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304035.474701:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ea00, rc 0) 00000100:00100000:1.0:1789304035.474753:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785506560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304035.474761:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1789304035.474808:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785506560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304035.474822:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304035.474839:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304035.474857:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304035.474863:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304035.474870:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.681858:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304035.871897:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304035.875539:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765419520 00000100:00100000:2.0:1789304035.875556:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765419520 00000100:00080000:1.0:1789304035.875631:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304035.875645:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 499 00000100:00100000:2.0:1789304035.875656:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:38058:x1876219765419520:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:2.0:1789304035.875683:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304035.875706:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231294dca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610003f expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.875771:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294dd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.875786:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.875800:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.875813:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294dd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.875821:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.875828:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.878855:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294ddf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.878881:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294ddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.878894:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294ddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304035.878944:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789304035.878949:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304035.878972:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294ddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.878986:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.878994:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294dd1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879001:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879007:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304035.879012:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879020:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294dd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879032:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304035.879035:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304035.879040:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294dd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879047:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294dd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879062:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879068:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879078:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879083:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304035.879085:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879106:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879114:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304035.879117:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304035.879119:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294dd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879126:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294dd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.879169:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231294dca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610003f expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.880678:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294ddf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610003f expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304035.880689:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c421d2200) 00010000:00010000:2.0:1789304035.880692:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304035.880696:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789304035.880771:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:38058:x1876219765419520:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 5116us (8880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304035.880785:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 499 00000100:00100000:2.0:1789304036.114721:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785506688 00000100:00100000:2.0:1789304036.114729:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785506688 00000100:00100000:2.0:1789304036.114800:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1789304036.114810:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785506688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304036.114846:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304036.114892:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785506688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304036.114899:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00080000:1.0:1789304036.115044:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304036.115331:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785506688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304036.204606:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765419648 00000100:00100000:1.0:1789304036.204638:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765419648 00000100:00100000:1.0:1789304036.204718:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 903 00000100:00100000:1.0:1789304036.204730:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765419648:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304036.204824:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765419648:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 96us (10518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304036.204831:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 903 00000100:00100000:2.0:1789304036.206405:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765419904 00000100:00100000:2.0:1789304036.206418:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765419904 00000100:00100000:0.0:1789304036.206834:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765419776 00000100:00100000:0.0:1789304036.206839:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765419776 00000100:00100000:0.0:1789304036.210350:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 717 00000100:00100000:0.0:1789304036.210364:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765419904:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304036.210449:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765419904:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (15705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304036.210458:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 717 00000100:00100000:0.0:1789304036.214266:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 718 00000100:00100000:0.0:1789304036.214280:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765419776:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304036.214373:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765419776:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 96us (19600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304036.214381:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 718 00000100:00080000:1.0:1789304036.215127:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304036.215134:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304036.690254:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304037.569996:0:64883:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdfe632d00 20000000:00000080:1.0:1789304037.570015:0:64883:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c4131f800 uarg=0000000000000000 00010000:00010000:1.0:1789304037.570283:0:64883:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304037.570322:0:64883:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c421d2200) 00010000:00010000:1.0:1789304037.570326:0:64883:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304037.570344:0:64883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231294ddf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610003f expref: 5 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304037.570369:0:64883:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304037.570387:0:64883:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304037.570401:0:64883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304037.570414:0:64883:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294dc3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294dbc expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304037.570421:0:64883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304037.570461:0:64883:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294dc3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294dbc expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304037.570477:0:64883:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294dc3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294dbc expref: 18 pid: 5847 timeout: 1637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304037.570492:0:64883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64883:1876219785506944:0@lo:104: 00000100:00100000:1.0:1789304037.570558:0:64883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304037.570610:0:64883:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c36a87600 going to sleep for 11 seconds 00010000:00010000:0.0:1789304037.571485:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304037.571493:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571501:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304037.571506:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571515:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304037.571530:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304037.571536:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304037.571577:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571584:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304037.571604:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571611:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb7231294dbc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294dc3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571623:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304037.571625:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304037.571627:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304037.571640:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785507072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304037.571676:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304037.571721:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785507072 00000100:00100000:0.0:1789304037.571725:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785507072 00010000:00010000:0.0:1789304037.571745:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294dc3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294dbc expref: 19 pid: 5847 timeout: 1637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304037.571765:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789304037.571771:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785507072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304037.571782:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304037.571786:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294dc3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294dbc expref: 19 pid: 5847 timeout: 1637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571803:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294dc3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294dbc expref: 19 pid: 5847 timeout: 1637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571818:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571826:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571840:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571847:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571854:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571859:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571864:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304037.571867:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571875:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571884:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304037.571918:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304037.571959:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785507072:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304037.571966:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789304037.572026:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785507072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304037.572561:0:64883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294dc3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294dbc expref: 18 pid: 5847 timeout: 1637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304037.572569:0:64883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64883:1876219785506944:0@lo:104: 00010000:00010000:1.0:1789304037.572584:0:64883:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304037.572590:0:64883:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304037.572602:0:64883:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304037.572606:0:64883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231294de6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304038.677128:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304038.677150:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785507200:0@lo:400:kworker.0 00000100:00100000:0.0:1789304038.677216:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304038.677262:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785507328:0@lo:400:kworker.0 00000100:00100000:0.0:1789304038.677287:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304038.677347:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785507840:0@lo:400:kworker.0 00000100:00100000:0.0:1789304038.677367:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304038.677382:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304038.677388:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785507712:0@lo:400:kworker.0 00000100:00100000:0.0:1789304038.677416:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304038.677446:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785507200 00000100:00100000:0.0:1789304038.677450:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785507200 00000100:00100000:0.0:1789304038.677490:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1789304038.677497:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785507200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304038.677537:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785507200:12345-0@lo:400:kworker.0 Request processed in 41us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304038.677543:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:0.0:1789304038.677569:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785507328 00000100:00100000:0.0:1789304038.677573:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785507328 00000100:00100000:0.0:1789304038.677592:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785507584 00000100:00100000:0.0:1789304038.677593:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785507584 00000100:00100000:0.0:1789304038.677608:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785507712 00000100:00100000:0.0:1789304038.677621:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785507712 00000100:00100000:0.0:1789304038.677640:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1789304038.677649:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785507328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304038.677697:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785507328:12345-0@lo:400:kworker.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304038.677706:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1789304038.677718:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1789304038.677725:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785507584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304038.677744:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785507584:12345-0@lo:400:kworker.0 Request processed in 19us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304038.677750:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1789304038.677788:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785507328:0@lo:400:kworker.0 00000100:00100000:0.0:1789304038.677800:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785507840:0@lo:400:kworker.0 00000100:00100000:0.0:1789304038.677809:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785507200:0@lo:400:kworker.0 00000100:00100000:0.0:1789304038.677840:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785507712:0@lo:400:kworker.0 00010000:00010000:0.0:1789304038.739421:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304039.258724:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304039.258733:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304039.258737:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304039.258785:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304039.258798:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304039.258811:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304039.258836:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785507968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304039.258919:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304039.258986:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c2e90d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304039.259046:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785507968 00000100:00100000:2.0:1789304039.259054:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785507968 00000100:00100000:2.0:1789304039.259132:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1789304039.259142:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785507968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304039.259156:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304039.259169:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231294df4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294ded expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304039.259191:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231294df4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294ded expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304039.259203:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231294df4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294ded expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304039.259217:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc800, rc 0) 00000100:00100000:2.0:1789304039.259265:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785507968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304039.259272:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1789304039.259537:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785507968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304039.259552:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304039.259561:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304039.259580:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304039.259601:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304039.259608:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304039.772399:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304041.066881:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304041.066959:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765420032 00000100:00100000:0.0:1789304041.066970:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765420032 00000100:00100000:0.0:1789304041.067054:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 500 00000100:00100000:0.0:1789304041.067065:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:38145:x1876219765420032:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304041.067124:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304041.067165:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294dfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100046 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.067243:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294e02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.067268:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.067285:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304041.067325:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:0.0:1789304041.067329:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304041.067350:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294e02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.067381:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294dfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100046 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.067405:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231294e02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100046 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.067414:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:0.0:1789304041.067417:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304041.067422:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789304041.067484:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:38145:x1876219765420032:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 419us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304041.067491:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 500 00000100:00100000:0.0:1789304041.072883:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304041.236344:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304041.236373:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785508096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304041.236456:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789304041.250233:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304041.335705:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304041.335744:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304041.335778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304041.335814:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765420672 00000100:00100000:0.0:1789304041.335834:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765420672 00000100:00100000:0.0:1789304041.335909:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765420544 00000100:00100000:0.0:1789304041.335913:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765420544 00000100:00100000:0.0:1789304041.335942:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 721 00000100:00100000:0.0:1789304041.335953:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765420544:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304041.336032:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765420544:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304041.336040:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 721 00000100:00100000:0.0:1789304041.336060:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 258 00000100:00100000:0.0:1789304041.336066:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765420672:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:0.0:1789304041.336114:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231294c49 00000100:00080000:0.0:1789304041.336124:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9e2c3b4c8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789304041.336165:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:0.0:1789304041.336451:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765420672:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 383us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304041.336459:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 258 00000100:00080000:0.0:1789304041.336481:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304041.336485:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304041.336501:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304041.336628:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765420416 00000100:00100000:1.0:1789304041.336633:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765420416 00000100:00100000:1.0:1789304041.336672:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 906 00000100:00100000:1.0:1789304041.336680:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765420416:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304041.336707:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765420416:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304041.336714:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 906 00010000:00010000:2.0:1789304041.811639:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304041.915305:0:65081:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6d6a6920 20000000:00000080:1.0:1789304041.915325:0:65081:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c4131f400 uarg=0000000000000000 00010000:00010000:1.0:1789304041.916025:0:65081:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304041.916043:0:65081:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304041.916057:0:65081:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304041.916076:0:65081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304041.916133:0:65081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231294df4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294ded expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304041.916142:0:65081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304041.916181:0:65081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231294df4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294ded expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304041.916202:0:65081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231294df4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294ded expref: 18 pid: 5847 timeout: 1641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304041.916217:0:65081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65081:1876219785508224:0@lo:104: 00000100:00100000:1.0:1789304041.916285:0:65081:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304041.916345:0:65081:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13cf80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304041.916540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785508224 00000100:00100000:2.0:1789304041.916548:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785508224 00000100:00100000:2.0:1789304041.916602:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789304041.916612:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:65081:x1876219785508224:12345-0@lo:104: 00010000:00010000:2.0:1789304041.916635:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304041.916703:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304041.916709:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:65081:x1876219785508224:12345-0@lo:104: Request processed in 99us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304041.916716:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00010000:00010000:0.0:1789304041.916781:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304041.916789:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.916797:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304041.916801:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.916811:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304041.916820:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304041.916825:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304041.916871:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.916878:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304041.916912:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.916920:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231294ded lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294df4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.916935:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304041.916936:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304041.916938:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304041.916949:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785508352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304041.916983:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304041.917021:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785508352 00000100:00100000:0.0:1789304041.917026:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785508352 00010000:00010000:0.0:1789304041.917047:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231294df4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294ded expref: 19 pid: 5847 timeout: 1641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304041.917069:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789304041.917076:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0386b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785508352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304041.917086:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304041.917121:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231294df4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294ded expref: 19 pid: 5847 timeout: 1641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917132:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231294df4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294ded expref: 19 pid: 5847 timeout: 1641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917146:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917154:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917165:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917171:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917178:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917184:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917189:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304041.917193:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917198:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917206:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304041.917218:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304041.917247:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0386b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785508352:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304041.917253:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1789304041.917312:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785508352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304041.920306:0:65081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231294df4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294ded expref: 18 pid: 5847 timeout: 1641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304041.920329:0:65081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65081:1876219785508224:0@lo:104: 00010000:00010000:1.0:1789304041.920360:0:65081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304041.920371:0:65081:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304041.920378:0:65081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304041.920384:0:65081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231294e10 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304042.259262:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785508480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304042.259467:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304042.259547:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785508480 00000100:00100000:2.0:1789304042.259557:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785508480 00000100:00100000:2.0:1789304042.259621:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1789304042.259630:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785508480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304042.259663:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304042.259709:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785508480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304042.259716:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1789304042.259765:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785508480:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304042.260376:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304042.834227:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304043.283571:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304043.283582:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304043.283588:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304043.283642:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304043.283654:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304043.283674:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304043.283699:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785508608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304043.283778:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304043.283832:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0246d600 going to sleep for 11 seconds 00000100:00100000:2.0:1789304043.284011:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785508608 00000100:00100000:2.0:1789304043.284020:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785508608 00000100:00100000:2.0:1789304043.284074:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1789304043.284084:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785508608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304043.285279:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304043.285302:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294e1e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294e17 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304043.285334:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294e1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294e17 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304043.285345:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294e1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294e17 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304043.285353:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecde00, rc 0) 00000100:00100000:2.0:1789304043.285414:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785508608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1331us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304043.285421:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1789304043.289629:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785508608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304043.289661:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304043.289675:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304043.289700:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304043.289706:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304043.289714:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304043.801591:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785509120:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.801660:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304043.801715:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789304043.801721:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785508736:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.801750:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304043.801773:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785509248:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.801794:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304043.801819:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785508864:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.801853:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304043.801870:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785509376:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.802031:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304043.802051:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304043.802057:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785508992:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.802077:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304043.802133:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785509120 00000100:00100000:0.0:1789304043.802140:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785509120 00000100:00100000:0.0:1789304043.802205:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785509248 00000100:00100000:0.0:1789304043.802209:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785509248 00000100:00100000:0.0:1789304043.802224:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785508864 00000100:00100000:0.0:1789304043.802228:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785508864 00000100:00100000:0.0:1789304043.802242:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1789304043.802250:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785509120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.802303:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785509120:12345-0@lo:400:kworker.0 Request processed in 53us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304043.802310:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1789304043.802327:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1789304043.802333:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785509248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.802360:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785509248:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304043.802365:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1789304043.802376:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1789304043.802381:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785508864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.802409:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785508864:12345-0@lo:400:kworker.0 Request processed in 28us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304043.802414:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1789304043.802432:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785508736 00000100:00100000:0.0:1789304043.802435:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785508736 00000100:00100000:0.0:1789304043.802457:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1789304043.802463:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785508736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.802489:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785508736:12345-0@lo:400:kworker.0 Request processed in 26us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304043.802494:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1789304043.802525:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785509376 00000100:00100000:0.0:1789304043.802528:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785509376 00000100:00100000:0.0:1789304043.802686:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785508992 00000100:00100000:0.0:1789304043.802690:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785508992 00000100:00100000:0.0:1789304043.802720:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1789304043.802726:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785509376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.802758:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785509376:12345-0@lo:400:kworker.0 Request processed in 32us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304043.802764:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1789304043.802774:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1789304043.802780:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785508992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.802807:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785508992:12345-0@lo:400:kworker.0 Request processed in 27us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304043.802812:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1789304043.802873:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785508992:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.802951:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785508864:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.802964:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785509376:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.803020:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785508736:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.803031:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785509248:0@lo:400:kworker.0 00000100:00100000:0.0:1789304043.803040:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785509120:0@lo:400:kworker.0 00000100:00080000:1.0:1789304043.803450:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304043.803457:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304043.859256:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304044.884355:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304045.362983:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304045.363132:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765420800 00000100:00100000:1.0:1789304045.363143:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765420800 00000100:00100000:1.0:1789304045.363227:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 502 00000100:00100000:1.0:1789304045.363243:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:38230:x1876219765420800:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304045.363361:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:38230:x1876219765420800:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 123us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304045.363384:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 502 00000100:00080000:0.0:1789304045.363455:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304045.365784:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765420928 00000100:00100000:0.0:1789304045.365793:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765420928 00000100:00100000:2.0:1789304045.365954:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 259 00000100:00100000:2.0:1789304045.365968:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:38230:x1876219765420928:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:1.0:1789304045.366054:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304045.370292:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765421056 00000100:00100000:0.0:1789304045.370302:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765421056 00000100:00100000:0.0:1789304045.370345:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 260 00000100:00100000:0.0:1789304045.370357:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876219765421056:12345-192.168.202.29@tcp:8:lfs.60003 00010000:00080000:0.0:1789304045.370396:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1495 last 0 00000020:00000080:0.0:1789304045.370430:0:17212:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231294e25 00002000:00100000:0.0:1789304045.370443:0:17212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b01e8f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789304045.370469:0:17212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789304045.370568:0:17212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789304045.370612:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2b01e8b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789304045.370683:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765421056:12345-192.168.202.29@tcp:8:lfs.60003 Request processed in 327us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304045.370690:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 260 00000100:00100000:2.0:1789304045.376984:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:1.0:1789304045.378340:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304045.381329:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765421312 00000100:00100000:0.0:1789304045.381339:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765421312 00000100:00100000:0.0:1789304045.381404:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 503 00000100:00100000:0.0:1789304045.381416:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:38230:x1876219765421312:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304045.382034:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:38230:x1876219765421312:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 618us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304045.382043:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 503 00000100:00100000:0.0:1789304045.389985:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304045.390141:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765421440 00000100:00100000:2.0:1789304045.390152:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765421440 00000100:00100000:2.0:1789304045.390251:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 504 00000100:00100000:2.0:1789304045.390264:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:38230:x1876219765421440:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304045.390365:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:38230:x1876219765421440:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 103us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304045.390371:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 504 00000100:00100000:2.0:1789304045.395523:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304045.403080:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304045.418318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304045.418446:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765421824 00000100:00100000:1.0:1789304045.418457:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765421824 00000100:00100000:1.0:1789304045.418528:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 505 00000100:00100000:1.0:1789304045.418540:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:38230:x1876219765421824:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304045.419138:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:38230:x1876219765421824:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 553us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304045.419148:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 505 00000100:00100000:0.0:1789304045.490620:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304045.495772:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765422208 00000100:00100000:0.0:1789304045.495785:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765422208 00000100:00100000:0.0:1789304045.495937:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 507 00000100:00100000:0.0:1789304045.495948:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:38234:x1876219765422208:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304045.495972:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304045.495995:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231294e48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100054 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.496718:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294e4f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.496736:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294e4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.496749:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294e4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.496765:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.496772:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.496780:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789304045.498184:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10:0x0], index 1: 0 00010000:00010000:0.0:1789304045.498512:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294e5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498528:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498552:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498592:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294e4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498605:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294e4f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498613:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294e4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498619:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304045.498624:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294e4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498631:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294e4f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498643:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:0.0:1789304045.498647:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304045.498652:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294e4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498657:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231294e4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304045.498673:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003dc6132 reply state 00000000b60bb363 transno 4294967494 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304045.498683:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789304045.498719:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231294e48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100054 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498734:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294e5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100054 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.498747:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9e2c0558d200) 00010000:00010000:0.0:1789304045.498749:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304045.498752:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbc00, rc 0) 00000100:00100000:0.0:1789304045.499343:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:38234:x1876219765422208:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 3394us (3732us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1789304045.499353:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 507 00010000:00010000:2.0:1789304045.501780:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304045.501797:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304045.501804:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304045.501811:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304045.501985:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304045.501995:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304045.502011:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff9e2c0558d800) 00010000:00010000:2.0:1789304045.502014:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304045.502019:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304045.502025:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231294e56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304045.511678:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765422336 00000100:00100000:0.0:1789304045.511692:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765422336 00000100:00100000:0.0:1789304045.511770:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 264 00000100:00100000:0.0:1789304045.511782:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:38234:x1876219765422336:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304045.511803:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304045.511912:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e9d9e5e/0xefc0bb7231294e6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610005b expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304045.511951:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789304045.511986:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=1495s v=(0 0) 00010000:00010000:0.0:1789304045.511992:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304045.512004:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e9d9e5e/0xefc0bb7231294e6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610005b expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.512027:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e9d9e5e/0xefc0bb7231294e6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610005b expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304045.512042:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa200, rc 0) 00000100:00100000:0.0:1789304045.512177:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:38234:x1876219765422336:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 397us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304045.512186:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 264 00000100:00100000:0.0:1789304045.551589:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000001:00100000:1.0:1789304045.601846:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00100000:1.0:1789304045.601982:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304045.601987:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2c3b4cc000/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304045.602023:0:490:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c3b4cc000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:1.0:1789304045.602077:0:490:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c3b4c8800 for lustre-OST0001 00000100:00100000:2.0:1789304045.609859:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304045.609999:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765422592 00000100:00100000:0.0:1789304045.610011:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765422592 00000100:00100000:0.0:1789304045.610081:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 508 00000100:00100000:0.0:1789304045.610127:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:38234:x1876219765422592:12345-192.168.202.29@tcp:44:dd.60003 00000100:00100000:0.0:1789304045.644972:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:38234:x1876219765422592:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 34870us (35111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304045.644988:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 508 00000001:00080000:2.0:1789304045.650226:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967494 is committed 00000100:00100000:0.0:1789304045.653784:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000001:00080000:1.0:1789304045.694400:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967327 is committed 00000100:00100000:1.0:1789304045.696385:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304045.696477:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765422976 00000100:00100000:0.0:1789304045.696486:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765422976 00000100:00100000:0.0:1789304045.696531:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 55 00000100:00100000:0.0:1789304045.696540:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:38234:x1876219765422976:12345-192.168.202.29@tcp:35:dd.60003 00000100:00100000:0.0:1789304045.696984:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:38234:x1876219765422976:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 444us (607us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789304045.696990:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 55 00010000:00010000:0.0:1789304045.906589:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304046.359250:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304046.359381:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304046.359443:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785509504 00000100:00100000:2.0:1789304046.359461:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785509504 00000100:00080000:0.0:1789304046.359559:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304046.359604:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1789304046.359621:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785509504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304046.359661:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789304046.359736:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785509504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304046.359745:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1789304046.359892:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785509504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304046.437046:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304046.437080:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304046.437146:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304046.437175:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765423488 00000100:00100000:0.0:1789304046.437180:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765423488 00000100:00100000:0.0:1789304046.437222:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 724 00000100:00100000:0.0:1789304046.437233:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765423488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304046.437276:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765423488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 44us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304046.437291:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 724 00000100:00100000:0.0:1789304046.437318:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765423104 00000100:00100000:0.0:1789304046.437321:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765423104 00000100:00100000:0.0:1789304046.437351:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 909 00000100:00100000:0.0:1789304046.437359:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765423104:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304046.437385:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765423104:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304046.437392:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 909 00000100:00100000:0.0:1789304046.442330:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000001:00080000:0.0:1789304046.754446:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967495 is committed 00010000:00010000:2.0:1789304046.935993:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304047.384141:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785509632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304047.384218:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304047.384373:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785509632 00000100:00100000:2.0:1789304047.384383:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785509632 00000100:00100000:2.0:1789304047.384456:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1789304047.384466:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785509632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304047.384510:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304047.384566:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785509632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304047.384573:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00080000:0.0:1789304047.384638:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304047.384686:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785509632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304047.955189:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304048.451677:0:65328:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1498129582869ns, next at 1477633670873ns, rc = 0 00000004:00080000:2.0:1789304048.451803:0:65328:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1498129711420ns, next at 1450389973218ns, rc = 0 00000100:00100000:0.0:1789304048.914362:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785509760:0@lo:400:kworker.0 00000100:00100000:0.0:1789304048.914441:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304048.914597:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785509760 00000100:00100000:1.0:1789304048.914605:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785509760 00000100:00100000:1.0:1789304048.914684:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1789304048.914694:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785509760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304048.918114:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785509760:12345-0@lo:400:kworker.0 Request processed in 3414us (3665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304048.918128:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1789304048.918388:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785510400:0@lo:400:kworker.0 00000100:00100000:1.0:1789304048.918451:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304048.918539:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785510400 00000100:00100000:2.0:1789304048.918547:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785510400 00000100:00100000:2.0:1789304048.918599:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1789304048.918607:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785510400:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789304048.919808:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304048.919813:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304048.920108:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785510400:12345-0@lo:400:kworker.0 Request processed in 1502us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304048.920117:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1789304048.920200:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785510400:0@lo:400:kworker.0 00000100:00100000:0.0:1789304048.920424:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785509760:0@lo:400:kworker.0 00000100:00100000:2.0:1789304048.920498:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785510272:0@lo:400:kworker.0 00010000:00010000:0.0:1789304048.978290:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304050.079421:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765423616 00000100:00100000:0.0:1789304050.079432:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765423616 00000100:00100000:0.0:1789304050.079514:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 509 00000100:00100000:0.0:1789304050.079524:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:38427:x1876219765423616:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304050.079624:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:38427:x1876219765423616:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 101us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304050.079631:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 509 00000100:00100000:1.0:1789304050.088087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:1.0:1789304050.090408:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304050.098210:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:0.0:1789304050.098907:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304050.123148:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304050.123191:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765424000 00000100:00100000:2.0:1789304050.123201:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765424000 00000100:00100000:2.0:1789304050.123257:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 510 00000100:00100000:2.0:1789304050.123267:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:38427:x1876219765424000:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304050.123674:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:38427:x1876219765424000:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 407us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304050.123681:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 510 00000100:00100000:1.0:1789304050.136419:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304050.136454:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765424128 00000100:00100000:1.0:1789304050.136463:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765424128 00000100:00100000:1.0:1789304050.136514:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 511 00000100:00100000:1.0:1789304050.136524:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:38427:x1876219765424128:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304050.136614:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:38427:x1876219765424128:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 91us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304050.136621:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 511 00000100:00100000:0.0:1789304050.151025:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304050.151062:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765424256 00000100:00100000:0.0:1789304050.151073:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765424256 00000100:00100000:0.0:1789304050.151143:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 268 00000100:00100000:0.0:1789304050.151154:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:38427:x1876219765424256:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304050.151509:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:38427:x1876219765424256:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 357us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304050.151517:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 268 00000100:00100000:1.0:1789304050.159614:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304050.163364:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304050.281146:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304050.281437:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765424768 00000100:00100000:2.0:1789304050.281449:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765424768 00000100:00100000:2.0:1789304050.281505:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 513 00000100:00100000:2.0:1789304050.281516:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:38431:x1876219765424768:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:2.0:1789304050.281570:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304050.281597:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231294e5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100054 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.281628:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9e2c0558d200) 00010000:00010000:2.0:1789304050.281639:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304050.281660:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294e72 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.281676:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294e72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.281686:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294e72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.281701:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.281708:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.281715:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.282211:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294e80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.282222:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294e80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.282229:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294e80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304050.284713:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].16, 64 off9216 00000004:00080000:2.0:1789304050.284727:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1499962636190ns, next at 1500962633180ns, rc = 0 00010000:00010000:2.0:1789304050.285002:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285018:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285030:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285039:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285052:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285058:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285165:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304050.285190:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294e80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285196:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294e80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285204:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294e80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285210:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304050.285214:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294e80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285221:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294e80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285232:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:2.0:1789304050.285235:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304050.285239:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294e80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285245:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231294e80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285264:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294e72 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285270:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294e72 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285276:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294e72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285281:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304050.285284:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294e72 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285289:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294e72 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285296:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:2.0:1789304050.285298:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304050.285300:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294e72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304050.285306:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231294e72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304050.285314:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053b78ba8 reply state 0000000086b3e362 transno 4294967496 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304050.285322:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304050.285393:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:38431:x1876219765424768:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 3876us (4255us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789304050.285401:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 513 00010000:00010000:0.0:1789304050.287380:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304050.287393:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.287403:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304050.287407:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.287416:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.287431:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:0.0:1789304050.287435:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789304050.287439:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.287444:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231294e87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.287467:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304050.287469:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304050.287471:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304050.296023:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.296043:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.296051:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.296057:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304050.296062:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.296070:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.296087:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff9e2c421d2a00) 00010000:00010000:0.0:1789304050.296108:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304050.296115:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304050.296121:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231294e79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304051.028562:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304051.474588:0:8095:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1501152494285ns, next at 1502152491902ns, rc = 0 00000100:00100000:2.0:1789304051.475026:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785510528 00000100:00100000:2.0:1789304051.475035:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785510528 00000100:00100000:2.0:1789304051.475128:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1789304051.475137:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785510528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304051.475171:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789304051.475220:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785510528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304051.475228:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00080000:1.0:1789304051.475289:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304051.563908:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304051.563952:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304051.563979:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304051.564001:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304051.564026:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765425152 00000100:00100000:0.0:1789304051.564035:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765425152 00000100:00100000:0.0:1789304051.564082:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765425280 00000100:00100000:0.0:1789304051.564085:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765425280 00000100:00100000:0.0:1789304051.564128:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 728 00000100:00100000:0.0:1789304051.564137:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765425152:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304051.564205:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765425152:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304051.564212:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 728 00000100:00100000:0.0:1789304051.564228:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 729 00000100:00100000:0.0:1789304051.564235:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765425280:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304051.564260:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765425280:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304051.564267:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 729 00000100:00100000:0.0:1789304051.564283:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765425024 00000100:00100000:0.0:1789304051.564287:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765425024 00000100:00100000:0.0:1789304051.564311:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1031 00000100:00100000:0.0:1789304051.564317:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765425024:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304051.564343:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765425024:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304051.564353:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1031 00000100:00100000:0.0:1789304052.498969:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785510656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304052.499043:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789304052.503715:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304052.503806:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785510656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304053.013493:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785510784:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789304053.013634:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304053.013673:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785510784 00000100:00100000:2.0:1789304053.013682:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785510784 00000100:00100000:2.0:1789304053.013738:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789304053.013757:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785510784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789304053.013784:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:16 count 1 00000100:00080000:1.0:1789304053.013820:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304053.013869:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304053.013954:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e9d9e5e/0xefc0bb7231294e6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610005b expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304053.013963:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x10:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1789304053.013968:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304053.013973:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304053.013998:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e9d9e5e/0xefc0bb7231294e6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610005b expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304053.014009:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e9d9e5e/0xefc0bb7231294e6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610005b expref: 5 pid: 17212 timeout: 1602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304053.014018:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876219785510912:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789304053.014072:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c112d0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789304053.015519:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876219785510912:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789304053.015547:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304053.016230:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:1.0:1789304053.016606:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304053.017320:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304053.017331:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304053.017342:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304053.017349:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304053.017374:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789304053.017706:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304053.017713:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304053.017721:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304053.017726:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304053.017736:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304053.017977:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304053.017986:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b37d15e/0xefc0bb7231294e8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304053.018012:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304053.018014:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304053.018016:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304053.018217:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785510784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4408us (4519us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789304053.018229:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000004:00080000:0.0:1789304053.018410:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c02f2f100/2, rc 0, transno 4294967328 00000100:00100000:0.0:1789304053.018450:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785510784:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789304053.075054:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304054.034720:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785511296:0@lo:400:kworker.0 00000100:00100000:1.0:1789304054.034815:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304054.034888:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304054.034894:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785511424:0@lo:400:kworker.0 00000100:00100000:1.0:1789304054.034918:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304054.035048:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785511168 00000100:00100000:2.0:1789304054.035057:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785511168 00000100:00100000:2.0:1789304054.039190:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1789304054.039212:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785511424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304054.039303:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785511424:12345-0@lo:400:kworker.0 Request processed in 101us (4384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304054.039311:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1789304054.039331:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:2.0:1789304054.039338:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785511168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304054.039378:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785511168:12345-0@lo:400:kworker.0 Request processed in 41us (4482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304054.039385:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:2.0:1789304054.039399:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:2.0:1789304054.039406:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785511552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304054.039435:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785511552:12345-0@lo:400:kworker.0 Request processed in 30us (4402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304054.039440:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:2.0:1789304054.039491:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785511552:0@lo:400:kworker.0 00000100:00100000:2.0:1789304054.039506:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785511168:0@lo:400:kworker.0 00000100:00100000:1.0:1789304054.039935:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785511296 00000100:00100000:1.0:1789304054.039945:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785511296 00000100:00100000:1.0:1789304054.040011:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785511680 00000100:00100000:1.0:1789304054.040018:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785511680 00000100:00100000:1.0:1789304054.040046:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1789304054.040053:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785511296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304054.040124:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785511296:12345-0@lo:400:kworker.0 Request processed in 72us (5309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304054.040132:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1789304054.040144:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1789304054.040152:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785511680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304054.040188:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785511680:12345-0@lo:400:kworker.0 Request processed in 38us (5246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304054.040194:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:1.0:1789304054.040230:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785511424:0@lo:400:kworker.0 00000100:00100000:1.0:1789304054.040242:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785511296:0@lo:400:kworker.0 00000100:00100000:1.0:1789304054.040276:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785511680:0@lo:400:kworker.0 00000100:00080000:0.0:1789304054.041904:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304054.041915:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304054.041932:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785511040 00000100:00100000:0.0:1789304054.041941:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785511040 00000100:00100000:0.0:1789304054.042001:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1789304054.042009:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785511040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304054.042081:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785511040:12345-0@lo:400:kworker.0 Request processed in 73us (7089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304054.042104:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1789304054.042278:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785511040:0@lo:400:kworker.0 00010000:00010000:2.0:1789304054.098472:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304055.122234:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304056.146190:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304056.594586:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304056.594612:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785511808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304056.594699:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789304056.596015:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304056.596048:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967328 gen 2 00000004:00080000:0.0:1789304056.596054:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c02f2f100, transno 4294967328 00000100:00100000:0.0:1789304056.596082:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785511808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304056.676842:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304056.676891:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304056.676930:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304056.676970:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304056.677005:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765425920 00000100:00100000:0.0:1789304056.677016:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765425920 00000100:00100000:0.0:1789304056.677073:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765425792 00000100:00100000:0.0:1789304056.677076:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765425792 00000100:00100000:0.0:1789304056.677147:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 732 00000100:00100000:0.0:1789304056.677156:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765425920:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304056.677224:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765425920:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 69us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304056.677232:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 732 00000100:00100000:0.0:1789304056.677248:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 733 00000100:00100000:0.0:1789304056.677256:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765425792:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304056.677287:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765425792:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304056.677295:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 733 00000100:00080000:0.0:1789304056.677434:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304056.677438:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304056.677516:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765425664 00000100:00100000:2.0:1789304056.677521:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765425664 00000100:00100000:2.0:1789304056.677568:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1035 00000100:00100000:2.0:1789304056.677576:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765425664:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304056.677616:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765425664:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304056.677623:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1035 00000100:00080000:0.0:1789304056.680005:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304057.173122:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304057.625211:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785511936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304057.625286:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304057.625743:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785511936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304057.626073:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304058.195169:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304059.154410:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785512192:0@lo:400:kworker.0 00000100:00100000:1.0:1789304059.154575:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304059.154634:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785512704:0@lo:400:kworker.0 00000100:00100000:1.0:1789304059.154661:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304059.154674:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785512064:0@lo:400:kworker.0 00000100:00100000:1.0:1789304059.154704:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785512448:0@lo:400:kworker.0 00000100:00100000:2.0:1789304059.154719:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304059.154726:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304059.154744:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785512576:0@lo:400:kworker.0 00000100:00100000:1.0:1789304059.154757:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304059.154763:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785512320:0@lo:400:kworker.0 00000100:00100000:2.0:1789304059.154765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304059.154793:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785512064 00000100:00100000:2.0:1789304059.154801:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785512064 00000100:00100000:2.0:1789304059.154839:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1789304059.154848:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785512064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304059.154865:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304059.154892:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785512064:12345-0@lo:400:kworker.0 Request processed in 45us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304059.154899:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1789304059.154931:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785512192 00000100:00100000:2.0:1789304059.154935:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785512192 00000100:00100000:2.0:1789304059.154975:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785512448 00000100:00100000:2.0:1789304059.154978:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785512448 00000100:00100000:2.0:1789304059.155005:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785512576 00000100:00100000:2.0:1789304059.155008:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785512576 00000100:00100000:2.0:1789304059.155022:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1789304059.155028:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785512192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304059.155063:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785512192:12345-0@lo:400:kworker.0 Request processed in 35us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304059.155069:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1789304059.155081:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1789304059.155086:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785512448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304059.155146:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785512448:12345-0@lo:400:kworker.0 Request processed in 60us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304059.155152:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1789304059.155164:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1789304059.155170:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785512576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304059.155195:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785512576:12345-0@lo:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304059.155200:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1789304059.155236:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785512064:0@lo:400:kworker.0 00000100:00100000:2.0:1789304059.155248:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785512576:0@lo:400:kworker.0 00000100:00100000:2.0:1789304059.155282:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785512448:0@lo:400:kworker.0 00000100:00100000:2.0:1789304059.155312:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785512192:0@lo:400:kworker.0 00000100:00100000:0.0:1789304059.155445:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785512704 00000100:00100000:0.0:1789304059.155449:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785512704 00000100:00100000:0.0:1789304059.155484:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785512320 00000100:00100000:0.0:1789304059.155487:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785512320 00000100:00100000:0.0:1789304059.155508:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1789304059.155516:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785512704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304059.155522:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1789304059.155531:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785512320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304059.155563:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785512320:12345-0@lo:400:kworker.0 Request processed in 34us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304059.155563:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785512704:12345-0@lo:400:kworker.0 Request processed in 47us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304059.155569:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1789304059.159209:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00080000:0.0:1789304059.159257:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304059.159262:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304059.159265:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304059.159361:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785512320:0@lo:400:kworker.0 00010000:00010000:0.0:1789304059.218233:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304060.242347:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304061.266261:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304061.715503:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785512832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304061.715576:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304061.715780:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785512832 00000100:00100000:2.0:1789304061.715789:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785512832 00000100:00100000:2.0:1789304061.715853:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:2.0:1789304061.715861:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785512832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304061.715896:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304061.715938:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785512832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304061.715945:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00080000:0.0:1789304061.715995:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304061.716024:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785512832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304061.797611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304061.797789:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304061.798515:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304061.798570:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304061.798604:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765426304 00000100:00100000:1.0:1789304061.798614:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765426304 00000100:00100000:1.0:1789304061.798690:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765426432 00000100:00100000:1.0:1789304061.798696:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765426432 00000100:00100000:2.0:1789304061.798853:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765426048 00000100:00100000:2.0:1789304061.798866:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765426048 00000100:00100000:2.0:1789304061.798907:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 915 00000100:00100000:2.0:1789304061.798916:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765426048:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304061.798950:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765426048:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 36us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304061.798956:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 915 00000100:00080000:2.0:1789304061.799404:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304061.799410:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304061.799414:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304061.799858:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 736 00000100:00100000:1.0:1789304061.799879:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765426304:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304061.799891:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 737 00000100:00100000:2.0:1789304061.799908:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765426432:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304061.799975:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765426304:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 102us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304061.799984:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 736 00000100:00100000:2.0:1789304061.800051:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765426432:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 146us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304061.800060:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 737 00010000:00010000:0.0:1789304062.290338:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304062.740940:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785512960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304062.741053:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304062.742958:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785512960:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789304062.744924:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304063.318508:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304064.274694:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785513472:0@lo:400:kworker.0 00000100:00100000:0.0:1789304064.274796:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304064.274883:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304064.274889:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785513344:0@lo:400:kworker.0 00000100:00100000:0.0:1789304064.274917:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304064.275877:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785513472 00000100:00100000:1.0:1789304064.275883:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785513472 00000100:00100000:1.0:1789304064.275943:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785513216 00000100:00100000:1.0:1789304064.275946:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785513216 00000100:00100000:1.0:1789304064.275970:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785513600 00000100:00100000:1.0:1789304064.275973:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785513600 00000100:00100000:1.0:1789304064.275994:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1789304064.276000:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785513472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304064.276049:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785513472:12345-0@lo:400:kworker.0 Request processed in 49us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304064.276076:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1789304064.276137:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1789304064.276145:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785513216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789304064.280002:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304064.280030:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785513344 00000100:00100000:0.0:1789304064.280042:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785513344 00000100:00100000:0.0:1789304064.280128:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785513728 00000100:00100000:0.0:1789304064.280132:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785513728 00000100:00100000:0.0:1789304064.280165:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1789304064.280176:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785513344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304064.280266:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785513344:12345-0@lo:400:kworker.0 Request processed in 93us (5348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304064.280273:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1789304064.280288:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1789304064.280294:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785513728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304064.280324:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785513728:12345-0@lo:400:kworker.0 Request processed in 30us (4976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304064.280330:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00080000:0.0:1789304064.280346:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304064.280349:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304064.299220:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785513216:12345-0@lo:400:kworker.0 Request processed in 23058us (24337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304064.299243:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1789304064.299438:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785513216:0@lo:400:kworker.0 00010000:00010000:0.0:1789304064.339177:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304065.364182:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304066.387780:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304066.834650:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785513856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304066.834733:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789304066.835342:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304066.837221:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785513856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304066.916875:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304066.918227:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304066.918281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304066.918313:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304066.918350:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765426944 00000100:00100000:0.0:1789304066.918360:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765426944 00000100:00100000:0.0:1789304066.918424:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765426816 00000100:00100000:0.0:1789304066.918427:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765426816 00000100:00100000:0.0:1789304066.918453:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 740 00000100:00100000:0.0:1789304066.918462:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765426944:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304066.918894:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 741 00000100:00100000:1.0:1789304066.918906:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765426816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304066.918992:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765426816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304066.919000:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 741 00000100:00080000:1.0:1789304066.919221:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304066.919227:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304066.920453:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765426944:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1981us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304066.920469:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 740 00000100:00100000:2.0:1789304066.920895:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765426560 00000100:00100000:2.0:1789304066.920906:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765426560 00000100:00100000:2.0:1789304066.920975:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 917 00000100:00100000:2.0:1789304066.920984:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765426560:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304066.921032:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765426560:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 49us (2749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304066.921042:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 917 00000100:00080000:1.0:1789304066.924273:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304067.410601:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304067.858396:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785513984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304067.858468:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304067.858676:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785513984 00000100:00100000:2.0:1789304067.858684:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785513984 00000100:00100000:2.0:1789304067.858819:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1789304067.858829:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785513984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304067.858864:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304067.858932:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785513984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304067.858939:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:1.0:1789304067.859033:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785513984:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304067.859295:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304068.434250:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304069.111527:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:0.0:1789304069.112127:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304069.117680:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304069.119420:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765427200 00000100:00100000:1.0:1789304069.119434:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765427200 00000100:00100000:1.0:1789304069.119627:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 271 00000100:00100000:1.0:1789304069.119643:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:38649:x1876219765427200:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304069.120031:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:38649:x1876219765427200:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 393us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304069.120049:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 271 00000100:00100000:1.0:1789304069.122425:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:0.0:1789304069.122634:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304069.122638:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304069.138848:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765427456 00000100:00100000:1.0:1789304069.138860:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765427456 00000100:00100000:1.0:1789304069.138928:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 515 00000100:00100000:1.0:1789304069.138939:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:38649:x1876219765427456:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304069.139833:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:38649:x1876219765427456:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 893us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304069.139843:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 515 00000100:00100000:1.0:1789304069.158135:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765427584 00000100:00100000:1.0:1789304069.158146:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765427584 00000100:00100000:1.0:1789304069.158203:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 516 00000100:00100000:1.0:1789304069.158215:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:38649:x1876219765427584:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304069.158309:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:38649:x1876219765427584:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304069.158317:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 516 00000100:00100000:0.0:1789304069.162740:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304069.165881:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765427712 00000100:00100000:1.0:1789304069.165895:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765427712 00000100:00100000:1.0:1789304069.165991:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 273 00000100:00100000:1.0:1789304069.166003:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:38649:x1876219765427712:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304069.167389:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:38649:x1876219765427712:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1383us (4654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304069.167401:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 273 00000100:00100000:1.0:1789304069.168838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304069.171129:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 274 00000100:00100000:1.0:1789304069.172247:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:38649:x1876219765427840:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304069.186944:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:38649:x1876219765427840:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 14699us (18100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304069.186959:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 274 00000100:00100000:0.0:1789304069.203453:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304069.203590:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765427968 00000100:00100000:0.0:1789304069.204282:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765427968 00000100:00100000:0.0:1789304069.204351:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 517 00000100:00100000:0.0:1789304069.204362:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:38649:x1876219765427968:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304069.205037:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:38649:x1876219765427968:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 675us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304069.205046:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 517 00000100:00100000:1.0:1789304069.263414:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304069.263647:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765428096 00000100:00100000:0.0:1789304069.263658:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765428096 00000100:00100000:0.0:1789304069.263721:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 518 00000100:00100000:0.0:1789304069.263731:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:38650:x1876219765428096:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304069.263754:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304069.263780:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231294e95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100062 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304069.263853:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294e9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304069.263886:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304069.263899:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304069.263944:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:0.0:1789304069.263949:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304069.263971:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304069.263998:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231294e95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100062 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304069.264021:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100062 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304069.264031:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:0.0:1789304069.264034:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304069.264038:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afae00, rc 0) 00000100:00100000:0.0:1789304069.264153:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:38650:x1876219765428096:12345-192.168.202.29@tcp:101:rm.0 Request processed in 423us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304069.264159:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 518 00000100:00100000:0.0:1789304069.274047:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304069.278342:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765428352 00000100:00100000:1.0:1789304069.278357:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765428352 00000100:00100000:0.0:1789304069.278781:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 519 00000100:00100000:0.0:1789304069.278792:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:38650:x1876219765428352:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304069.278813:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304069.278836:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231294ea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100069 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304069.278946:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:0.0:1789304069.279256:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231294ea3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100069 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304069.279272:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d000) 00010000:00010000:0.0:1789304069.279276:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789304069.279281:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231294ea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100069 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304069.279299:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789304069.279371:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:38650:x1876219765428352:12345-192.168.202.29@tcp:101:rm.0 Request processed in 580us (5333us total) trans 4294967497 rc 301/301 00000100:00100000:0.0:1789304069.279380:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 519 00000100:00100000:0.0:1789304069.298770:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304069.299810:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765428480 00000100:00100000:1.0:1789304069.299822:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765428480 00000100:00100000:1.0:1789304069.299893:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:1.0:1789304069.299905:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:38650:x1876219765428480:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:0.0:1789304069.306047:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:38650:x1876219765428480:12345-192.168.202.29@tcp:37:rm.0 Request processed in 6128us (7273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304069.306078:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:2.0:1789304069.315252:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304069.315292:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765428736 00000100:00100000:2.0:1789304069.315302:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765428736 00000100:00100000:2.0:1789304069.315353:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:2.0:1789304069.315363:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:38650:x1876219765428736:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:2.0:1789304069.315860:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:38650:x1876219765428736:12345-192.168.202.29@tcp:35:rm.0 Request processed in 496us (614us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789304069.315870:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:2.0:1789304069.328534:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304069.328773:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765428992 00000100:00100000:1.0:1789304069.328787:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765428992 00000100:00100000:1.0:1789304069.328865:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 520 00000100:00100000:1.0:1789304069.328878:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:38650:x1876219765428992:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:1.0:1789304069.328949:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789304069.328984:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231294e9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100062 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329005:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231294e41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610004d expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329015:0:7654:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231294a97) 00010000:00010000:1.0:1789304069.329020:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:1.0:1789304069.329030:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304069.329056:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294eb1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329081:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294eb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329108:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294eb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329121:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294eb8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329128:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329135:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329511:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294ebf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329520:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294ebf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329527:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294ebf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329777:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294ebf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329786:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294ebf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329793:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294ebf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329808:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304069.329813:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294ebf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329820:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294ebf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329830:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:1.0:1789304069.329833:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789304069.329837:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294ebf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329844:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231294ebf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329863:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294eb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329870:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294eb1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329876:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294eb1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329881:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304069.329884:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294eb1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329891:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294eb1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329908:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:1.0:1789304069.329910:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304069.329913:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294eb1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329919:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231294eb1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329930:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329937:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294eb8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329944:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329949:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304069.329952:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329959:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294eb8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329965:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9e2c14add700) 00010000:00010000:1.0:1789304069.329967:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304069.329969:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294eb8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304069.329975:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231294eb8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304069.330109:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:38650:x1876219765428992:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1209us (1561us total) trans 0 rc -13/-13 00000100:00100000:1.0:1789304069.330118:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 520 00000100:00100000:0.0:1789304069.395788:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785514112:0@lo:400:kworker.0 00000100:00100000:0.0:1789304069.395889:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304069.395903:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785514240:0@lo:400:kworker.0 00000100:00100000:0.0:1789304069.396123:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785514624:0@lo:400:kworker.0 00000100:00100000:0.0:1789304069.396154:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304069.396192:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785514112 00000100:00100000:0.0:1789304069.396199:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785514112 00000100:00100000:0.0:1789304069.396241:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1789304069.396249:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785514112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304069.396294:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785514112:12345-0@lo:400:kworker.0 Request processed in 46us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304069.396302:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1789304069.396331:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785514624 00000100:00100000:0.0:1789304069.396334:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785514624 00000100:00100000:0.0:1789304069.396362:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1789304069.396367:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785514624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304069.396497:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785514624:12345-0@lo:400:kworker.0 Request processed in 130us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304069.396504:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00080000:0.0:1789304069.396532:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304069.396561:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785514624:0@lo:400:kworker.0 00000100:00100000:0.0:1789304069.396569:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785514112:0@lo:400:kworker.0 00000100:00100000:0.0:1789304069.397659:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785514496 00000100:00100000:0.0:1789304069.397665:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785514496 00000100:00100000:1.0:1789304069.398989:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304069.399022:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785514752:0@lo:400:kworker.0 00000100:00100000:1.0:1789304069.399049:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304069.399167:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785514240 00000100:00100000:0.0:1789304069.399174:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785514240 00000100:00100000:0.0:1789304069.399194:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1789304069.399201:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785514496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304069.399237:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785514496:12345-0@lo:400:kworker.0 Request processed in 37us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304069.399243:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1789304069.399255:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1789304069.399260:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785514240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304069.399289:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785514240:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304069.399296:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1789304069.399332:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785514240:0@lo:400:kworker.0 00000100:00100000:2.0:1789304069.399438:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785514752 00000100:00100000:2.0:1789304069.399444:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785514752 00000100:00100000:2.0:1789304069.399505:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1789304069.399513:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785514752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304069.399559:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785514752:12345-0@lo:400:kworker.0 Request processed in 47us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304069.399564:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:0.0:1789304069.399666:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785514752:0@lo:400:kworker.0 00000100:00100000:2.0:1789304069.400383:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785514496:0@lo:400:kworker.0 00000100:00100000:2.0:1789304069.400398:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785514368:0@lo:400:kworker.0 00010000:00010000:0.0:1789304070.482250:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304071.352081:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785514880 00000100:00100000:2.0:1789304071.352282:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785514880 00000100:00100000:2.0:1789304071.352372:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789304071.352382:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:65692:x1876219785514880:12345-0@lo:104: 00010000:00010000:2.0:1789304071.352397:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304071.352480:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304071.352487:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:65692:x1876219785514880:12345-0@lo:104: Request processed in 106us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304071.352493:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789304071.352556:0:65692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65692:1876219785514880:0@lo:104: 00010000:00010000:1.0:1789304071.352684:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304071.352691:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.352699:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304071.352704:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.352714:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304071.352721:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304071.352727:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304071.352758:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.352764:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304071.352786:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.352812:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb7231294e17 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294e1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.352828:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304071.352830:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304071.352832:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304071.352847:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304071.352859:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785515008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304071.352893:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304071.353155:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785515008 00000100:00100000:1.0:1789304071.353162:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785515008 00010000:00010000:1.0:1789304071.353192:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294e1e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294e17 expref: 19 pid: 5845 timeout: 1671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304071.353218:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789304071.353225:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785515008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304071.353237:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304071.353242:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294e1e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294e17 expref: 19 pid: 5845 timeout: 1671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353254:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294e1e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294e17 expref: 19 pid: 5845 timeout: 1671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353269:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294e1e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294e17 expref: 19 pid: 5845 timeout: 1671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353283:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353302:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353315:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353323:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353330:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353337:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353343:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304071.353347:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353354:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353362:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304071.353371:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304071.353403:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785515008:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304071.353410:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789304071.353440:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785515008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304071.353523:0:65692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304071.353533:0:65692:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304071.353540:0:65692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304071.353546:0:65692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231294ec6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304071.957342:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304071.957365:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785515136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304071.957436:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789304071.962233:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304072.037803:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765429376 00000100:00100000:1.0:1789304072.037809:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765429376 00000100:00100000:1.0:1789304072.037872:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765429504 00000100:00100000:1.0:1789304072.037876:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765429504 00000100:00080000:0.0:1789304072.037899:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304072.037904:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 744 00000100:00080000:0.0:1789304072.037905:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304072.037917:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765429376:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304072.037982:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765429376:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 70us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304072.037990:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 744 00000100:00100000:1.0:1789304072.038009:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 745 00000100:00100000:1.0:1789304072.038016:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765429504:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304072.038040:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765429504:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304072.038046:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 745 00000020:00000080:1.0:1789304072.462884:0:65740:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffddd18a790 20000000:00000080:1.0:1789304072.462900:0:65740:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854d000 uarg=0000000000000000 00010000:00010000:1.0:1789304072.463153:0:65740:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304072.463167:0:65740:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304072.463184:0:65740:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304072.463203:0:65740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.463217:0:65740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.463227:0:65740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.463243:0:65740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.463249:0:65740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.463256:0:65740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.463261:0:65740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304072.463265:0:65740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.463272:0:65740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.463285:0:65740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.463292:0:65740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.463298:0:65740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e600/0xefc0bb7231294ecd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304072.536418:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304072.979293:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785515264 00000100:00100000:2.0:1789304072.979302:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785515264 00000100:00100000:2.0:1789304072.979368:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:2.0:1789304072.979377:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785515264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304072.979411:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304072.979471:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785515264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304072.979479:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 10000000:01000000:1.0:1789304073.234861:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304073.234867:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304073.234872:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304073.234910:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.234925:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.234934:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304073.234954:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785515392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304073.235013:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304073.235064:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1789304073.235135:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785515392 00000100:00100000:0.0:1789304073.235142:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785515392 00000100:00100000:0.0:1789304073.235184:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:0.0:1789304073.235193:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785515392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304073.235206:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304073.235220:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231294edb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294ed4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.235243:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231294edb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294ed4 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.235254:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231294edb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294ed4 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.235263:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa400, rc 0) 00000100:00100000:0.0:1789304073.235450:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785515392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 258us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304073.235456:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1789304073.247151:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785515392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304073.247205:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.247238:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304073.247292:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304073.247299:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.247307:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789304073.455830:0:65788:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd85a48d00 20000000:00000080:1.0:1789304073.455847:0:65788:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854c400 uarg=0000000000000000 00010000:00010000:1.0:1789304073.456078:0:65788:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304073.456517:0:65788:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304073.456638:0:65788:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304073.456658:0:65788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.456676:0:65788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231294edb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294ed4 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.456684:0:65788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.456726:0:65788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231294edb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294ed4 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.456742:0:65788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231294edb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294ed4 expref: 18 pid: 5847 timeout: 1673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304073.456757:0:65788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65788:1876219785515520:0@lo:104: 00000100:00100000:1.0:1789304073.456826:0:65788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304073.457056:0:65788:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388c8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789304073.457260:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789304073.457274:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785515520 00000100:00100000:0.0:1789304073.457281:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785515520 00000100:00100000:0.0:1789304073.457334:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789304073.457343:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c149a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:65788:x1876219785515520:12345-0@lo:104: 00010000:00010000:0.0:1789304073.457356:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457420:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304073.457426:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c149a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:65788:x1876219785515520:12345-0@lo:104: Request processed in 84us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304073.457432:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00010000:00010000:0.0:1789304073.457472:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304073.457478:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457484:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304073.457488:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457501:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304073.457507:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304073.457513:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304073.457543:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457549:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304073.457580:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457587:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294ed4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294edb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457601:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304073.457603:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304073.457604:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304073.457624:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785515648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304073.457654:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304073.457694:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785515648 00000100:00100000:0.0:1789304073.457698:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785515648 00010000:00010000:0.0:1789304073.457715:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231294edb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294ed4 expref: 19 pid: 5847 timeout: 1673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304073.457735:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789304073.457741:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785515648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304073.457752:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304073.457757:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231294edb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294ed4 expref: 19 pid: 5847 timeout: 1673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457768:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231294edb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294ed4 expref: 19 pid: 5847 timeout: 1673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457782:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457790:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457803:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457810:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457817:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457823:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457828:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304073.457833:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457841:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457855:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304073.457864:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304073.457893:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785515648:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304073.457899:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789304073.457933:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785515648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304073.458000:0:65788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231294edb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294ed4 expref: 18 pid: 5847 timeout: 1673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304073.458011:0:65788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65788:1876219785515520:0@lo:104: 00010000:00010000:1.0:1789304073.458024:0:65788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.458033:0:65788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.458038:0:65788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.458058:0:65788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294ee2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304073.556940:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304074.531340:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785515904 00000100:00100000:0.0:1789304074.531359:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785515904 00000100:00100000:0.0:1789304074.531437:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785516288 00000100:00100000:0.0:1789304074.531440:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785516288 00000100:00100000:0.0:1789304074.531474:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1789304074.531483:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785515904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304074.531625:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785515904:12345-0@lo:400:kworker.0 Request processed in 143us (5465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304074.531635:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1789304074.531656:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1789304074.531663:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785516288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304074.531692:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785516288:12345-0@lo:400:kworker.0 Request processed in 30us (5446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304074.531698:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1789304074.531725:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785516032:0@lo:400:kworker.0 00000100:00100000:0.0:1789304074.531770:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304074.531801:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304074.531808:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785516160:0@lo:400:kworker.0 00000100:00100000:0.0:1789304074.531830:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304074.531858:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785516160 00000100:00100000:0.0:1789304074.531862:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785516160 00000100:00100000:0.0:1789304074.531888:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1789304074.531894:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785516160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304074.531928:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785516160:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304074.531933:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1789304074.531951:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785516032 00000100:00100000:0.0:1789304074.531955:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785516032 00000100:00100000:0.0:1789304074.531981:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1789304074.531988:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785516032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304074.532014:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785516032:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304074.532020:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1789304074.532058:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785516160:0@lo:400:kworker.0 00000100:00100000:0.0:1789304074.532068:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785516032:0@lo:400:kworker.0 00000100:00080000:0.0:1789304074.532116:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304074.532121:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304074.532145:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785516288:0@lo:400:kworker.0 00000100:00100000:0.0:1789304074.532158:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785515904:0@lo:400:kworker.0 00010000:00010000:1.0:1789304074.579711:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304074.834195:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304074.834203:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304074.834208:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304074.834255:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304074.834272:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304074.834283:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304074.834308:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785516544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304074.834376:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304074.834423:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f6a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304074.834445:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785516544 00000100:00100000:0.0:1789304074.834452:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785516544 00000100:00100000:0.0:1789304074.834496:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:0.0:1789304074.834504:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785516544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304074.834517:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304074.834530:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294ef0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294ee9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304074.834563:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294ef0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294ee9 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304074.834573:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294ef0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294ee9 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304074.834581:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789304074.834633:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785516544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304074.834641:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:0.0:1789304074.834696:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785516544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304074.834710:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304074.834719:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304074.834737:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304074.834743:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304074.834751:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304075.609173:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304077.091180:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785516672 00000100:00100000:1.0:1789304077.091196:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785516672 00000100:00100000:1.0:1789304077.091277:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1789304077.091287:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785516672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304077.091327:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304077.091420:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785516672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (6975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304077.091428:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1789304077.091500:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785516672:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304077.091694:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304077.164591:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765429888 00000100:00100000:2.0:1789304077.164595:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765429888 00000100:00100000:2.0:1789304077.164624:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765430016 00000100:00100000:2.0:1789304077.164627:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765430016 00000100:00100000:2.0:1789304077.164647:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 748 00000100:00100000:2.0:1789304077.164652:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765429888:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304077.164715:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765429888:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 62us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304077.164722:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 748 00000100:00100000:2.0:1789304077.164739:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 749 00000100:00100000:2.0:1789304077.164745:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765430016:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304077.164921:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765429632 00000100:00100000:1.0:1789304077.164926:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765429632 00000100:00100000:1.0:1789304077.164954:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 923 00000100:00100000:1.0:1789304077.164961:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765429632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304077.176415:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765430016:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 11660us (11891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304077.176430:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 749 00000100:00100000:1.0:1789304077.176896:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765429632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 11932us (12587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304077.176905:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 923 00010000:00010000:1.0:1789304077.652733:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304077.659669:0:65985:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1a4df630 20000000:00000080:2.0:1789304077.659688:0:65985:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36e49000 uarg=0000000000000000 00010000:00010000:2.0:1789304077.660173:0:65985:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304077.660187:0:65985:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304077.660205:0:65985:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304077.660223:0:65985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304077.660239:0:65985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294ef0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294ee9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304077.660248:0:65985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304077.660285:0:65985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294ef0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294ee9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304077.660298:0:65985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294ef0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294ee9 expref: 18 pid: 5845 timeout: 1677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304077.660311:0:65985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65985:1876219785516800:0@lo:104: 00000100:00100000:2.0:1789304077.660371:0:65985:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304077.661063:0:65985:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0621fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789304077.661656:0:65985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65985:1876219785516800:0@lo:104: 00010000:00010000:2.0:1789304077.661674:0:65985:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.661772:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304077.661779:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.661801:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304077.661805:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.661813:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304077.661820:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304077.661826:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304077.661864:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.661871:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304077.661891:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.661897:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb7231294ee9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294ef0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.661911:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304077.661913:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304077.661914:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304077.661921:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304077.661932:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785516928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304077.661963:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304077.661997:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785516928 00000100:00100000:1.0:1789304077.662001:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785516928 00010000:00010000:1.0:1789304077.662027:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294ef0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294ee9 expref: 19 pid: 5845 timeout: 1677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304077.662048:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789304077.662070:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785516928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304077.662081:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304077.662086:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294ef0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294ee9 expref: 19 pid: 5845 timeout: 1677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662120:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294ef0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294ee9 expref: 19 pid: 5845 timeout: 1677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662133:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231294ef0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294ee9 expref: 19 pid: 5845 timeout: 1677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662145:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662153:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662166:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662173:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662180:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662185:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662196:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304077.662200:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662218:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662229:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304077.662238:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304077.662266:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785516928:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304077.662273:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789304077.662301:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785516928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304077.662584:0:65985:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304077.662592:0:65985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304077.662598:0:65985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231294ef7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304078.104689:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785517056 00000100:00100000:2.0:1789304078.104701:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785517056 00000100:00100000:2.0:1789304078.104780:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1789304078.104792:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785517056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304078.104829:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304078.111204:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785517056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6405us (7800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304078.111219:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00080000:2.0:1789304078.111259:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1789304078.866223:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304078.866230:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304078.866235:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304078.866284:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304078.866295:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304078.866306:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304078.866331:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785517184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304078.866400:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304078.866518:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0621fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789304078.867088:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785517184 00000100:00100000:0.0:1789304078.867113:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785517184 00000100:00100000:1.0:1789304078.867378:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:1.0:1789304078.867389:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785517184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304078.867405:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304078.867423:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294f05 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294efe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304078.867447:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294f05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294efe expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304078.867459:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294f05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294efe expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304078.867468:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ee00, rc 0) 00000100:00100000:1.0:1789304078.867545:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785517184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304078.867551:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1789304078.867715:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785517184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304078.867731:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304078.867739:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304078.867756:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304078.867761:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304078.867768:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304079.635701:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785517696:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.635778:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304079.635837:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789304079.635843:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785517312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.635871:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304079.635894:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785517824:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.635914:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304079.635939:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785517440:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.635960:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304079.635976:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785517952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.635996:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304079.636012:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304079.636017:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785517568:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636037:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304079.636073:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785517696 00000100:00100000:1.0:1789304079.636080:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785517696 00000100:00100000:1.0:1789304079.636167:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785517824 00000100:00100000:1.0:1789304079.636171:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785517824 00000100:00100000:1.0:1789304079.636193:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785517440 00000100:00100000:1.0:1789304079.636196:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785517440 00000100:00100000:1.0:1789304079.636211:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1789304079.636219:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785517696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636271:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785517696:12345-0@lo:400:kworker.0 Request processed in 53us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304079.636291:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1789304079.636309:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1789304079.636316:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785517824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636345:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785517824:12345-0@lo:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304079.636351:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1789304079.636361:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1789304079.636367:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785517440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636397:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785517440:12345-0@lo:400:kworker.0 Request processed in 31us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304079.636403:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1789304079.636432:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785517312 00000100:00100000:1.0:1789304079.636435:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785517312 00000100:00100000:1.0:1789304079.636459:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1789304079.636466:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785517312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636493:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785517312:12345-0@lo:400:kworker.0 Request processed in 28us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304079.636510:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1789304079.636542:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785517952 00000100:00100000:1.0:1789304079.636545:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785517952 00000100:00100000:1.0:1789304079.636569:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785517568 00000100:00100000:1.0:1789304079.636572:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785517568 00000100:00100000:1.0:1789304079.636591:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1789304079.636597:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785517952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636627:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785517952:12345-0@lo:400:kworker.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304079.636643:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1789304079.636655:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1789304079.636662:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785517568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636689:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785517568:12345-0@lo:400:kworker.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304079.636694:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00080000:1.0:1789304079.636712:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304079.636717:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304079.636759:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785517568:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636768:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785517440:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636776:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785517952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636805:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785517312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636815:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785517824:0@lo:400:kworker.0 00000100:00100000:1.0:1789304079.636822:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785517696:0@lo:400:kworker.0 00010000:00010000:1.0:1789304079.699569:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304080.722369:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304082.201272:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785518080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304082.201343:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304082.202547:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785518080 00000100:00100000:2.0:1789304082.202560:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785518080 00000100:00100000:2.0:1789304082.202622:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1789304082.202633:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785518080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304082.202669:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304082.206138:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785518080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3501us (4788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304082.206153:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1789304082.206328:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785518080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304082.280565:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765430144 00000100:00100000:0.0:1789304082.280576:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765430144 00000100:00100000:0.0:1789304082.280697:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 926 00000100:00100000:0.0:1789304082.280710:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765430144:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304082.280784:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765430144:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 77us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304082.280791:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 926 00000100:00100000:2.0:1789304082.281136:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765430528 00000100:00100000:2.0:1789304082.281142:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765430528 00000100:00100000:2.0:1789304082.281190:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765430400 00000100:00100000:2.0:1789304082.281194:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765430400 00000100:00100000:2.0:1789304082.281217:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 752 00000100:00100000:2.0:1789304082.281224:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765430528:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304082.281263:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765430528:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304082.281269:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 752 00000100:00100000:2.0:1789304082.281283:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 753 00000100:00100000:2.0:1789304082.281289:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765430400:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304082.281314:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765430400:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304082.281320:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 753 00000100:00100000:1.0:1789304082.282341:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765430272 00000100:00100000:1.0:1789304082.282352:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765430272 00000100:00100000:1.0:1789304082.282456:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1055 00000100:00100000:1.0:1789304082.282468:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765430272:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304082.282584:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765430272:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 121us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304082.282591:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1055 00010000:00010000:1.0:1789304082.773201:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304083.218559:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785518208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304083.218647:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304083.219320:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785518208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304083.219390:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304083.794595:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304084.758407:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785518336:0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.758498:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304084.758551:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785518848:0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.758582:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304084.758610:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304084.758616:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785518720:0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.758638:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304084.758666:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785518592:0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.758693:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304084.758714:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789304084.758719:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785518464:0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.758741:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304084.758758:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785518976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.758783:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304084.758814:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785518848 00000100:00100000:0.0:1789304084.758822:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785518848 00000100:00100000:0.0:1789304084.758877:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785518720 00000100:00100000:0.0:1789304084.758881:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785518720 00000100:00100000:0.0:1789304084.758904:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785518464 00000100:00100000:0.0:1789304084.758906:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785518464 00000100:00100000:0.0:1789304084.758921:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1789304084.758929:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785518848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.758985:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785518848:12345-0@lo:400:kworker.0 Request processed in 55us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304084.758992:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1789304084.759011:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1789304084.759017:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785518720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.759046:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785518720:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304084.759052:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1789304084.759062:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1789304084.759067:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785518464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.759125:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785518464:12345-0@lo:400:kworker.0 Request processed in 57us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304084.759131:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1789304084.759156:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785518592 00000100:00100000:0.0:1789304084.759159:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785518592 00000100:00100000:0.0:1789304084.759182:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785518976 00000100:00100000:0.0:1789304084.759185:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785518976 00000100:00100000:0.0:1789304084.759204:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1789304084.759209:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785518592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.759240:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785518592:12345-0@lo:400:kworker.0 Request processed in 30us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304084.759245:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1789304084.759257:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1789304084.759263:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785518976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.759286:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785518976:12345-0@lo:400:kworker.0 Request processed in 25us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304084.759290:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00080000:0.0:1789304084.759311:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304084.759315:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304084.759353:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785518464:0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.759362:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785518976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.759369:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785518592:0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.759399:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785518720:0@lo:400:kworker.0 00000100:00100000:0.0:1789304084.759408:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785518848:0@lo:400:kworker.0 00000100:00100000:1.0:1789304084.759544:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785518336 00000100:00100000:1.0:1789304084.759549:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785518336 00000100:00100000:1.0:1789304084.759587:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1789304084.759595:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785518336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304084.759632:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785518336:12345-0@lo:400:kworker.0 Request processed in 39us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304084.759638:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:0.0:1789304084.761954:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785518336:0@lo:400:kworker.0 00010000:00010000:1.0:1789304085.842320:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304086.867116:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304087.314908:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304087.314930:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785519104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304087.315001:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304087.315279:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785519104 00000100:00100000:2.0:1789304087.315288:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785519104 00000100:00100000:2.0:1789304087.315362:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:2.0:1789304087.315372:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785519104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304087.315407:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304087.315901:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785519104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 531us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304087.315910:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1789304087.315999:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785519104:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304087.316065:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304087.399466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304087.399517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304087.399807:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304087.399844:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304087.399881:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765430912 00000100:00100000:0.0:1789304087.399890:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765430912 00000100:00100000:0.0:1789304087.399949:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765431040 00000100:00100000:0.0:1789304087.399953:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765431040 00000100:00100000:0.0:1789304087.399980:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 756 00000100:00100000:0.0:1789304087.399989:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765430912:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304087.401932:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765430912:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1937us (2406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304087.401944:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 756 00000100:00100000:1.0:1789304087.403040:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765430784 00000100:00100000:1.0:1789304087.403051:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765430784 00000100:00100000:1.0:1789304087.403147:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1059 00000100:00100000:1.0:1789304087.403158:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765430784:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304087.403238:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765430784:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (3431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304087.403245:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1059 00000100:00100000:2.0:1789304088.338943:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785519232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304088.339014:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304088.339066:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785519232 00000100:00100000:1.0:1789304088.339074:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785519232 00000100:00080000:2.0:1789304088.339125:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304088.339161:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1789304088.339174:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785519232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304088.339212:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304088.339265:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785519232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304088.339273:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1789304088.339311:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785519232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304088.930860:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789304089.124302:0:66328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 18: test nodemap mapped_noadmin fileops ========================================================== 08:54:47 (1789304087) 00000100:00100000:1.0:1789304089.875643:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785519360:0@lo:400:kworker.0 00000100:00100000:1.0:1789304089.875736:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304089.875792:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785519872:0@lo:400:kworker.0 00000100:00100000:1.0:1789304089.875818:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304089.875845:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304089.875850:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785519744:0@lo:400:kworker.0 00000100:00100000:1.0:1789304089.875871:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304089.875896:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785519488:0@lo:400:kworker.0 00000100:00100000:1.0:1789304089.875917:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304089.875933:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785520000:0@lo:400:kworker.0 00000100:00100000:1.0:1789304089.875951:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304089.875967:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304089.875972:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785519616:0@lo:400:kworker.0 00000100:00100000:1.0:1789304089.875989:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304089.879333:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785519872 00000100:00100000:0.0:1789304089.879345:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785519872 00000100:00100000:0.0:1789304089.879400:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785519744 00000100:00100000:0.0:1789304089.879471:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785519744 00000100:00100000:0.0:1789304089.879493:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785519488 00000100:00100000:0.0:1789304089.879496:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785519488 00000100:00100000:0.0:1789304089.879513:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1789304089.879522:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785519872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304089.879608:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785519872:12345-0@lo:400:kworker.0 Request processed in 87us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304089.879615:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1789304089.879633:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1789304089.879639:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785519744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304089.879669:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785519744:12345-0@lo:400:kworker.0 Request processed in 31us (3797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304089.879675:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1789304089.879685:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1789304089.879691:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785519488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304089.879719:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785519488:12345-0@lo:400:kworker.0 Request processed in 29us (3801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304089.879725:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1789304089.879747:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785519360 00000100:00100000:0.0:1789304089.879751:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785519360 00000100:00100000:0.0:1789304089.879774:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1789304089.879781:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785519360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304089.879810:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785519360:12345-0@lo:400:kworker.0 Request processed in 30us (4075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304089.879816:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1789304089.879861:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785520000 00000100:00100000:0.0:1789304089.879865:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785520000 00000100:00100000:0.0:1789304089.879889:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785519616 00000100:00100000:0.0:1789304089.879892:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785519616 00000100:00100000:0.0:1789304089.879908:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1789304089.879914:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785520000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304089.879945:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785520000:12345-0@lo:400:kworker.0 Request processed in 31us (3993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304089.879950:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1789304089.879960:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1789304089.879966:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785519616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304089.879993:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785519616:12345-0@lo:400:kworker.0 Request processed in 27us (4002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304089.879998:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00080000:2.0:1789304089.887992:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304089.888004:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304089.888284:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785519616:0@lo:400:kworker.0 00000100:00100000:2.0:1789304089.888303:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785519488:0@lo:400:kworker.0 00000100:00100000:2.0:1789304089.888668:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785520000:0@lo:400:kworker.0 00000100:00100000:2.0:1789304089.888722:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785519744:0@lo:400:kworker.0 00000100:00100000:2.0:1789304089.888732:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785519360:0@lo:400:kworker.0 00000100:00100000:2.0:1789304089.888742:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785519872:0@lo:400:kworker.0 00010000:00010000:1.0:1789304089.945992:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304090.970556:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304091.528683:0:66425:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3a828790 20000000:00000080:0.0:1789304091.528701:0:66425:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c05394800 uarg=0000000000000000 10000000:01000000:0.0:1789304091.530240:0:66425:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304091.530262:0:66425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304091.530281:0:66425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294f05 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294efe expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304091.530289:0:66425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304091.530332:0:66425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294f05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294efe expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304091.530347:0:66425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294f05 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294efe expref: 18 pid: 5846 timeout: 1691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304091.530361:0:66425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66425:1876219785520128:0@lo:104: 00000100:00100000:0.0:1789304091.530666:0:66425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304091.530778:0:66425:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c056c8540 going to sleep for 11 seconds 00000100:00100000:2.0:1789304091.530986:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785520128 00000100:00100000:2.0:1789304091.530995:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785520128 00000100:00100000:2.0:1789304091.531078:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789304091.531111:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:66425:x1876219785520128:12345-0@lo:104: 00010000:00010000:2.0:1789304091.531125:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304091.531194:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304091.531201:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:66425:x1876219785520128:12345-0@lo:104: Request processed in 115us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304091.531208:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789304091.531284:0:66425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66425:1876219785520128:0@lo:104: 00010000:00010000:0.0:1789304091.531304:0:66425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531407:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304091.531414:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531421:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304091.531426:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531452:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304091.531459:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304091.531464:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304091.531504:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531511:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304091.531533:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531540:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb7231294efe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f05 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531558:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304091.531560:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304091.531562:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304091.531573:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785520256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304091.531609:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304091.531649:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785520256 00000100:00100000:1.0:1789304091.531653:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785520256 00010000:00010000:1.0:1789304091.531673:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294f05 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294efe expref: 19 pid: 5846 timeout: 1691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304091.531691:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789304091.531697:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785520256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304091.531708:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304091.531713:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294f05 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294efe expref: 19 pid: 5846 timeout: 1691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531723:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294f05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294efe expref: 19 pid: 5846 timeout: 1691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531735:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231294f05 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294efe expref: 19 pid: 5846 timeout: 1691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531747:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531756:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531768:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531775:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531782:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531788:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531793:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304091.531798:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531809:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531820:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.531829:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304091.531854:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785520256:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304091.531860:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789304091.531888:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785520256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304091.532012:0:66425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304091.532019:0:66425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304091.532025:0:66425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f0c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304091.986345:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304092.438797:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785520384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304092.438866:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304092.438943:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785520384 00000100:00100000:1.0:1789304092.438950:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785520384 00000100:00100000:1.0:1789304092.439005:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1789304092.439017:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785520384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304092.439050:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304092.439112:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785520384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304092.439119:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00080000:1.0:1789304092.439142:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304092.439177:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785520384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304092.514011:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765431168 00000100:00100000:2.0:1789304092.514023:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765431168 00000100:00100000:2.0:1789304092.514107:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 930 00000100:00100000:2.0:1789304092.514120:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765431168:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304092.514193:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765431168:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304092.514199:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 930 00010000:00010000:2.0:1789304092.518074:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304092.518196:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765431296 00000100:00100000:1.0:1789304092.518205:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765431296 00000100:00100000:1.0:1789304092.518280:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1063 00000100:00100000:1.0:1789304092.518289:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765431296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304092.518367:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765431296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304092.518374:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1063 00000020:00000080:0.0:1789304092.544898:0:66473:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4572b090 20000000:00000080:0.0:1789304092.544914:0:66473:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c013f6800 uarg=0000000000000000 10000000:01000000:0.0:1789304092.545306:0:66473:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304092.545550:0:66473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304092.545568:0:66473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304092.545578:0:66473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304092.545585:0:66473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304092.545593:0:66473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304092.545605:0:66473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304092.545611:0:66473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304092.545615:0:66473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304092.545623:0:66473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304092.545715:0:66473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304092.545725:0:66473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304092.545731:0:66473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231294f13 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.012009:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304093.266192:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304093.266200:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304093.266206:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304093.266253:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231294f1a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.266275:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231294f1a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.266286:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231294f1a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304093.266315:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785520512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304093.266400:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304093.267627:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c112d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304093.267656:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785520512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304093.267672:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231294f1a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f21 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.267682:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231294f1a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294f21 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304093.267703:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304093.267709:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231294f1a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f21 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.267717:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231294f1a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f21 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304093.460588:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785520640 00000100:00100000:1.0:1789304093.460605:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785520640 00000100:00100000:1.0:1789304093.460704:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1789304093.460715:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785520640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304093.460761:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304093.460852:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785520640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304093.460859:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:1.0:1789304093.460917:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785520640:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1789304093.632341:0:66521:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc95ae7410 20000000:00000080:0.0:1789304093.632360:0:66521:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c013f6c00 uarg=0000000000000000 10000000:01000000:0.0:1789304093.632736:0:66521:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304093.632758:0:66521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.632779:0:66521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231294f21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294f1a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.632797:0:66521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.632840:0:66521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231294f21 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294f1a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.632856:0:66521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231294f21 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294f1a expref: 18 pid: 5847 timeout: 1693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304093.632871:0:66521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66521:1876219785520768:0@lo:104: 00000100:00100000:0.0:1789304093.632939:0:66521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304093.633173:0:66521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c112d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304093.642673:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789304093.642687:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:66521:x1876219785520768:12345-0@lo:104: 00010000:00010000:0.0:1789304093.642708:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231294f1a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294f21 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.644000:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304093.644013:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:66521:x1876219785520768:12345-0@lo:104: Request processed in 1328us (11072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304093.644024:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789304093.644765:0:66521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66521:1876219785520768:0@lo:104: 00010000:00010000:2.0:1789304093.644852:0:66521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304093.645909:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785520896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304093.645974:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304093.646056:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785520896 00000100:00100000:1.0:1789304093.646064:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785520896 00010000:00010000:1.0:1789304093.646112:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231294f21 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294f1a expref: 19 pid: 5847 timeout: 1693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304093.647081:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789304093.647116:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785520896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304093.647595:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304093.647603:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231294f21 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294f1a expref: 19 pid: 5847 timeout: 1693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647619:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231294f21 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294f1a expref: 19 pid: 5847 timeout: 1693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647637:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231294f21 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294f1a expref: 19 pid: 5847 timeout: 1693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647653:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647662:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647680:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647686:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647693:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647699:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647704:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304093.647707:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647716:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647735:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304093.647750:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304093.647990:0:66521:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.647999:0:66521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304093.648005:0:66521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231294f28 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304093.650375:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785520896:12345-0@lo:103:ldlm_bl.0 Request processed in 3268us (4384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304093.650391:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789304093.653997:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785520896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304094.034832:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304094.643856:0:66571:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda3604690 20000000:00000080:2.0:1789304094.643869:0:66571:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36e48c00 uarg=0000000000000000 10000000:01000000:2.0:1789304094.644268:0:66571:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304094.644286:0:66571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304094.644298:0:66571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304094.644306:0:66571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304094.644311:0:66571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304094.644316:0:66571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304094.644320:0:66571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304094.644324:0:66571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304094.644327:0:66571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304094.644332:0:66571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304094.644341:0:66571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304094.644346:0:66571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304094.644351:0:66571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231294f2f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304094.994349:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785521152:0@lo:400:kworker.0 00000100:00100000:1.0:1789304094.994455:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304094.994508:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785521664:0@lo:400:kworker.0 00000100:00100000:1.0:1789304094.994535:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304094.994563:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304094.994570:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785521280:0@lo:400:kworker.0 00000100:00100000:1.0:1789304094.994593:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304094.994629:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785521152 00000100:00100000:1.0:1789304094.994637:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785521152 00000100:00100000:1.0:1789304094.994684:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1789304094.994693:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785521152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304094.994745:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785521152:12345-0@lo:400:kworker.0 Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304094.994751:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1789304094.994774:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785521664 00000100:00100000:1.0:1789304094.994778:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785521664 00000100:00100000:1.0:1789304094.994816:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785521280 00000100:00100000:1.0:1789304094.994820:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785521280 00000100:00100000:1.0:1789304094.994840:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1789304094.994846:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785521664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304094.994878:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785521664:12345-0@lo:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304094.994888:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1789304094.994899:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:1.0:1789304094.994905:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785521280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304094.994933:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785521280:12345-0@lo:400:kworker.0 Request processed in 28us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304094.994939:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00080000:1.0:1789304094.994962:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304094.994997:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785521280:0@lo:400:kworker.0 00000100:00100000:1.0:1789304094.995008:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785521152:0@lo:400:kworker.0 00000100:00100000:1.0:1789304094.995017:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785521664:0@lo:400:kworker.0 00000100:00100000:2.0:1789304094.995987:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785521536 00000100:00100000:2.0:1789304094.995995:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785521536 00000100:00100000:2.0:1789304094.996044:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785521408 00000100:00100000:2.0:1789304094.996048:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785521408 00000100:00100000:2.0:1789304094.996071:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1789304094.996078:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785521536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304094.996158:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785521536:12345-0@lo:400:kworker.0 Request processed in 80us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304094.996165:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1789304094.996181:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1789304094.996188:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785521408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304094.996214:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785521408:12345-0@lo:400:kworker.0 Request processed in 28us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304094.996219:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1789304094.996251:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785521408:0@lo:400:kworker.0 00000100:00100000:2.0:1789304094.996261:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785521536:0@lo:400:kworker.0 00000100:00100000:1.0:1789304094.998635:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785521024 00000100:00100000:1.0:1789304094.998654:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785521024 00000100:00100000:1.0:1789304094.998728:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1789304094.998739:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785521024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304094.998841:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785521024:12345-0@lo:400:kworker.0 Request processed in 104us (3549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304094.998849:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:2.0:1789304094.999301:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785521024:0@lo:400:kworker.0 10000000:01000000:0.0:1789304095.453156:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304095.453164:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304095.453169:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304095.453216:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304095.453229:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304095.453306:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304095.453334:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785521792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304095.453421:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304095.454039:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c112d09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304095.488246:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785521920 00000100:00100000:2.0:1789304095.488256:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785521920 00000100:00100000:2.0:1789304095.488318:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789304095.488328:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:66619:x1876219785521920:12345-0@lo:104: 00010000:00010000:2.0:1789304095.488346:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294f3d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304095.488454:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304095.488460:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:66619:x1876219785521920:12345-0@lo:104: Request processed in 134us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304095.488467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789304095.489060:0:66619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66619:1876219785521920:0@lo:104: 00010000:00010000:0.0:1789304095.489079:0:66619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.489996:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304095.490008:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294f3d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490019:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304095.490023:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294f3d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490038:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294f3d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304095.490046:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294f3d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304095.490052:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304095.490121:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f3d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490128:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304095.490159:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f3d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490167:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231294f36 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f3d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490185:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304095.490187:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304095.490189:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304095.490197:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304095.490214:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785522048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304095.490273:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304095.490319:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785522048 00000100:00100000:1.0:1789304095.490325:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785522048 00010000:00010000:1.0:1789304095.490362:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294f3d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294f36 expref: 19 pid: 5846 timeout: 1695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304095.490388:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789304095.490396:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03869c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785522048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304095.490411:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304095.490417:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294f3d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294f36 expref: 19 pid: 5846 timeout: 1695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490428:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294f3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294f36 expref: 19 pid: 5846 timeout: 1695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490440:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231294f3d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294f36 expref: 19 pid: 5846 timeout: 1695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490457:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490465:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490480:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490488:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490494:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490501:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490506:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304095.490511:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490519:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490530:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304095.490539:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304095.490572:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03869c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785522048:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304095.490579:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789304095.490643:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785522048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304095.490797:0:66619:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304095.490806:0:66619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304095.490820:0:66619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231294f44 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789304096.059294:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304096.059304:0:6723:0:(genops.c:885:class_export_put()) final put ffff9e2b01e99800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304096.059641:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b01e99800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0000 00000020:00000080:1.0:1789304096.059695:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b01e9a800 for lustre-OST0000 00000001:00100000:1.0:1789304096.060899:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304096.060906:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2b01e8f000/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:2.0:1789304096.060969:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b01e8f000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:2.0:1789304096.061043:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b01e8b800 for lustre-OST0001 00010000:00010000:1.0:1789304097.107015:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304097.234206:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304097.234282:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304097.234288:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304097.234477:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304097.234492:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304097.234504:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304097.234533:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785522176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304097.234602:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304097.234662:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f709240 going to sleep for 11 seconds 00000100:00100000:2.0:1789304097.235567:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785522176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304097.235586:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304097.235596:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304097.235678:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304097.235685:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304097.235693:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304097.555304:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785522304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304097.555383:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304097.555493:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785522304 00000100:00100000:1.0:1789304097.555502:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785522304 00000100:00100000:1.0:1789304097.555572:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1789304097.555584:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785522304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304097.555623:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304097.555670:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785522304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304097.555677:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00080000:2.0:1789304097.555728:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304097.555763:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785522304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304097.634055:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304097.634135:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304097.634365:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765431808 00000100:00100000:2.0:1789304097.634375:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765431808 00000100:00100000:2.0:1789304097.634448:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1067 00000100:00100000:2.0:1789304097.634459:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765431808:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304097.634530:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765431808:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304097.634537:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1067 00000100:00100000:2.0:1789304097.634562:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765431680 00000100:00100000:2.0:1789304097.634566:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765431680 00000100:00100000:2.0:1789304097.634594:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 935 00000100:00100000:2.0:1789304097.634601:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765431680:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304097.634628:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765431680:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304097.634634:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 935 00000100:00080000:1.0:1789304097.634764:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1789304098.288265:0:66817:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc5fb5a1e0 20000000:00000080:0.0:1789304098.288284:0:66817:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3846bc00 uarg=0000000000000000 10000000:01000000:0.0:1789304098.288530:0:66817:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304098.288554:0:66817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304098.288573:0:66817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231294f59 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294f52 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304098.288580:0:66817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304098.288620:0:66817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231294f59 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294f52 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304098.288634:0:66817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231294f59 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294f52 expref: 18 pid: 5847 timeout: 1697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304098.288650:0:66817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66817:1876219785522432:0@lo:104: 00000100:00100000:0.0:1789304098.288720:0:66817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304098.288781:0:66817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f709240 going to sleep for 11 seconds 00000100:00100000:1.0:1789304098.288894:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785522432 00000100:00100000:1.0:1789304098.288904:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785522432 00000100:00100000:1.0:1789304098.288962:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789304098.288973:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:66817:x1876219785522432:12345-0@lo:104: 00010000:00010000:1.0:1789304098.288988:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289060:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304098.289067:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:66817:x1876219785522432:12345-0@lo:104: Request processed in 97us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304098.289074:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00010000:1.0:1789304098.289116:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304098.289122:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289129:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304098.289133:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289141:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304098.289148:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304098.289154:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304098.289188:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289195:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304098.289217:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289224:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231294f52 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f59 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289240:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304098.289241:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304098.289243:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304098.289618:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785522560 00000100:00100000:1.0:1789304098.289622:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785522560 00010000:00010000:1.0:1789304098.289640:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231294f59 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294f52 expref: 19 pid: 5847 timeout: 1697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304098.289670:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789304098.289677:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785522560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304098.289687:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304098.289693:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231294f59 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294f52 expref: 19 pid: 5847 timeout: 1697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289703:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231294f59 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294f52 expref: 19 pid: 5847 timeout: 1697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289715:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231294f59 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294f52 expref: 19 pid: 5847 timeout: 1697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289728:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289741:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289754:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289761:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289767:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289773:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289778:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304098.289782:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289789:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289800:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231294f60 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304098.289808:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304098.289838:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785522560:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304098.289845:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789304098.289869:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785522560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304098.578944:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785522688 00000100:00100000:0.0:1789304098.578953:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785522688 00000100:00080000:1.0:1789304098.579450:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304098.579670:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1789304098.579682:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785522688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304098.579719:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304098.580060:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785522688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 380us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304098.580068:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00010000:00010000:1.0:1789304099.155499:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304099.180351:0:66867:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe277dd2e0 20000000:00000080:1.0:1789304099.180435:0:66867:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b0208d400 uarg=0000000000000000 10000000:01000000:1.0:1789304099.181072:0:66867:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304099.181509:0:66867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304099.181527:0:66867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304099.181539:0:66867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304099.181546:0:66867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304099.181553:0:66867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304099.181560:0:66867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304099.181566:0:66867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304099.181571:0:66867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304099.181578:0:66867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304099.181590:0:66867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304099.181598:0:66867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304099.181605:0:66867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231294f67 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304099.606341:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304099.606349:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304099.606354:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304099.606411:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231294f6e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304099.606424:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231294f6e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304099.606437:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231294f6e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304099.606465:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785522816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304099.606537:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304099.606587:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0621f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789304099.606614:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785522816 00000100:00100000:0.0:1789304099.606622:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785522816 00000100:00100000:0.0:1789304099.606679:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:0.0:1789304099.606691:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785522816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304099.606707:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304099.606724:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f75 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294f6e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304099.606752:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f75 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294f6e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304099.606765:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f75 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294f6e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304099.606775:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb800, rc 0) 00000100:00100000:0.0:1789304099.606822:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785522816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304099.606829:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:0.0:1789304099.606883:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785522816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304099.606898:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231294f6e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304099.606908:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231294f6e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294f75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304099.606929:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304099.606935:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231294f6e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304099.606944:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231294f6e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f75 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304100.117490:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785522944:0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.117562:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304100.117701:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304100.117708:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785523328:0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.117732:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304100.117762:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785522944 00000100:00100000:1.0:1789304100.117771:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785522944 00000100:00100000:1.0:1789304100.117812:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785523328 00000100:00100000:1.0:1789304100.117815:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785523328 00000100:00100000:1.0:1789304100.117844:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1789304100.117853:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785522944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.117908:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785522944:12345-0@lo:400:kworker.0 Request processed in 57us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304100.117916:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1789304100.117934:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1789304100.117940:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785523328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.117965:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785523328:12345-0@lo:400:kworker.0 Request processed in 26us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304100.117970:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1789304100.117988:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785523200:0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.118012:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304100.118031:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304100.118037:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785523072:0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.118059:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304100.118198:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785523200 00000100:00100000:1.0:1789304100.118203:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785523200 00000100:00100000:1.0:1789304100.118229:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1789304100.118235:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785523200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.118269:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785523200:12345-0@lo:400:kworker.0 Request processed in 34us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304100.118275:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00080000:1.0:1789304100.118294:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304100.118323:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785523072 00000100:00100000:1.0:1789304100.118327:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785523072 00000100:00100000:1.0:1789304100.118357:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:1.0:1789304100.118365:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785523072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.118397:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785523072:12345-0@lo:400:kworker.0 Request processed in 34us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304100.118403:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00080000:1.0:1789304100.118420:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304100.118445:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41370a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785523072:0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.118456:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785523200:0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.118480:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41373100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785523328:0@lo:400:kworker.0 00000100:00100000:1.0:1789304100.118487:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785522944:0@lo:400:kworker.0 00010000:00010000:1.0:1789304101.202576:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304102.226648:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304102.528435:0:67064:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4e70bea0 20000000:00000080:2.0:1789304102.528452:0:67064:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c0623ac00 uarg=0000000000000000 00010000:00010000:2.0:1789304102.528672:0:67064:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304102.528686:0:67064:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304102.528699:0:67064:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304102.528720:0:67064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294f7c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304102.528738:0:67064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f75 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294f6e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304102.528746:0:67064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294f7c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304102.528789:0:67064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f75 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294f6e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304102.528804:0:67064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f75 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294f6e expref: 18 pid: 5846 timeout: 1702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304102.528819:0:67064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67064:1876219785523584:0@lo:104: 00000100:00100000:2.0:1789304102.528887:0:67064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304102.528945:0:67064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05a08300 going to sleep for 11 seconds 00010000:00010000:2.0:1789304102.531726:0:67064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231294f75 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294f6e expref: 18 pid: 5846 timeout: 1702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304102.531738:0:67064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67064:1876219785523584:0@lo:104: 00010000:00010000:2.0:1789304102.531755:0:67064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294f7c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304102.531764:0:67064:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294f7c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304102.531771:0:67064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294f7c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304102.531778:0:67064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294f7c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304102.676278:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785523840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304102.676360:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304102.676430:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785523840 00000100:00100000:1.0:1789304102.676439:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785523840 00000100:00100000:1.0:1789304102.676487:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1789304102.676497:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785523840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304102.676532:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304102.676576:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785523840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304102.676583:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00080000:1.0:1789304102.676603:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304102.676638:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785523840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304102.755441:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304102.755539:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765432064 00000100:00100000:0.0:1789304102.755553:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765432064 00000100:00100000:0.0:1789304102.755631:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1071 00000100:00100000:0.0:1789304102.755642:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765432064:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304102.755726:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765432064:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304102.755734:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1071 00000100:00080000:2.0:1789304102.765044:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304102.765801:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304102.765841:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765431936 00000100:00100000:2.0:1789304102.765854:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765431936 00000100:00100000:2.0:1789304102.765908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 937 00000100:00100000:2.0:1789304102.765919:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765431936:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304102.765996:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765431936:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 78us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304102.766003:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 937 00000100:00100000:0.0:1789304103.699121:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785523968 00000100:00100000:0.0:1789304103.699131:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785523968 00000100:00100000:0.0:1789304103.699196:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1789304103.699205:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785523968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304103.699239:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304103.699297:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785523968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304103.699304:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00080000:1.0:1789304103.699549:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304104.280252:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304104.339186:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304104.339192:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304104.339197:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304104.339242:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304104.339255:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304104.339276:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304104.339305:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785524096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304104.339380:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304104.339438:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789304104.345456:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785524096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304104.345490:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304104.345505:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304104.345532:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304104.345538:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304104.345546:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304105.234401:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785524608:0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.234476:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304105.234528:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789304105.234535:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785524224:0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.234557:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304105.234575:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785524736:0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.234611:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304105.234639:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785524352:0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.234662:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304105.234679:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304105.234685:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785524480:0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.234706:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304105.234737:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785524608 00000100:00100000:1.0:1789304105.234745:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785524608 00000100:00100000:1.0:1789304105.234795:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785524224 00000100:00100000:1.0:1789304105.234798:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785524224 00000100:00100000:1.0:1789304105.234818:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785524480 00000100:00100000:1.0:1789304105.234821:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785524480 00000100:00100000:1.0:1789304105.234837:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1789304105.234846:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785524608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.234899:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785524608:12345-0@lo:400:kworker.0 Request processed in 54us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304105.234906:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1789304105.234923:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1789304105.234929:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785524224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.234953:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785524224:12345-0@lo:400:kworker.0 Request processed in 24us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304105.234959:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1789304105.234970:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1789304105.234976:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785524480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.235006:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785524480:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304105.235012:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1789304105.235033:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785524736 00000100:00100000:1.0:1789304105.235036:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785524736 00000100:00100000:1.0:1789304105.235062:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785524352 00000100:00100000:1.0:1789304105.235065:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785524352 00000100:00100000:1.0:1789304105.235085:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:1.0:1789304105.235117:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785524736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.235553:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785524736:12345-0@lo:400:kworker.0 Request processed in 461us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304105.235563:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:1.0:1789304105.235577:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:1.0:1789304105.235639:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785524352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.235671:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785524352:12345-0@lo:400:kworker.0 Request processed in 89us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304105.235678:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00080000:1.0:1789304105.235705:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304105.235709:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304105.235711:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304105.235751:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785524480:0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.235763:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785524352:0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.235795:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785524224:0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.235805:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785524736:0@lo:400:kworker.0 00000100:00100000:1.0:1789304105.235813:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785524608:0@lo:400:kworker.0 00000100:00100000:0.0:1789304105.654649:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789304105.654664:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785524864 00000100:00100000:0.0:1789304105.654670:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785524864 00000100:00100000:0.0:1789304105.654721:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789304105.654732:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02013450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:67263:x1876219785524864:12345-0@lo:104: 00010000:00010000:0.0:1789304105.654745:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304105.654807:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304105.654813:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02013450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:67263:x1876219785524864:12345-0@lo:104: Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304105.654820:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00010000:1.0:1789304105.654888:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304105.654894:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.654899:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304105.654902:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.654907:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304105.654915:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304105.654919:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304105.654984:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.654991:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304105.655017:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655024:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fa00/0xefc0bb7231294f83 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294f8a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655039:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304105.655041:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304105.655042:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304105.655251:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785524992 00000100:00100000:1.0:1789304105.655273:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785524992 00010000:00010000:1.0:1789304105.655294:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231294f8a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294f83 expref: 19 pid: 5845 timeout: 1705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304105.655322:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789304105.655329:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785524992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304105.655340:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304105.655345:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231294f8a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294f83 expref: 19 pid: 5845 timeout: 1705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655355:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231294f8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294f83 expref: 19 pid: 5845 timeout: 1705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655367:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231294f8a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294f83 expref: 19 pid: 5845 timeout: 1705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655378:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231294f91 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655383:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231294f91 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655392:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231294f91 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655397:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231294f91 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655402:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231294f91 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655406:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231294f91 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655409:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304105.655412:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231294f91 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655416:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231294f91 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655464:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231294f91 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304105.655479:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304105.655551:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41371c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785524992:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304105.655557:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789304105.655603:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785524992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304106.323383:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304106.402789:0:67312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff5e7eb40 20000000:00000080:0.0:1789304106.402811:0:67312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36e4a000 uarg=0000000000000000 10000000:01000000:0.0:1789304106.402862:0:67312:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304106.402885:0:67312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304106.402902:0:67312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304106.402914:0:67312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304106.402922:0:67312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304106.402929:0:67312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304106.402937:0:67312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304106.402944:0:67312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304106.402949:0:67312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304106.402957:0:67312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304106.402970:0:67312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304106.402978:0:67312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304106.402988:0:67312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231294f98 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304107.349443:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304107.478624:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304107.478632:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304107.478636:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304107.478681:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304107.478694:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304107.478706:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304107.478729:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785525120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304107.478796:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304107.479435:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789304107.479460:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785525120 00000100:00100000:1.0:1789304107.479467:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785525120 00000100:00100000:1.0:1789304107.479521:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1789304107.479529:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785525120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304107.479555:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304107.479572:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231294fa6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294f9f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304107.479638:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231294fa6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294f9f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304107.479652:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231294fa6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294f9f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304107.479663:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e000, rc 0) 00000100:00100000:1.0:1789304107.479703:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785525120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304107.479710:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1789304107.479756:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785525120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304107.479770:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304107.479779:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304107.479808:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304107.479814:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304107.479822:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304107.794369:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785525248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304107.794440:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789304107.796856:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304107.797219:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785525248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304107.880258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304107.880437:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304107.882160:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765432320 00000100:00100000:2.0:1789304107.882173:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765432320 00000100:00100000:2.0:1789304107.882266:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1075 00000100:00100000:2.0:1789304107.882276:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765432320:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304107.882357:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765432320:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304107.882365:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1075 00000100:00100000:0.0:1789304107.882388:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765432192 00000100:00100000:0.0:1789304107.882393:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765432192 00000100:00100000:0.0:1789304107.882423:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 940 00000100:00100000:0.0:1789304107.882429:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765432192:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304107.882457:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765432192:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304107.882464:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 940 00000100:00080000:1.0:1789304107.882710:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304108.373590:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304108.818847:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785525376 00000100:00100000:1.0:1789304108.818857:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785525376 00000100:00100000:1.0:1789304108.818936:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1789304108.818946:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785525376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304108.818983:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304108.819034:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41373b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785525376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304108.819041:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00080000:0.0:1789304108.819293:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304109.396417:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304110.355141:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785525888:0@lo:400:kworker.0 00000100:00100000:1.0:1789304110.355171:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304110.355196:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789304110.355202:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785525504:0@lo:400:kworker.0 00000100:00100000:1.0:1789304110.355241:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304110.355263:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785526016:0@lo:400:kworker.0 00000100:00100000:1.0:1789304110.355297:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304110.355323:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785525504 00000100:00100000:1.0:1789304110.355332:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785525504 00000100:00100000:1.0:1789304110.355360:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:1.0:1789304110.355367:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785525504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304110.355400:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785525504:12345-0@lo:400:kworker.0 Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304110.355406:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:1.0:1789304110.355442:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785525504:0@lo:400:kworker.0 00000100:00100000:1.0:1789304110.355781:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1789304110.355788:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785525888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304110.355826:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785525888:12345-0@lo:400:kworker.0 Request processed in 39us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304110.355833:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1789304110.355861:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41370e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785525888:0@lo:400:kworker.0 00000100:00080000:0.0:1789304110.356060:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304110.356469:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41372300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785526016:0@lo:400:kworker.0 00010000:00010000:1.0:1789304111.444729:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304111.793009:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785526272 00000100:00100000:0.0:1789304111.793025:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785526272 00000100:00100000:0.0:1789304111.793170:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789304111.793181:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:67604:x1876219785526272:12345-0@lo:104: 00010000:00010000:0.0:1789304111.793209:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304111.793316:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304111.793321:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:67604:x1876219785526272:12345-0@lo:104: Request processed in 144us (4712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304111.793328:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789304111.793404:0:67604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67604:1876219785526272:0@lo:104: 00010000:00010000:1.0:1789304111.793429:0:67604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793500:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304111.793507:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793518:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304111.793522:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793530:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304111.793537:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304111.793543:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304111.793586:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793592:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304111.793613:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793619:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ee00/0xefc0bb7231294f9f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294fa6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793635:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304111.793637:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304111.793638:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304111.793650:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785526400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304111.793685:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304111.793742:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785526400 00000100:00100000:2.0:1789304111.793755:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785526400 00010000:00010000:2.0:1789304111.793776:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231294fa6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294f9f expref: 19 pid: 5846 timeout: 1711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304111.793798:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789304111.793804:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785526400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304111.793815:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304111.793820:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231294fa6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294f9f expref: 19 pid: 5846 timeout: 1711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793830:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231294fa6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294f9f expref: 19 pid: 5846 timeout: 1711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793842:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231294fa6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294f9f expref: 19 pid: 5846 timeout: 1711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793854:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793861:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793873:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793881:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793888:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793894:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793903:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304111.793907:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793914:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793926:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304111.793935:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304111.793963:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785526400:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304111.793970:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789304111.793998:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785526400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304111.794127:0:67604:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304111.794134:0:67604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304111.794141:0:67604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231294fad lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789304112.556520:0:67652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf6a40f20 20000000:00000080:2.0:1789304112.556540:0:67652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c0623a800 uarg=0000000000000000 00010000:00010000:2.0:1789304112.556810:0:67652:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304112.556826:0:67652:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304112.556841:0:67652:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304112.556860:0:67652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304112.556876:0:67652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304112.556887:0:67652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304112.556901:0:67652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304112.556908:0:67652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304112.556916:0:67652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304112.556923:0:67652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304112.556928:0:67652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304112.556937:0:67652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304112.556953:0:67652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304112.556961:0:67652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304112.556967:0:67652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231294fb4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304112.914583:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785526528 00000100:00100000:2.0:1789304112.914592:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785526528 00000100:00100000:2.0:1789304112.914657:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1789304112.914667:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785526528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304112.914701:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304112.914751:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41372680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785526528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304112.914758:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1789304112.914815:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785526528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304112.997590:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765432448 00000100:00100000:0.0:1789304112.997607:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765432448 00000100:00100000:0.0:1789304112.997674:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 942 00000100:00100000:0.0:1789304112.997684:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765432448:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304112.997762:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765432448:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304112.997769:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 942 00010000:00010000:1.0:1789304113.503579:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304113.810243:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304113.810251:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304113.810256:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304113.810306:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304113.810320:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304113.810331:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304113.810357:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785526656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304113.810430:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304113.810490:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b04091300 going to sleep for 11 seconds 00000100:00100000:0.0:1789304113.810670:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785526656 00000100:00100000:0.0:1789304113.810679:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785526656 00000100:00100000:0.0:1789304113.810731:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1789304113.810740:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785526656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304113.810752:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304113.810766:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231294fc2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231294fbb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304113.810789:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231294fc2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231294fbb expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304113.810800:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231294fc2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294fbb expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304113.810809:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304113.810863:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785526656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304113.810870:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1789304113.943682:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785526784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304113.943753:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304113.950619:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785526784 00000100:00100000:1.0:1789304113.950636:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785526784 00000100:00100000:1.0:1789304113.950722:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1789304113.950732:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785526784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304113.950772:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304113.950881:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785526784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (7127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304113.950888:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1789304113.951127:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785526784:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304114.519209:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304115.475609:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785527296:0@lo:400:kworker.0 00000100:00100000:2.0:1789304115.475710:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304115.475759:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304115.475764:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785527168:0@lo:400:kworker.0 00000100:00100000:2.0:1789304115.475783:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304115.475803:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785527296 00000100:00100000:2.0:1789304115.475809:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785527296 00000100:00100000:2.0:1789304115.475850:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1789304115.475857:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785527296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304115.475895:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785527296:12345-0@lo:400:kworker.0 Request processed in 39us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304115.475899:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1789304115.475931:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785527296:0@lo:400:kworker.0 00000100:00100000:1.0:1789304115.476044:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785527040:0@lo:400:kworker.0 00000100:00100000:1.0:1789304115.476074:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304115.476122:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785527552:0@lo:400:kworker.0 00000100:00100000:1.0:1789304115.476144:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304115.476171:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789304115.476177:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785526912:0@lo:400:kworker.0 00000100:00100000:1.0:1789304115.476207:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304115.476230:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785527424:0@lo:400:kworker.0 00000100:00100000:1.0:1789304115.476252:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304115.476276:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785526912 00000100:00100000:1.0:1789304115.476280:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785526912 00000100:00100000:1.0:1789304115.476309:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1789304115.476315:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785526912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304115.476350:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785526912:12345-0@lo:400:kworker.0 Request processed in 35us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304115.476356:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1789304115.476391:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785526912:0@lo:400:kworker.0 00000100:00100000:2.0:1789304115.653759:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765432704 00000100:00100000:2.0:1789304115.653773:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765432704 00000100:00100000:2.0:1789304115.653868:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 521 00000100:00100000:2.0:1789304115.653879:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41372300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:39882:x1876219765432704:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304115.653903:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304115.653931:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294fc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100070 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304115.654013:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294fd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304115.654181:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304115.654200:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304115.654242:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789304115.654247:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304115.654382:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304115.654414:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231294fc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100070 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304115.654434:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231294fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100070 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304115.654443:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2800) 00010000:00010000:2.0:1789304115.654445:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304115.654573:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd200, rc 0) 00000100:00100000:0.0:1789304115.659584:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304115.719487:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304115.719998:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765432960 00000100:00100000:2.0:1789304115.720010:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765432960 00000100:00100000:2.0:1789304115.720073:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 523 00000100:00100000:2.0:1789304115.720085:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765432960:12345-192.168.202.29@tcp:41:mkdir.0 00000004:00000024:2.0:1789304115.720189:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789304115.720372:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765432960:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 287us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304115.720384:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 523 00000100:00100000:2.0:1789304115.723189:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:3.0:1789304115.738027:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231294ff3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.738542:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304115.738547:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231294ff3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.738555:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231294ff3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.738571:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c2ea19000) 00010000:00010000:3.0:1789304115.738574:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304115.738580:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231294ff3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.738586:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231294ff3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304115.798631:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304115.798981:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765433344 00000100:00100000:3.0:1789304115.798995:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765433344 00000100:00100000:3.0:1789304115.799071:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 525 00000100:00100000:3.0:1789304115.799082:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:39890:x1876219765433344:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:3.0:1789304115.799143:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304115.799177:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231294ffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610007e expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.799243:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295001 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.799257:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.799272:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304115.799313:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789304115.799317:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304115.799339:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.799364:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231294ffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610007e expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.799390:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610007e expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.799400:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:3.0:1789304115.799403:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304115.799406:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e000, rc 0) 00000100:00100000:3.0:1789304115.799473:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:39890:x1876219765433344:12345-192.168.202.29@tcp:101:chown.0 Request processed in 393us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304115.799479:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 525 00000100:00100000:2.0:1789304115.803712:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304115.803937:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765433472 00000100:00100000:0.0:1789304115.803947:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765433472 00000100:00100000:0.0:1789304115.804011:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 526 00000100:00100000:0.0:1789304115.804022:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:39890:x1876219765433472:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:0.0:1789304115.804057:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304115.804080:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231295008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100085 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804196:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129500f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804225:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129500f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804239:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129500f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804257:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295016 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804264:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804272:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804375:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129501d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804386:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129501d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804392:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129501d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304115.804425:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789304115.804429:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304115.804448:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129501d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804461:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129500f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804467:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129500f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804473:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129500f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804478:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304115.804481:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129500f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804488:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129500f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804499:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:0.0:1789304115.804503:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304115.804508:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129500f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804519:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129500f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804532:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804538:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295016 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804543:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295016 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804548:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304115.804550:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295016 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804555:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295016 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804562:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789304115.804565:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304115.804567:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295016 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804573:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295016 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804602:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231295008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100085 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.804617:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129501d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100085 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.805190:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304115.805193:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304115.805196:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afae00, rc 0) 00000100:00100000:1.0:1789304115.805499:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:39890:x1876219765433472:12345-192.168.202.29@tcp:101:chown.0 Request processed in 1475us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304115.805507:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 526 00000100:00100000:1.0:1789304115.814121:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304115.814433:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765433728 00000100:00100000:3.0:1789304115.814444:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765433728 00000100:00100000:3.0:1789304115.814555:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 527 00000100:00100000:3.0:1789304115.814567:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:39890:x1876219765433728:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:3.0:1789304115.814630:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304115.814659:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129501d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100085 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.814684:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:3.0:1789304115.814695:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304115.814720:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.814732:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304115.814754:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304115.815571:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2dc5b3a reply state 0000000032a2de1d transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304115.815583:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304115.815591:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000100:00100000:3.0:1789304115.815911:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:39890:x1876219765433728:12345-192.168.202.29@tcp:36:chown.0 Request processed in 1345us (1818us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789304115.815919:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 527 00010000:00010000:0.0:1789304115.826455:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.826477:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.826486:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.826491:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304115.826496:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.826504:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.826520:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:0.0:1789304115.826523:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304115.826528:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304115.826534:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295024 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304116.563391:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304116.820834:0:67847:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc8a041f90 20000000:00000080:0.0:1789304116.820855:0:67847:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c40f39000 uarg=0000000000000000 00010000:00010000:0.0:1789304116.821411:0:67847:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789304116.821446:0:67847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:0.0:1789304116.821450:0:67847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304116.821461:0:67847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295001 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610007e expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304116.821485:0:67847:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789304116.821502:0:67847:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304116.821519:0:67847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304116.821533:0:67847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231294fc2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231294fbb expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304116.821540:0:67847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304116.821584:0:67847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231294fc2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231294fbb expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304116.821600:0:67847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231294fc2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231294fbb expref: 18 pid: 5847 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304116.821616:0:67847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67847:1876219785527680:0@lo:104: 00000100:00100000:0.0:1789304116.821676:0:67847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304116.821740:0:67847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13cf80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304116.821931:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785527680 00000100:00100000:2.0:1789304116.821940:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785527680 00000100:00100000:2.0:1789304116.822003:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789304116.823172:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:67847:x1876219785527680:12345-0@lo:104: 00010000:00010000:0.0:1789304116.823191:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294fc2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304116.823284:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304116.823291:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:67847:x1876219785527680:12345-0@lo:104: Request processed in 385us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304116.823299:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789304116.823311:0:67847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67847:1876219785527680:0@lo:104: 00010000:00010000:2.0:1789304116.823333:0:67847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304116.823387:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304116.823394:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231294fc2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304116.823401:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304116.823405:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231294fc2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304116.823413:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231294fc2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304116.823419:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231294fc2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304116.823424:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304116.823463:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294fc2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304116.823470:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304116.823498:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294fc2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304116.823505:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231294fbb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231294fc2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304116.823526:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304116.823528:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304116.823530:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304116.823609:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304116.823621:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785527808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304116.823702:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304116.826972:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785527808 00000100:00100000:3.0:1789304116.826988:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785527808 00010000:00010000:3.0:1789304116.827035:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231294fc2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294fbb expref: 19 pid: 5847 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304116.827145:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789304116.827164:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785527808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304116.827179:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304116.827186:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231294fc2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231294fbb expref: 19 pid: 5847 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827200:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231294fc2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231294fbb expref: 19 pid: 5847 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827219:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231294fc2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231294fbb expref: 19 pid: 5847 timeout: 1716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827236:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827244:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827264:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827271:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827278:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827285:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827291:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304116.827295:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827304:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827319:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304116.827329:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304116.827410:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785527808:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (3706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304116.827417:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789304116.827447:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785527808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304116.827485:0:67847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304116.827494:0:67847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304116.827500:0:67847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129502b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304117.586395:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304117.863891:0:67895:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc5cb8e7f0 20000000:00000080:1.0:1789304117.863908:0:67895:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c371f2c00 uarg=0000000000000000 00010000:00010000:1.0:1789304117.865188:0:67895:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304117.865215:0:67895:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304117.865232:0:67895:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304117.865254:0:67895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304117.865271:0:67895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304117.865284:0:67895:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304117.865291:0:67895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304117.865298:0:67895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304117.865305:0:67895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304117.865311:0:67895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304117.865316:0:67895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304117.865727:0:67895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304117.865741:0:67895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304117.865755:0:67895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304117.865760:0:67895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295032 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304118.035410:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304118.035433:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785527936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304118.035506:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304118.035572:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785527936 00000100:00100000:2.0:1789304118.035580:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785527936 00000100:00100000:2.0:1789304118.035641:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:2.0:1789304118.035652:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785527936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304118.035694:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304118.035746:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785527936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304118.035755:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00080000:2.0:1789304118.035777:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304118.035816:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785527936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304118.117663:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304118.117705:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304118.117716:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765433984 00000100:00100000:3.0:1789304118.117726:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765433856 00000100:00100000:2.0:1789304118.117727:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765433984 00000100:00100000:3.0:1789304118.117729:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765433856 00000100:00100000:2.0:1789304118.117780:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1083 00000100:00100000:2.0:1789304118.117791:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765433984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304118.117870:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41370e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765433984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304118.117878:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1083 00000100:00100000:3.0:1789304118.117879:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 945 00000100:00100000:3.0:1789304118.117886:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765433856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304118.117914:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765433856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304118.117921:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 945 00000100:00080000:2.0:1789304118.118187:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304118.615563:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304118.675370:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304118.675377:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304118.675381:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304118.675425:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304118.675438:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304118.675449:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304118.675478:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41371500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785528064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304118.675548:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304118.675603:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c07978e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789304118.675663:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785528064 00000100:00100000:1.0:1789304118.675671:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785528064 00000100:00100000:1.0:1789304118.675729:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:1.0:1789304118.675739:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785528064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304118.675752:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304118.675766:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295040 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295039 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304118.675788:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295040 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295039 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304118.675800:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295040 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295039 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304118.675809:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e000, rc 0) 00000100:00100000:1.0:1789304118.675864:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785528064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304118.675872:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:2.0:1789304118.675957:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785528064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304118.675971:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304118.675981:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304118.676001:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304118.676006:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304118.676013:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304119.060481:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785528192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304119.060596:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304119.060807:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785528192 00000100:00100000:1.0:1789304119.060816:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785528192 00000100:00100000:1.0:1789304119.060877:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1789304119.060887:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785528192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304119.060924:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304119.060973:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785528192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304119.060980:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00080000:2.0:1789304119.061302:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304119.061343:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785528192:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789304119.618532:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00010000:00010000:1.0:1789304119.636254:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304120.598542:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785528448:0@lo:400:kworker.0 00000100:00100000:0.0:1789304120.598616:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304120.598668:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785528960:0@lo:400:kworker.0 00000100:00100000:0.0:1789304120.598696:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304120.598732:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304120.598737:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785528576:0@lo:400:kworker.0 00000100:00100000:0.0:1789304120.598756:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304120.598880:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785528320:0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.598918:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304120.598955:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785528832:0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.598978:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304120.598997:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304120.599002:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785528704:0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.599021:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304120.599048:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785528448 00000100:00100000:1.0:1789304120.599055:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785528448 00000100:00100000:1.0:1789304120.599125:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785528832 00000100:00100000:1.0:1789304120.599129:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785528832 00000100:00100000:1.0:1789304120.599153:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785528704 00000100:00100000:1.0:1789304120.599168:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785528704 00000100:00100000:1.0:1789304120.599347:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1789304120.599356:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785528448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.599412:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785528448:12345-0@lo:400:kworker.0 Request processed in 57us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304120.599421:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1789304120.599436:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1789304120.599441:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785528832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.599469:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785528832:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304120.599474:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1789304120.599484:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1789304120.599490:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785528704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.599515:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785528704:12345-0@lo:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304120.599521:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00080000:1.0:1789304120.599548:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304120.599583:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785528704:0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.599593:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785528832:0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.599622:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785528448:0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.599663:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785528960 00000100:00100000:1.0:1789304120.599667:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785528960 00000100:00100000:1.0:1789304120.599695:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785528576 00000100:00100000:1.0:1789304120.599698:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785528576 00000100:00100000:1.0:1789304120.599713:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1789304120.599718:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785528960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.599765:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785528960:12345-0@lo:400:kworker.0 Request processed in 46us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304120.599770:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1789304120.599783:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:1.0:1789304120.599789:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785528576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.599813:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785528576:12345-0@lo:400:kworker.0 Request processed in 25us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304120.599818:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00080000:1.0:1789304120.599843:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304120.599858:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785528576:0@lo:400:kworker.0 00000100:00100000:1.0:1789304120.599866:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785528960:0@lo:400:kworker.0 00000100:00100000:0.0:1789304120.600965:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785528320 00000100:00100000:0.0:1789304120.600974:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785528320 00000100:00100000:0.0:1789304120.601025:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:0.0:1789304120.601035:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785528320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304120.601132:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785528320:12345-0@lo:400:kworker.0 Request processed in 99us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304120.601138:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1789304120.601844:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785528320:0@lo:400:kworker.0 00010000:00010000:2.0:1789304120.658366:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304121.475348:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304121.480352:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765434112 00000100:00100000:0.0:1789304121.480430:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765434112 00000100:00100000:0.0:1789304121.480552:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:0.0:1789304121.480564:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:5594:x1876219765434112:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789304121.480582:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304121.480585:0:5839:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231295001) 00010000:00010000:0.0:1789304121.480587:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304121.480654:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:5594:x1876219765434112:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 92us (5316us total) trans 0 rc 116/116 00000100:00100000:0.0:1789304121.480662:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00080000:1.0:1789304121.480878:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304121.686589:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304122.706374:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304123.164625:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785529088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304123.164697:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304123.164786:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785529088 00000100:00100000:3.0:1789304123.164793:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785529088 00000100:00100000:3.0:1789304123.164845:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1789304123.164854:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785529088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304123.164888:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304123.164936:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41373100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785529088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304123.164944:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:3.0:1789304123.164988:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785529088:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304123.165016:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304123.233695:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304123.233745:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304123.233807:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765434368 00000100:00100000:0.0:1789304123.233818:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765434368 00000100:00100000:0.0:1789304123.233902:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1087 00000100:00100000:0.0:1789304123.233912:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765434368:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304123.234005:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765434368:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304123.234014:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1087 00000100:00080000:2.0:1789304123.234923:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304123.235747:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765434240 00000100:00100000:3.0:1789304123.235758:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765434240 00000100:00100000:3.0:1789304123.235803:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 948 00000100:00100000:3.0:1789304123.235811:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765434240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304123.235876:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765434240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 65us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304123.235896:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 948 00000020:00000080:2.0:1789304123.691801:0:68140:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8fbfe820 20000000:00000080:2.0:1789304123.691817:0:68140:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412ea800 uarg=0000000000000000 00010000:00010000:2.0:1789304123.693562:0:68140:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304123.693584:0:68140:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304123.693599:0:68140:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304123.693619:0:68140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304123.693637:0:68140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295040 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295039 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304123.693645:0:68140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304123.693687:0:68140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295040 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295039 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304123.693704:0:68140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295040 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295039 expref: 18 pid: 5847 timeout: 1723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304123.693720:0:68140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68140:1876219785529216:0@lo:104: 00000100:00100000:2.0:1789304123.693785:0:68140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304123.693847:0:68140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c373ea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304123.694039:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785529216 00000100:00100000:3.0:1789304123.694047:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785529216 00000100:00100000:3.0:1789304123.694126:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789304123.694136:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:68140:x1876219785529216:12345-0@lo:104: 00010000:00010000:3.0:1789304123.694156:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694218:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304123.694224:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:68140:x1876219785529216:12345-0@lo:104: Request processed in 90us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304123.694230:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00010000:00010000:3.0:1789304123.694254:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304123.694260:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694267:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304123.694271:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694278:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304123.694285:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304123.694290:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304123.694319:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694325:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304123.694346:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694357:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295039 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295040 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694374:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304123.694375:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304123.694377:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304123.694395:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785529344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304123.694428:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304123.694469:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785529344 00000100:00100000:3.0:1789304123.694484:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785529344 00010000:00010000:3.0:1789304123.694504:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295040 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295039 expref: 19 pid: 5847 timeout: 1723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304123.694525:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789304123.694531:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0386b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785529344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304123.694540:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304123.694545:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295040 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295039 expref: 19 pid: 5847 timeout: 1723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694555:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295040 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295039 expref: 19 pid: 5847 timeout: 1723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694570:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694578:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694593:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694601:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694608:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694614:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694619:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304123.694623:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694631:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694639:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.694647:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304123.694675:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0386b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785529344:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304123.694681:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789304123.694748:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41370380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785529344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304123.695055:0:68140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295040 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295039 expref: 18 pid: 5847 timeout: 1723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304123.695068:0:68140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68140:1876219785529216:0@lo:104: 00010000:00010000:2.0:1789304123.695081:0:68140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304123.695117:0:68140:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304123.695123:0:68140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304123.695129:0:68140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295047 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304123.731374:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304124.180271:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785529472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304124.180354:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304124.180475:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785529472 00000100:00100000:2.0:1789304124.180484:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785529472 00000100:00100000:2.0:1789304124.180553:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1789304124.180563:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785529472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304124.180599:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304124.180649:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41370380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785529472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304124.180656:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00080000:3.0:1789304124.180708:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304124.180768:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785529472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304124.763302:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304125.528455:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304125.528464:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304125.528470:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304125.528528:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304125.528541:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304125.528553:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304125.528582:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785529600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304125.528660:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304125.528728:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304125.530019:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785529600 00000100:00100000:1.0:1789304125.530033:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785529600 00000100:00100000:1.0:1789304125.530147:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1789304125.530158:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785529600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304125.530177:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304125.530196:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295055 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129504e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304125.530222:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295055 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129504e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304125.530234:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295055 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129504e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304125.530246:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e800, rc 0) 00000100:00100000:1.0:1789304125.530310:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785529600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304125.530316:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1789304125.530668:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785529600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304125.530688:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304125.530703:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304125.530728:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304125.530734:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304125.530742:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304125.718896:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785529728:0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.718981:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304125.719049:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785530240:0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.719084:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304125.719152:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304125.719158:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785529856:0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.719180:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304125.719211:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785529984:0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.719239:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304125.719259:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304125.719266:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785530112:0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.719288:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304125.719307:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785530240 00000100:00100000:2.0:1789304125.719315:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785530240 00000100:00100000:3.0:1789304125.719334:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785529856 00000100:00100000:3.0:1789304125.719340:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785529856 00000100:00100000:2.0:1789304125.719368:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1789304125.719378:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785530240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.719382:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1789304125.719391:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785529856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.719443:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785529856:12345-0@lo:400:kworker.0 Request processed in 54us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304125.719450:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1789304125.719474:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785529728 00000100:00100000:3.0:1789304125.719477:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785529728 00000100:00100000:3.0:1789304125.719498:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785529984 00000100:00100000:3.0:1789304125.719500:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785529984 00000100:00100000:3.0:1789304125.719516:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785530112 00000100:00100000:3.0:1789304125.719519:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785530112 00000100:00100000:3.0:1789304125.719530:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1789304125.719536:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785529728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304125.719561:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785530240:12345-0@lo:400:kworker.0 Request processed in 70us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304125.719568:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:3.0:1789304125.719573:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785529728:12345-0@lo:400:kworker.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304125.719581:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1789304125.719597:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1789304125.719602:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785529984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.719640:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41370a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785529984:12345-0@lo:400:kworker.0 Request processed in 37us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304125.719646:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1789304125.719658:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1789304125.719664:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785530112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.719690:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41371500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785530112:12345-0@lo:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304125.719695:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00080000:3.0:1789304125.719715:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789304125.719720:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304125.719754:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785529856:0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.719764:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785529728:0@lo:400:kworker.0 00000100:00100000:3.0:1789304125.719775:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785530240:0@lo:400:kworker.0 00000100:00100000:2.0:1789304125.720130:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785530112:0@lo:400:kworker.0 00000100:00100000:2.0:1789304125.720139:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785529984:0@lo:400:kworker.0 00010000:00010000:3.0:1789304125.781350:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304126.805258:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304127.097700:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304127.097779:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765434496 00000100:00100000:1.0:1789304127.097788:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765434496 00000100:00100000:1.0:1789304127.097854:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 528 00000100:00100000:1.0:1789304127.097865:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:40068:x1876219765434496:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304127.097886:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304127.097908:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129505c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610008c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.097976:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295063 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.097991:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.098004:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304127.098041:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789304127.098045:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304127.098085:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789304127.098201:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304127.098614:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129505c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610008c expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.098639:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610008c expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.098647:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:1.0:1789304127.098650:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304127.098652:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8fe00, rc 0) 00000100:00100000:1.0:1789304127.098701:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:40068:x1876219765434496:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 839us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304127.098706:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 528 00000100:00100000:1.0:1789304127.101007:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304127.101133:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765434624 00000100:00100000:3.0:1789304127.101143:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765434624 00000100:00100000:3.0:1789304127.101353:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 529 00000100:00100000:3.0:1789304127.101361:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:40068:x1876219765434624:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304127.101378:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304127.101395:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129506a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100093 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101438:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295071 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101449:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101456:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101513:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101521:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101527:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101762:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129507f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101769:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129507f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101777:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129507f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304127.101802:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:3.0:1789304127.101805:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304127.101819:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129507f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101827:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101831:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295071 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101835:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101839:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304127.101842:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101847:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295071 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101853:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:3.0:1789304127.101855:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304127.101859:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101863:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101874:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101877:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295078 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101881:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101883:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304127.101885:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101888:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101891:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304127.101893:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304127.101894:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295078 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101899:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101928:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129506a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100093 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101940:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129507f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100093 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.101952:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304127.101955:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304127.101957:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e000, rc 0) 00000100:00100000:3.0:1789304127.102004:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:40068:x1876219765434624:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 645us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304127.102009:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 529 00000100:00100000:1.0:1789304127.105770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304127.105862:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765434880 00000100:00100000:2.0:1789304127.105872:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765434880 00000100:00100000:2.0:1789304127.105957:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 530 00000100:00100000:2.0:1789304127.105967:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:40068:x1876219765434880:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:2.0:1789304127.106020:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304127.106045:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129507f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100093 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304127.106070:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:2.0:1789304127.106083:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304127.106396:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304127.106411:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304127.106421:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304127.140013:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e91288ce reply state 000000009c480b87 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304127.140028:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304127.140040:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000100:00100000:1.0:1789304127.140396:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:40068:x1876219765434880:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 34427us (34630us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789304127.140404:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 530 00000001:00080000:1.0:1789304127.140439:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00010000:00010000:1.0:1789304127.140453:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.140459:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.140465:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.140471:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304127.140474:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.140479:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.140491:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c421d2300) 00010000:00010000:1.0:1789304127.140493:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304127.140497:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.140500:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295086 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.826835:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304127.962834:0:68336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff34320f90 20000000:00000080:3.0:1789304127.962853:0:68336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c413e2000 uarg=0000000000000000 00010000:00010000:3.0:1789304127.964511:0:68336:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789304127.964554:0:68336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:3.0:1789304127.964558:0:68336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304127.964571:0:68336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295063 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610008c expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.964595:0:68336:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789304127.964612:0:68336:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304127.964627:0:68336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.964637:0:68336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295055 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129504e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.964644:0:68336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.964677:0:68336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295055 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129504e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.964691:0:68336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295055 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129504e expref: 18 pid: 5847 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304127.964702:0:68336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68336:1876219785530368:0@lo:104: 00000100:00100000:3.0:1789304127.964752:0:68336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304127.965370:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785530368 00000100:00100000:0.0:1789304127.965380:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785530368 00000100:00100000:3.0:1789304127.965407:0:68336:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789304127.965467:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789304127.965476:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:68336:x1876219785530368:12345-0@lo:104: 00010000:00010000:0.0:1789304127.965487:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304127.965562:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304127.965567:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:68336:x1876219785530368:12345-0@lo:104: Request processed in 94us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304127.965573:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789304127.965637:0:68336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68336:1876219785530368:0@lo:104: 00010000:00010000:3.0:1789304127.965656:0:68336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.965720:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304127.965729:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.965736:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304127.965741:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.965749:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304127.965756:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304127.965766:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304127.965812:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.965820:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304127.965857:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.965865:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb723129504e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295055 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.965883:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304127.965885:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304127.965886:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304127.965901:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785530496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304127.965940:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304127.965981:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785530496 00000100:00100000:1.0:1789304127.965986:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785530496 00010000:00010000:1.0:1789304127.966007:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295055 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129504e expref: 19 pid: 5847 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304127.966024:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789304127.966032:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785530496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304127.966057:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304127.966063:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295055 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129504e expref: 19 pid: 5847 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966073:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295055 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129504e expref: 19 pid: 5847 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966086:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295055 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129504e expref: 19 pid: 5847 timeout: 1727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966126:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966132:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966149:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966154:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966159:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966163:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966168:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304127.966172:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966180:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966190:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304127.966202:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304127.966231:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3709ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785530496:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304127.966236:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789304127.966259:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785530496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304127.966548:0:68336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.966554:0:68336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304127.966558:0:68336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129508d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304128.274209:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785530624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304128.274278:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304128.274349:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785530624 00000100:00100000:3.0:1789304128.274356:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785530624 00000100:00100000:3.0:1789304128.274403:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1789304128.274410:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c4112b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785530624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304128.274443:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304128.274493:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c4112b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785530624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304128.274499:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00080000:3.0:1789304128.274681:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304128.274717:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785530624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304128.361545:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304128.361586:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304128.361669:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765435136 00000100:00100000:3.0:1789304128.361679:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765435136 00000100:00100000:3.0:1789304128.361728:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1091 00000100:00100000:3.0:1789304128.361738:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765435136:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304128.361810:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765435136:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 74us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304128.361818:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1091 00000100:00100000:3.0:1789304128.361842:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765435008 00000100:00100000:3.0:1789304128.361846:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765435008 00000100:00100000:3.0:1789304128.361871:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 950 00000100:00100000:3.0:1789304128.361877:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765435008:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304128.361900:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765435008:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304128.361907:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 950 00010000:00010000:3.0:1789304128.850345:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304129.299007:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785530752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304129.299149:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304129.299563:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785530752 00000100:00100000:0.0:1789304129.299572:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785530752 00000100:00100000:0.0:1789304129.299643:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1789304129.299653:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785530752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304129.299688:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304129.299857:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304129.306003:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785530752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6342us (6853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304129.306030:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:3.0:1789304129.310540:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785530752:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1789304129.618194:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304129.618203:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304129.618209:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304129.618258:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304129.618271:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304129.618283:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304129.618308:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785530880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304129.618372:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304129.618448:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c083f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789304129.618514:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785530880 00000100:00100000:0.0:1789304129.618522:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785530880 00000100:00100000:0.0:1789304129.618573:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1789304129.618583:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785530880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304129.618596:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304129.618610:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbe00/0xefc0bb723129509b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295094 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304129.618632:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbe00/0xefc0bb723129509b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295094 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304129.618644:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb723129509b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295094 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304129.618652:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789304129.618697:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785530880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304129.618704:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1789304129.618748:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785530880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304129.618762:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304129.618772:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304129.618790:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304129.618796:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304129.618804:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304129.875796:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304130.835069:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785531264:0@lo:400:kworker.0 00000100:00100000:3.0:1789304130.835084:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785531136:0@lo:400:kworker.0 00000100:00100000:1.0:1789304130.835184:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785531008:0@lo:400:kworker.0 00000100:00100000:3.0:1789304130.835306:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304130.835370:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785531648:0@lo:400:kworker.0 00000100:00100000:3.0:1789304130.835396:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304130.835436:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785531648 00000100:00100000:3.0:1789304130.835443:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785531648 00000100:00100000:3.0:1789304130.835499:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1789304130.836160:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785531648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304130.836221:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785531648:12345-0@lo:400:kworker.0 Request processed in 715us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304130.836229:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1789304130.836274:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785531648:0@lo:400:kworker.0 00000100:00100000:0.0:1789304130.837263:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785531136 00000100:00100000:0.0:1789304130.837281:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785531136 00000100:00100000:0.0:1789304130.837335:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1789304130.837344:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785531136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304130.837405:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785531136:12345-0@lo:400:kworker.0 Request processed in 62us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304130.837412:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1789304130.837449:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785531136:0@lo:400:kworker.0 00000100:00100000:1.0:1789304130.839444:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304130.839512:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785531520:0@lo:400:kworker.0 00000100:00100000:1.0:1789304130.839562:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789304130.839605:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304130.840059:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785531520 00000100:00100000:0.0:1789304130.840068:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785531520 00000100:00080000:1.0:1789304130.840127:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304130.840149:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1789304130.840158:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3709a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785531520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304130.840212:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3709a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785531520:12345-0@lo:400:kworker.0 Request processed in 55us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304130.840220:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1789304130.840252:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785531520:0@lo:400:kworker.0 00000100:00100000:3.0:1789304130.840603:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785531008 00000100:00100000:3.0:1789304130.840609:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785531008 00000100:00100000:3.0:1789304130.840646:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:3.0:1789304130.840653:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785531008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304130.840703:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785531008:12345-0@lo:400:kworker.0 Request processed in 50us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304130.840709:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1789304130.840808:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785531008:0@lo:400:kworker.0 00000100:00100000:2.0:1789304130.841385:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304130.841423:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304130.841431:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785531392:0@lo:400:kworker.0 00000100:00100000:2.0:1789304130.841457:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304130.841597:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785531392 00000100:00100000:3.0:1789304130.841604:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785531392 00000100:00100000:3.0:1789304130.841640:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:3.0:1789304130.841648:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785531392:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789304130.841659:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304130.841714:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785531392:12345-0@lo:400:kworker.0 Request processed in 66us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304130.841720:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1789304130.841802:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785531392:0@lo:400:kworker.0 00000100:00100000:1.0:1789304130.842128:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785531264 00000100:00100000:1.0:1789304130.842132:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785531264 00000100:00100000:1.0:1789304130.842172:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1789304130.842179:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785531264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304130.842226:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785531264:12345-0@lo:400:kworker.0 Request processed in 48us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304130.842233:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:0.0:1789304130.842282:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785531264:0@lo:400:kworker.0 00010000:00010000:3.0:1789304130.898847:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304131.209987:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304131.210203:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765435264 00000100:00100000:3.0:1789304131.210213:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765435264 00000100:00100000:3.0:1789304131.210278:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 531 00000100:00100000:3.0:1789304131.210286:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:40145:x1876219765435264:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304131.210304:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304131.210324:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610009a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210383:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312950a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210396:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312950a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210409:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312950a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210420:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312950b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210427:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312950b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210434:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312950b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210727:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312950b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210736:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312950b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210744:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312950b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304131.210763:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:3.0:1789304131.210767:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304131.210783:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312950b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210806:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312950a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210813:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312950a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210820:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312950a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210830:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304131.210834:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312950a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210841:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312950a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210852:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304131.210855:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304131.210860:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312950a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210866:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312950a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210878:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312950b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210883:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312950b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210889:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312950b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210895:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304131.210898:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312950b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210903:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312950b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210914:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304131.210917:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304131.210919:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312950b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210924:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312950b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210953:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610009a expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210968:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312950b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610009a expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.210975:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:3.0:1789304131.210977:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304131.210979:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e200, rc 0) 00000100:00100000:3.0:1789304131.211049:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40145:x1876219765435264:12345-192.168.202.29@tcp:101:touch.0 Request processed in 763us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304131.211055:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 531 00000100:00080000:1.0:1789304131.211347:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304131.216128:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304131.216212:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765435520 00000100:00100000:1.0:1789304131.216224:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765435520 00000100:00100000:1.0:1789304131.216284:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 532 00000100:00100000:1.0:1789304131.216295:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:40145:x1876219765435520:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304131.216316:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304131.216340:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312950be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000a1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.216620:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312950c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.216636:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312950c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.216646:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312950c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.216660:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.216667:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.216673:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789304131.217389:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11:0x0], index 0: 0 00010000:00010000:1.0:1789304131.217654:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312950d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217665:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312950d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217674:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312950d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217711:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312950c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217717:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312950c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217723:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312950c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217727:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304131.217732:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312950c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217740:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312950c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217751:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:1.0:1789304131.217754:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304131.217758:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312950c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217764:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb72312950c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304131.217778:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024d21b25 reply state 0000000066814719 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304131.217786:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789304131.217815:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312950be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000a1 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217831:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312950d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000a1 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.217838:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:1.0:1789304131.217840:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304131.217842:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e800, rc 0) 00000100:00100000:1.0:1789304131.217912:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:40145:x1876219765435520:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1619us (1794us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789304131.217920:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 532 00010000:00010000:3.0:1789304131.221768:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.221797:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.221805:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.221813:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304131.221818:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.221826:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.221843:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c14add900) 00010000:00010000:3.0:1789304131.221847:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304131.221851:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.221858:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312950cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304131.222146:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304131.227474:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765435776 00000100:00100000:3.0:1789304131.227490:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765435776 00000100:00100000:3.0:1789304131.227572:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 533 00000100:00100000:3.0:1789304131.227582:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:40145:x1876219765435776:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:3.0:1789304131.227646:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304131.227672:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312950d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000a1 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.227689:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:3.0:1789304131.227700:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304131.227743:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.227757:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.227768:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304131.227909:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fa76ee2 reply state 000000001ca191b2 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304131.227919:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304131.228025:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:40145:x1876219765435776:12345-192.168.202.29@tcp:36:touch.0 Request processed in 433us (5872us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789304131.228032:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 533 00000100:00100000:0.0:1789304131.231057:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304131.231152:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765435904 00000100:00100000:1.0:1789304131.231161:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765435904 00000100:00100000:1.0:1789304131.231220:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 534 00000100:00100000:1.0:1789304131.231230:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:40145:x1876219765435904:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304131.231254:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304131.231274:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312950e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000a8 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.231333:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312950e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000a8 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.231349:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312950e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000a8 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.231367:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:1.0:1789304131.231371:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789304131.231375:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ea00, rc 0) 00000100:00100000:1.0:1789304131.231420:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:40145:x1876219765435904:12345-192.168.202.29@tcp:101:touch.0 Request processed in 192us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304131.231428:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 534 00010000:00010000:3.0:1789304131.232210:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.232224:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.232230:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.232237:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304131.232241:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.232249:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.232262:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304131.232265:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304131.232269:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.232281:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304131.233845:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304131.233958:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765436032 00000100:00100000:3.0:1789304131.233967:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765436032 00000100:00100000:3.0:1789304131.234024:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 277 00000100:00100000:3.0:1789304131.234032:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876219765436032:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:3.0:1789304131.234064:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1580 last 0 00000020:00000080:3.0:1789304131.234226:0:6691:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb72312950ef 00002000:00100000:3.0:1789304131.234271:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b02d15800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789304131.234297:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789304131.234591:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789304131.234668:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2b02d15000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789304131.235133:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765436032:12345-192.168.202.29@tcp:8:touch.0 Request processed in 1098us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304131.235141:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 277 00000100:00100000:1.0:1789304131.243058:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304131.243171:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765436160 00000100:00100000:3.0:1789304131.243181:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765436160 00000100:00100000:3.0:1789304131.243236:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 278 00000100:00100000:3.0:1789304131.243245:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765436160:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:1.0:1789304131.243905:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304131.332562:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:0:x1876219765436160:12345-192.168.202.29@tcp:2:touch.0 Request processed in 89307us (89504us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789304131.332575:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 278 00000001:00080000:1.0:1789304131.337703:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000001:00100000:1.0:1789304131.337717:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:1.0:1789304131.347233:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304131.353751:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765436416 00000100:00100000:3.0:1789304131.353766:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765436416 00000100:00100000:3.0:1789304131.353834:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:3.0:1789304131.353845:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:40145:x1876219765436416:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:3.0:1789304131.354224:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:40145:x1876219765436416:12345-192.168.202.29@tcp:35:touch.0 Request processed in 379us (7438us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789304131.354232:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:1.0:1789304131.439579:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304131.440196:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765436544 00000100:00100000:3.0:1789304131.440208:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765436544 00000100:00100000:3.0:1789304131.440265:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 535 00000100:00100000:3.0:1789304131.440275:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:40149:x1876219765436544:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304131.440300:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304131.440319:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000af expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440383:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440397:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440409:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440423:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295104 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440429:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440435:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440521:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129510b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440535:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129510b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440541:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129510b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304131.440586:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 0 00000004:00200000:3.0:1789304131.440591:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304131.440611:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129510b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440622:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129510b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440631:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440637:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440643:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440648:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304131.440652:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440659:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440671:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:3.0:1789304131.440674:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304131.440678:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440683:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312950fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440696:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440701:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295104 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440707:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295104 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440712:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304131.440714:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295104 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440719:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295104 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440726:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304131.440727:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304131.440730:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295104 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440735:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295104 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440761:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312950f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000af expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440776:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129510b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000af expref: 11 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.440782:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304131.440784:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304131.440786:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fa00, rc 0) 00000100:00100000:3.0:1789304131.441434:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:40149:x1876219765436544:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1157us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304131.441443:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 535 00000100:00100000:1.0:1789304131.447605:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304131.447689:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765436672 00000100:00100000:0.0:1789304131.447700:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765436672 00000100:00100000:0.0:1789304131.447761:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 279 00000100:00100000:0.0:1789304131.447770:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765436672:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304131.447787:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304131.447807:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231295112 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000b6 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304131.447833:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x6aa69d43, atime: 0x6aa69d43, ctime: 0x6aa69d43, blocks: 0x1 00010000:00010000:0.0:1789304131.447854:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=1581s v=(0 0) 00010000:00010000:0.0:1789304131.447859:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304131.447877:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231295112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000b6 expref: 6 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304131.447897:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231295112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000b6 expref: 6 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304131.447910:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789304131.447976:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765436672:12345-192.168.202.29@tcp:101:rm.0 Request processed in 207us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304131.447983:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 279 00000100:00100000:0.0:1789304131.454600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304131.458682:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765436928 00000100:00100000:3.0:1789304131.458699:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765436928 00000100:00100000:3.0:1789304131.458772:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 536 00000100:00100000:3.0:1789304131.458783:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:40149:x1876219765436928:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:3.0:1789304131.458838:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304131.458875:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129510b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000af expref: 11 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.458908:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312950e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000a8 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.458920:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304131.458930:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304131.458953:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295119 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.458977:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295119 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.458987:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295119 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.459001:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.459007:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.459024:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.459438:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295127 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.459447:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295127 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.459455:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295127 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304131.460411:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 64 off9280 00000004:00080000:3.0:1789304131.460424:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1581138332621ns, next at 1582138329942ns, rc = 0 00010000:00010000:3.0:1789304131.460483:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460496:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460504:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460516:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460523:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460530:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460544:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304131.460567:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295127 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460574:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295127 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460581:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295127 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460586:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304131.460590:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295127 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460598:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295127 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460609:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304131.460612:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304131.460616:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295127 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460625:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295127 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460643:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295119 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460650:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295119 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460656:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295119 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460660:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304131.460663:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295119 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460668:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295119 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460676:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:3.0:1789304131.460678:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304131.460681:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295119 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.460687:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295119 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304131.460697:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022e76b83 reply state 00000000e0c8026a transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304131.460705:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304131.460802:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:40149:x1876219765436928:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2019us (6209us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789304131.460811:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 536 00010000:00010000:1.0:1789304131.461494:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304131.461505:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.461513:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304131.461516:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.461523:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.461535:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:1.0:1789304131.461538:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304131.461541:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.461547:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb723129512e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304131.461570:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304131.461572:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304131.461574:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304131.463747:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.463763:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.463771:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.463777:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304131.463781:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.463788:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.463802:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304131.463805:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304131.463810:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304131.463816:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295120 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304131.925291:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304132.486710:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000001:00080000:1.0:1789304132.486725:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1789304132.486730:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 42 committed 00000100:00100000:3.0:1789304132.487129:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304132.495040:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785531776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789304132.495192:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304132.497911:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785531776 00000100:00100000:0.0:1789304132.497932:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785531776 00000100:00100000:2.0:1789304132.498231:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789304132.498243:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785531776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789304132.498275:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:17 count 1 00010000:00010000:2.0:1789304132.498301:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304132.498323:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231295112 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000b6 expref: 5 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304132.498333:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789304132.498337:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304132.498341:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304132.498376:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231295112 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000b6 expref: 5 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304132.498396:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231295112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000b6 expref: 5 pid: 17212 timeout: 1682 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304132.498410:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785531904:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789304132.498500:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752780 going to sleep for 11 seconds 00000100:00080000:1.0:1789304132.498645:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304132.504909:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304132.504957:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765437056 00000100:00100000:1.0:1789304132.504967:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765437056 00010000:00010000:1.0:1789304132.505017:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231295112 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000b6 expref: 6 pid: 17212 timeout: 1682 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304132.505061:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 313 00000100:00100000:1.0:1789304132.505072:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765437056:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304132.505085:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304132.505113:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231295112 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000b6 expref: 6 pid: 17212 timeout: 1682 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304132.505128:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231295112 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000b6 expref: 6 pid: 17212 timeout: 1682 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304132.505158:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304132.505163:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304132.505169:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304132.505185:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304132.505206:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304132.505255:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765437056:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 185us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304132.505263:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 313 00010000:00010000:3.0:1789304132.505481:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231295112 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000b6 expref: 5 pid: 17212 timeout: 1682 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304132.505498:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785531904:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304132.505518:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304132.505528:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304132.505535:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304132.505545:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304132.505553:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304132.505577:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789304132.506194:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785531776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7952us (11001us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789304132.506202:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000004:00080000:3.0:1789304132.506242:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c38477100/2, rc 0, transno 4294967330 00000100:00100000:3.0:1789304132.506249:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785531776:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789304132.506432:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304132.506439:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304132.506448:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304132.506453:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304132.506474:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304132.506492:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304132.506499:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231295135 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304132.506520:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304132.506523:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304132.506525:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304132.948378:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304133.395402:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304133.395426:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785532032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304133.395492:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304133.395641:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785532032 00000100:00100000:2.0:1789304133.395650:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785532032 00000100:00100000:2.0:1789304133.395716:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1789304133.395725:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785532032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304133.395759:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304133.395805:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785532032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304133.395812:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00080000:1.0:1789304133.395912:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304133.395949:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785532032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304133.480977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304133.481027:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304133.481059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304133.481107:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765437312 00000100:00100000:1.0:1789304133.481116:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765437312 00000100:00100000:1.0:1789304133.481177:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1095 00000100:00100000:1.0:1789304133.481188:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765437312:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304133.481264:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765437312:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304133.481272:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1095 00000100:00100000:1.0:1789304133.481297:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765437184 00000100:00100000:1.0:1789304133.481301:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765437184 00000100:00100000:1.0:1789304133.481324:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 953 00000100:00100000:1.0:1789304133.481330:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765437184:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304133.481354:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765437184:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304133.481361:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 953 00000100:00100000:1.0:1789304133.481387:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765437440 00000100:00100000:1.0:1789304133.481391:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765437440 00000100:00100000:1.0:1789304133.481416:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 776 00000100:00100000:1.0:1789304133.481422:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765437440:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304133.481444:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765437440:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304133.481450:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 776 00000100:00080000:1.0:1789304133.481463:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304133.481467:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1789304133.537358:0:68581:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7b36d600 20000000:00000080:2.0:1789304133.537374:0:68581:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412ea000 uarg=0000000000000000 00010000:00010000:2.0:1789304133.537719:0:68581:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789304133.537748:0:68581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:2.0:1789304133.537751:0:68581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304133.537772:0:68581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312950b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610009a expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304133.537790:0:68581:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789304133.537801:0:68581:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304133.537812:0:68581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304133.537826:0:68581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afbe00/0xefc0bb723129509b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295094 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304133.537832:0:68581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304133.537862:0:68581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afbe00/0xefc0bb723129509b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295094 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304133.537887:0:68581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb723129509b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295094 expref: 18 pid: 5846 timeout: 1733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304133.537901:0:68581:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68581:1876219785532160:0@lo:104: 00000100:00100000:2.0:1789304133.537964:0:68581:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304133.538026:0:68581:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789304133.538085:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785532160 00000100:00100000:1.0:1789304133.539281:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785532160 00000100:00100000:1.0:1789304133.539338:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789304133.539345:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:68581:x1876219785532160:12345-0@lo:104: 00010000:00010000:1.0:1789304133.539356:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.539426:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304133.539432:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:68581:x1876219785532160:12345-0@lo:104: Request processed in 88us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304133.539438:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789304133.539455:0:68581:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68581:1876219785532160:0@lo:104: 00010000:00010000:1.0:1789304133.539459:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304133.539464:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.539471:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304133.539475:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304133.539477:0:68581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.539484:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304133.539495:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304133.539501:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304133.539534:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.539541:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304133.539563:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304133.539567:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785532288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304133.539570:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb7231295094 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129509b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.539586:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304133.539587:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304133.539589:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304133.539600:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304133.540805:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785532288 00000100:00100000:1.0:1789304133.540816:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785532288 00010000:00010000:1.0:1789304133.540841:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afbe00/0xefc0bb723129509b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295094 expref: 19 pid: 5846 timeout: 1733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304133.540871:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789304133.540879:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02eda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785532288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304133.540890:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304133.540895:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afbe00/0xefc0bb723129509b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295094 expref: 19 pid: 5846 timeout: 1733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.540907:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afbe00/0xefc0bb723129509b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295094 expref: 19 pid: 5846 timeout: 1733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.540921:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbe00/0xefc0bb723129509b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295094 expref: 19 pid: 5846 timeout: 1733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.540936:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.540945:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.540960:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.540967:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.540973:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.540980:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.540986:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304133.540990:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.541016:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.541034:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304133.541049:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304133.541075:0:68581:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304133.541083:0:68581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304133.541103:0:68581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb723129513c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304133.541112:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02eda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785532288:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304133.541119:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789304133.541154:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785532288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304133.970981:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304134.418408:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785532416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304134.418490:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304134.418561:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785532416 00000100:00100000:0.0:1789304134.418570:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785532416 00000100:00080000:1.0:1789304134.418607:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304134.418640:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1789304134.418650:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785532416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304134.418685:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304134.418732:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785532416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304134.418739:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1789304134.418786:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785532416:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304134.994290:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304135.188333:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304135.188342:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304135.188348:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304135.188398:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304135.188411:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304135.188424:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304135.188450:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785532544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304135.188518:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304135.188584:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c371b2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789304135.189410:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785532544 00000100:00100000:2.0:1789304135.189421:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785532544 00000100:00100000:2.0:1789304135.189480:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1789304135.189491:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785532544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304135.189506:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304135.189523:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb723129514a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295143 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304135.189549:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb723129514a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295143 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304135.189707:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb723129514a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295143 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304135.189721:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789304135.189781:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785532544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 292us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304135.189787:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:1.0:1789304135.190185:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785532544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304135.190204:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304135.190213:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304135.190242:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304135.190247:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304135.190255:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304135.958166:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785532928:0@lo:400:kworker.0 00000100:00100000:3.0:1789304135.958237:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304135.958293:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304135.958299:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785533056:0@lo:400:kworker.0 00000100:00100000:3.0:1789304135.958325:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304135.958358:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785533056 00000100:00100000:3.0:1789304135.958366:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785533056 00000100:00100000:3.0:1789304135.958436:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1789304135.958445:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785533056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304135.958498:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785533056:12345-0@lo:400:kworker.0 Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304135.958506:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1789304135.958894:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785532672:0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.958932:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304135.958957:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785533184:0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.958990:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304135.959010:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789304135.959016:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785532800:0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.959038:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304135.959057:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785533312:0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.959075:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304135.959119:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785532928 00000100:00100000:0.0:1789304135.959123:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785532928 00000100:00100000:0.0:1789304135.959148:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785533312 00000100:00100000:0.0:1789304135.959150:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785533312 00000100:00100000:0.0:1789304135.959171:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1789304135.959177:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785532928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.959209:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785532928:12345-0@lo:400:kworker.0 Request processed in 33us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304135.959215:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:0.0:1789304135.959231:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1789304135.959236:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785533312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.959267:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785533312:12345-0@lo:400:kworker.0 Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304135.959273:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:0.0:1789304135.959291:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785532672 00000100:00100000:0.0:1789304135.959295:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785532672 00000100:00100000:0.0:1789304135.959317:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1789304135.959322:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785532672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.959349:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785532672:12345-0@lo:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304135.959355:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1789304135.959381:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785533184 00000100:00100000:0.0:1789304135.959384:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785533184 00000100:00100000:0.0:1789304135.959405:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785532800 00000100:00100000:0.0:1789304135.959407:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785532800 00000100:00100000:0.0:1789304135.959418:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1789304135.959423:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785533184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.959450:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785533184:12345-0@lo:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304135.959455:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1789304135.959465:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1789304135.959470:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785532800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.959492:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785532800:12345-0@lo:400:kworker.0 Request processed in 22us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304135.959497:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1789304135.959552:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785532800:0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.959563:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785533312:0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.959570:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785532672:0@lo:400:kworker.0 00000100:00100000:0.0:1789304135.959579:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785533184:0@lo:400:kworker.0 00000100:00080000:3.0:1789304135.959920:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304135.959925:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304135.959956:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785533056:0@lo:400:kworker.0 00000100:00100000:3.0:1789304135.959981:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785532928:0@lo:400:kworker.0 00010000:00010000:1.0:1789304136.019255:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304136.592251:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00000100:00100000:1.0:1789304136.720381:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304136.720663:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765437568 00000100:00100000:0.0:1789304136.720675:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765437568 00000100:00100000:0.0:1789304136.720748:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 537 00000100:00100000:0.0:1789304136.720758:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:40237:x1876219765437568:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304136.720778:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304136.720800:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231295151 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000bd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304136.720872:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304136.720886:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304136.720898:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304136.720932:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789304136.720935:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304136.720951:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304136.720988:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231295151 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000bd expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304136.721014:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000bd expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304136.721022:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:0.0:1789304136.721024:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304136.721028:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afaa00, rc 0) 00000100:00100000:0.0:1789304136.721081:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40237:x1876219765437568:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 324us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304136.721111:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 537 00000100:00080000:1.0:1789304136.721833:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304136.749727:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304136.749809:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765437824 00000100:00100000:0.0:1789304136.749821:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765437824 00000100:00100000:0.0:1789304136.749880:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 538 00000100:00100000:0.0:1789304136.749890:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:40237:x1876219765437824:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304136.749941:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304136.749980:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000bd expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304136.749997:0:5852:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312950b7) 00010000:00010000:0.0:1789304136.750000:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:0.0:1789304136.750024:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304136.750049:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304136.750062:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304136.750070:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304136.859446:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030f50ed6 reply state 0000000058c8496c transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304136.859466:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304136.859483:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000100:00100000:0.0:1789304136.859603:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:40237:x1876219765437824:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 109709us (109882us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789304136.859614:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 538 00000001:00080000:1.0:1789304136.866680:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00010000:00010000:3.0:1789304136.869243:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304136.869260:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304136.869269:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304136.869275:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304136.869279:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304136.869287:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304136.869303:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:3.0:1789304136.869305:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304136.869310:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304136.869317:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129515f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304137.042370:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304137.842600:0:68778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdab8b8240 20000000:00000080:0.0:1789304137.842620:0:68778:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c38469000 uarg=0000000000000000 00010000:00010000:0.0:1789304137.843301:0:68778:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304137.843317:0:68778:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304137.843331:0:68778:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304137.843349:0:68778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304137.843365:0:68778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb723129514a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295143 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304137.843374:0:68778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304137.843411:0:68778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb723129514a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295143 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304137.843425:0:68778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb723129514a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295143 expref: 18 pid: 5847 timeout: 1737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304137.843439:0:68778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38474a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68778:1876219785533440:0@lo:104: 00000100:00100000:0.0:1789304137.843501:0:68778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304137.843620:0:68778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789304137.845023:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785533440 00000100:00100000:1.0:1789304137.845034:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785533440 00000100:00100000:0.0:1789304137.848122:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789304137.848136:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38475c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:68778:x1876219785533440:12345-0@lo:104: 00010000:00010000:0.0:1789304137.848156:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304137.848261:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304137.848268:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38475c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:68778:x1876219785533440:12345-0@lo:104: Request processed in 136us (4767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304137.848275:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789304137.848414:0:68778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38474a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68778:1876219785533440:0@lo:104: 00010000:00010000:2.0:1789304137.848440:0:68778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304137.848560:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304137.848568:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304137.848576:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304137.848580:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304137.848589:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304137.848595:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304137.848600:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304137.848645:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304137.848651:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304137.848682:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304137.848690:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fe00/0xefc0bb7231295143 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129514a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304137.848704:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304137.848706:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304137.848707:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304137.848714:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304137.848729:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785533568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304137.848772:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304137.848948:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785533568 00000100:00100000:1.0:1789304137.848966:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785533568 00010000:00010000:1.0:1789304137.848993:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb723129514a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295143 expref: 19 pid: 5847 timeout: 1737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304137.849023:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789304137.849031:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785533568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304137.849042:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304137.849047:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb723129514a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295143 expref: 19 pid: 5847 timeout: 1737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849059:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb723129514a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295143 expref: 19 pid: 5847 timeout: 1737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849072:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb723129514a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295143 expref: 19 pid: 5847 timeout: 1737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849087:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849121:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849137:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849145:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849151:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849157:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849163:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304137.849167:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849174:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849190:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304137.849199:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304137.849228:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785533568:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304137.849234:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:2.0:1789304137.849298:0:68778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304137.849306:0:68778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304137.849312:0:68778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231295166 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304137.850324:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785533568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304138.091263:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304138.514604:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785533696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304138.514679:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304138.514807:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785533696 00000100:00100000:0.0:1789304138.514815:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785533696 00000100:00100000:0.0:1789304138.514868:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1789304138.514875:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785533696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304138.514906:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304138.514960:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785533696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304138.514968:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1789304138.515154:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785533696:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304138.515408:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304138.595284:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304138.595333:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304138.595368:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304138.595404:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765437952 00000100:00100000:3.0:1789304138.595416:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765437952 00000100:00100000:3.0:1789304138.595468:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 956 00000100:00100000:3.0:1789304138.595481:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765437952:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304138.595564:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765437952:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304138.595573:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 956 00000100:00100000:0.0:1789304138.595802:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765438080 00000100:00100000:0.0:1789304138.595808:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765438080 00000100:00100000:0.0:1789304138.595860:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1099 00000100:00100000:0.0:1789304138.595868:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765438080:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304138.595911:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765438080:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 44us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304138.595923:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1099 00000100:00100000:0.0:1789304138.595957:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765438208 00000100:00100000:0.0:1789304138.595961:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765438208 00000100:00100000:0.0:1789304138.595991:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 779 00000100:00100000:0.0:1789304138.595998:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765438208:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304138.596025:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765438208:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304138.596031:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 779 00000100:00080000:3.0:1789304138.600304:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304138.600315:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304139.090351:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304139.410291:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304139.410300:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304139.410306:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304139.410354:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304139.410366:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304139.410379:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304139.410410:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785533824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304139.410479:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304139.410678:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789304139.411227:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785533824 00000100:00100000:3.0:1789304139.411238:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785533824 00000100:00100000:3.0:1789304139.411290:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:3.0:1789304139.411300:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785533824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304139.411317:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304139.411334:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295174 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129516d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304139.411362:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295174 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129516d expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304139.411374:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295174 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129516d expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304139.411384:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304139.411442:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785533824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304139.411450:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1789304139.411470:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785533824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304139.411490:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304139.411501:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304139.411593:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304139.411600:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304139.411607:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304139.543603:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785533952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304139.543677:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304139.543767:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785533952 00000100:00100000:2.0:1789304139.543775:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785533952 00000100:00100000:2.0:1789304139.543842:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:2.0:1789304139.543853:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785533952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304139.543889:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304139.543960:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304139.544032:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785533952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304139.544040:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1789304139.545128:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000004:00080000:3.0:1789304139.545136:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c38477100, transno 4294967330 00000100:00100000:3.0:1789304139.545158:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785533952:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304140.115805:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304140.272121:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304140.273439:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765438336 00000100:00100000:0.0:1789304140.273452:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765438336 00000100:00080000:1.0:1789304140.273494:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304140.273522:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 539 00000100:00100000:0.0:1789304140.273533:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:40314:x1876219765438336:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789304140.273555:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304140.273574:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129517b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000c4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.273651:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295182 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.273663:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.273673:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.273681:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295189 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.273689:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.273693:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274126:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231295190 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274137:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231295190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274146:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231295190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304140.274288:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789304140.274293:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304140.274315:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231295190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274327:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274334:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295182 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274340:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295182 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274345:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304140.274350:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295182 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274358:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295182 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274370:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:0.0:1789304140.274373:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304140.274378:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274383:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274394:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274401:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295189 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274407:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274412:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304140.274415:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274420:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295189 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274429:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c0558da00) 00010000:00010000:0.0:1789304140.274431:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304140.274434:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295189 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274444:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295189 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274480:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129517b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000c4 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274496:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231295190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000c4 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.274503:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:0.0:1789304140.274506:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304140.274509:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789304140.274581:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:40314:x1876219765438336:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1049us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304140.274589:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 539 00000100:00100000:0.0:1789304140.277626:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304140.277700:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765438592 00000100:00100000:1.0:1789304140.277708:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765438592 00000100:00100000:1.0:1789304140.277788:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 540 00000100:00100000:1.0:1789304140.277800:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:40314:x1876219765438592:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304140.277831:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304140.277852:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295197 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.277924:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129519e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.277945:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129519e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.277954:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129519e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.277966:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312951a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.277972:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312951a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.277977:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312951a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304140.277988:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00010000:1.0:1789304140.278005:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129519e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278012:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129519e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278117:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129519e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278124:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304140.278129:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129519e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278138:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129519e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278151:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:1.0:1789304140.278155:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304140.278160:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129519e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278166:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129519e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278184:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312951a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278191:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312951a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278197:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312951a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278202:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304140.278206:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312951a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278223:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312951a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278232:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c14add600) 00010000:00010000:1.0:1789304140.278235:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304140.278238:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312951a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278244:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312951a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278280:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295197 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000cb expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278291:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:1.0:1789304140.278293:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304140.278298:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295197 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000cb expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.278308:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8f400, rc 0) 00000100:00100000:1.0:1789304140.278518:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:40314:x1876219765438592:12345-192.168.202.29@tcp:101:touch.0 Request processed in 715us (894us total) trans 0 rc 301/301 00000100:00100000:1.0:1789304140.278527:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 540 00000100:00100000:0.0:1789304140.283293:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304140.283392:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765438720 00000100:00100000:1.0:1789304140.283400:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765438720 00000100:00100000:1.0:1789304140.283444:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 541 00000100:00100000:1.0:1789304140.283451:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40314:x1876219765438720:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304140.283467:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304140.283483:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312951ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000d2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283536:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312951b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283546:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312951b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283554:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312951b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283563:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312951ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283567:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312951ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283571:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312951ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283586:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312951b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283590:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312951b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283595:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312951b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283598:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304140.283601:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312951b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283606:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312951b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283614:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:1.0:1789304140.283616:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304140.283619:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312951b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283623:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312951b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283630:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312951ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283633:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312951ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283637:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312951ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283641:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304140.283644:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312951ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283650:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312951ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283658:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c14adda00) 00010000:00010000:1.0:1789304140.283660:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304140.283663:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312951ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283669:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312951ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283697:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312951ac lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000d2 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283705:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:1.0:1789304140.283706:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304140.283709:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312951ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000d2 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304140.283715:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e600, rc 0) 00000100:00100000:1.0:1789304140.283776:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40314:x1876219765438720:12345-192.168.202.29@tcp:101:touch.0 Request processed in 325us (491us total) trans 0 rc 301/301 00000100:00100000:1.0:1789304140.283783:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 541 00000100:00100000:3.0:1789304140.286960:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304140.287014:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765438848 00000100:00100000:0.0:1789304140.287026:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765438848 00000100:00100000:0.0:1789304140.287086:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 542 00000100:00100000:0.0:1789304140.287119:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:40314:x1876219765438848:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789304140.287145:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304140.287166:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312951c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000d9 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287243:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312951c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287260:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312951c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287273:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312951c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287284:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312951cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287288:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312951cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287293:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312951cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287310:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312951c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287314:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312951c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287318:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312951c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287322:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304140.287327:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312951c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287332:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312951c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287339:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:0.0:1789304140.287342:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304140.287346:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312951c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287350:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312951c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287356:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312951cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287359:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312951cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287363:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312951cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287366:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304140.287368:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312951cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287371:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312951cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287374:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c0558de00) 00010000:00010000:0.0:1789304140.287375:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304140.287377:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312951cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287380:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312951cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287404:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312951c1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000d9 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287412:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:0.0:1789304140.287413:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304140.287415:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312951c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000d9 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304140.287421:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:0.0:1789304140.287472:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:40314:x1876219765438848:12345-192.168.202.29@tcp:101:touch.0 Request processed in 357us (526us total) trans 0 rc 301/301 00000100:00100000:0.0:1789304140.287480:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 542 00000100:00100000:2.0:1789304141.077691:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785534208:0@lo:400:kworker.0 00000100:00100000:2.0:1789304141.077788:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304141.077839:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785534720:0@lo:400:kworker.0 00000100:00100000:2.0:1789304141.077879:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304141.077909:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304141.077915:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785534336:0@lo:400:kworker.0 00000100:00100000:2.0:1789304141.077961:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304141.077996:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785534208 00000100:00100000:2.0:1789304141.078004:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785534208 00000100:00100000:2.0:1789304141.078053:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1789304141.078062:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785534208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304141.078136:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785534208:12345-0@lo:400:kworker.0 Request processed in 75us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304141.078143:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1789304141.078165:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785534720 00000100:00100000:2.0:1789304141.078169:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785534720 00000100:00100000:2.0:1789304141.078202:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785534336 00000100:00100000:2.0:1789304141.078205:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785534336 00000100:00100000:2.0:1789304141.078227:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1789304141.078234:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785534720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304141.078263:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785534720:12345-0@lo:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304141.078269:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1789304141.078281:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:2.0:1789304141.078287:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785534336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304141.078312:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785534336:12345-0@lo:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304141.078317:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00080000:2.0:1789304141.078336:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304141.078340:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304141.078372:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785534336:0@lo:400:kworker.0 00000100:00100000:2.0:1789304141.078382:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785534208:0@lo:400:kworker.0 00000100:00100000:2.0:1789304141.078389:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785534720:0@lo:400:kworker.0 00000100:00100000:0.0:1789304141.078779:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785534080:0@lo:400:kworker.0 00000100:00100000:0.0:1789304141.078818:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304141.078843:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785534592:0@lo:400:kworker.0 00000100:00100000:0.0:1789304141.078868:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304141.078908:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304141.078915:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785534464:0@lo:400:kworker.0 00000100:00100000:0.0:1789304141.078952:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304141.078981:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785534592 00000100:00100000:0.0:1789304141.078985:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785534592 00000100:00100000:0.0:1789304141.079018:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785534464 00000100:00100000:0.0:1789304141.079021:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785534464 00000100:00100000:0.0:1789304141.079041:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1789304141.079047:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785534592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304141.079083:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785534592:12345-0@lo:400:kworker.0 Request processed in 36us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304141.079113:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1789304141.079130:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1789304141.079137:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785534464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304141.079164:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785534464:12345-0@lo:400:kworker.0 Request processed in 28us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304141.079170:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00080000:0.0:1789304141.079192:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304141.079213:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785534464:0@lo:400:kworker.0 00000100:00100000:0.0:1789304141.079222:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785534592:0@lo:400:kworker.0 00000100:00100000:2.0:1789304141.079317:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785534080 00000100:00100000:2.0:1789304141.079321:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785534080 00000100:00100000:2.0:1789304141.079350:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:2.0:1789304141.079357:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785534080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304141.079390:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785534080:12345-0@lo:400:kworker.0 Request processed in 35us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304141.079396:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1789304141.079468:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785534080:0@lo:400:kworker.0 00010000:00010000:0.0:1789304141.139971:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304141.859514:0:69023:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc5d78440 20000000:00000080:1.0:1789304141.859532:0:69023:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e7a000 uarg=0000000000000000 00010000:00010000:1.0:1789304141.859739:0:69023:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304141.859813:0:69023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:1.0:1789304141.859816:0:69023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304141.859825:0:69023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231295190 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000c4 expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304141.859843:0:69023:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304141.859854:0:69023:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304141.859865:0:69023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304141.859874:0:69023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295174 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129516d expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304141.859879:0:69023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304141.859912:0:69023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295174 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129516d expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304141.859937:0:69023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295174 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129516d expref: 18 pid: 5847 timeout: 1741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304141.859952:0:69023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69023:1876219785534848:0@lo:104: 00000100:00100000:1.0:1789304141.860160:0:69023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304141.860212:0:69023:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789304141.860217:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789304141.860231:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785534848 00000100:00100000:2.0:1789304141.860237:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785534848 00000100:00100000:2.0:1789304141.860280:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789304141.860286:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06086050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:69023:x1876219785534848:12345-0@lo:104: 00010000:00010000:2.0:1789304141.860297:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304141.860353:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304141.860359:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06086050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:69023:x1876219785534848:12345-0@lo:104: Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304141.860365:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789304141.860370:0:69023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69023:1876219785534848:0@lo:104: 00010000:00010000:1.0:1789304141.860387:0:69023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860437:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304141.860443:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860448:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304141.860451:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860457:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304141.860461:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304141.860464:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304141.860490:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860494:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304141.860511:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860523:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb723129516d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295174 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304141.860531:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785534976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304141.860547:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304141.860549:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304141.860550:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304141.860559:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304141.860634:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785534976 00000100:00100000:3.0:1789304141.860638:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785534976 00010000:00010000:3.0:1789304141.860653:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295174 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129516d expref: 19 pid: 5847 timeout: 1741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304141.860684:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789304141.860691:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785534976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304141.860702:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304141.860707:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295174 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129516d expref: 19 pid: 5847 timeout: 1741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860718:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295174 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129516d expref: 19 pid: 5847 timeout: 1741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860730:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295174 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129516d expref: 19 pid: 5847 timeout: 1741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860742:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860749:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860762:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860769:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860776:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860782:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860788:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304141.860791:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860799:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860814:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304141.860823:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304141.860830:0:69023:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304141.860837:0:69023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304141.860843:0:69023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8fe00/0xefc0bb72312951d6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304141.860864:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785534976:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304141.860870:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789304141.860946:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785534976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304142.165566:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304143.187217:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304143.636255:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304143.636281:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785535104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304143.636351:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304143.636419:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785535104 00000100:00100000:0.0:1789304143.636427:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785535104 00000100:00100000:0.0:1789304143.636482:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1789304143.636491:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785535104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304143.636530:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304143.636574:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785535104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304143.636580:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00080000:0.0:1789304143.636603:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304143.636637:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785535104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304143.716312:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304143.716355:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304143.716383:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304143.716412:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765438976 00000100:00100000:1.0:1789304143.716421:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765438976 00000100:00100000:1.0:1789304143.716470:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 959 00000100:00100000:1.0:1789304143.716479:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765438976:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304143.716550:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765438976:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304143.716557:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 959 00000100:00100000:1.0:1789304143.716590:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765439232 00000100:00100000:1.0:1789304143.716594:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765439232 00000100:00100000:1.0:1789304143.716634:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 782 00000100:00100000:1.0:1789304143.716655:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765439232:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304143.716685:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765439232:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304143.716693:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 782 00000100:00080000:1.0:1789304143.716840:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304143.717474:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765439104 00000100:00100000:0.0:1789304143.717482:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765439104 00000100:00100000:0.0:1789304143.717551:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1103 00000100:00100000:0.0:1789304143.717559:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765439104:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304143.717605:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765439104:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 47us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304143.717612:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1103 00000100:00080000:1.0:1789304143.722546:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1789304143.763607:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304143.763615:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304143.763620:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304143.763676:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304143.763689:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304143.763700:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304143.763726:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785535232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304143.763818:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304143.763885:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f709f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789304143.765189:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785535232 00000100:00100000:3.0:1789304143.765201:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785535232 00000100:00100000:3.0:1789304143.765260:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1789304143.765272:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785535232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304143.765290:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304143.765312:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312951e4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312951dd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304143.765341:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312951e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312951dd expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304143.765353:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312951e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312951dd expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304143.765363:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304143.765435:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785535232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304143.765442:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1789304143.765565:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785535232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304143.765584:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304143.765594:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304143.765616:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304143.765621:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304143.765629:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.210269:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304144.671288:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785535360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304144.671433:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304144.671696:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785535360 00000100:00100000:1.0:1789304144.671706:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785535360 00000100:00100000:1.0:1789304144.671777:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1789304144.671789:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785535360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304144.671849:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789304144.671995:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304144.678447:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785535360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6650us (7002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304144.678463:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1789304144.679519:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785535360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304144.768948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304144.769018:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765439360 00000100:00100000:3.0:1789304144.769028:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765439360 00000100:00100000:3.0:1789304144.769086:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 543 00000100:00100000:3.0:1789304144.769123:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:40401:x1876219765439360:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304144.769144:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304144.769198:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312951eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000e0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.769282:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312951f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.769310:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312951f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.769324:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312951f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304144.769362:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:3.0:1789304144.769365:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304144.769384:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312951f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.769409:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312951eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000e0 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.769432:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312951f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000e0 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.769441:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:3.0:1789304144.769444:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304144.769448:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304144.769519:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:40401:x1876219765439360:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 398us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304144.769527:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 543 00000100:00100000:3.0:1789304144.773866:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304144.773953:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765439616 00000100:00100000:0.0:1789304144.773963:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765439616 00000100:00100000:0.0:1789304144.774024:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 544 00000100:00100000:0.0:1789304144.774035:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:40401:x1876219765439616:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304144.774087:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304144.774280:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312951f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000e0 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304144.774305:0:5852:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231295190) 00010000:00010000:0.0:1789304144.774310:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:0.0:1789304144.774322:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304144.774349:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304144.774364:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304144.774375:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304144.774733:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dac08237 reply state 00000000d246763a transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304144.774743:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304144.774753:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000100:00100000:0.0:1789304144.774843:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:40401:x1876219765439616:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 810us (986us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789304144.774851:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 544 00010000:00010000:3.0:1789304144.789007:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.789028:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.789042:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.789049:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304144.789054:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.789063:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.789078:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558da00) 00010000:00010000:3.0:1789304144.789081:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304144.789086:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304144.789108:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312951f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304145.234743:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304145.659859:0:69219:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8f4d8eb0 20000000:00000080:1.0:1789304145.659888:0:69219:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e79800 uarg=0000000000000000 00010000:00010000:1.0:1789304145.660681:0:69219:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304145.660699:0:69219:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304145.660713:0:69219:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304145.660731:0:69219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304145.660750:0:69219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312951e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312951dd expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304145.660758:0:69219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304145.660799:0:69219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312951e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312951dd expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304145.660814:0:69219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312951e4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312951dd expref: 18 pid: 5845 timeout: 1745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304145.660829:0:69219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69219:1876219785535488:0@lo:104: 00000100:00100000:1.0:1789304145.660906:0:69219:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304145.661368:0:69219:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789304145.664468:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785535488 00000100:00100000:0.0:1789304145.664484:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785535488 00000100:00100000:0.0:1789304145.664543:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789304145.664553:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:69219:x1876219785535488:12345-0@lo:104: 00010000:00010000:0.0:1789304145.664571:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304145.664783:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304145.664791:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:69219:x1876219785535488:12345-0@lo:104: Request processed in 239us (3884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304145.664799:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00010000:2.0:1789304145.664864:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304145.664872:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.664890:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304145.664894:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.664903:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304145.664910:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304145.664915:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304145.664975:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.664982:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304145.665021:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665028:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312951dd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312951e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665046:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304145.665047:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304145.665049:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304145.665056:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304145.665070:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785535616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304145.665137:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304145.665201:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785535616 00000100:00100000:2.0:1789304145.665205:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785535616 00010000:00010000:2.0:1789304145.665236:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312951e4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312951dd expref: 19 pid: 5845 timeout: 1745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304145.665260:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789304145.665268:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785535616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304145.665279:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304145.665284:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312951e4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312951dd expref: 19 pid: 5845 timeout: 1745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665294:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312951e4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312951dd expref: 19 pid: 5845 timeout: 1745 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665312:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665320:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665336:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665344:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665350:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665357:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665363:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304145.665367:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665375:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665384:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304145.665394:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304145.665424:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785535616:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304145.665430:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1789304145.665467:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785535616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304145.670748:0:69219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f200/0xefc0bb72312951e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312951dd expref: 18 pid: 5845 timeout: 1745 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304145.670771:0:69219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69219:1876219785535488:0@lo:104: 00010000:00010000:1.0:1789304145.670800:0:69219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304145.670811:0:69219:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304145.670817:0:69219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304145.670823:0:69219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295200 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304146.194623:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785536128:0@lo:400:kworker.0 00000100:00100000:2.0:1789304146.194650:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785536000:0@lo:400:kworker.0 00000100:00100000:2.0:1789304146.194705:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304146.194785:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304146.194794:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785535872:0@lo:400:kworker.0 00000100:00100000:3.0:1789304146.194801:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785536000 00000100:00100000:3.0:1789304146.194810:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785536000 00000100:00100000:2.0:1789304146.194826:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304146.194861:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785535872 00000100:00100000:2.0:1789304146.194867:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785535872 00000100:00100000:3.0:1789304146.194894:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1789304146.194908:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785536000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304146.194921:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1789304146.194931:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785535872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304146.194983:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785536000:12345-0@lo:400:kworker.0 Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304146.194992:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1789304146.195009:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785535744:0@lo:400:kworker.0 00000100:00080000:3.0:1789304146.195017:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304146.195023:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304146.195048:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304146.195079:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785536256:0@lo:400:kworker.0 00000100:00100000:0.0:1789304146.195117:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304146.195144:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785535744 00000100:00100000:3.0:1789304146.195149:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785535744 00000100:00100000:0.0:1789304146.195155:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785536256 00000100:00100000:0.0:1789304146.195160:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785536256 00000100:00100000:3.0:1789304146.195179:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1789304146.195188:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785535744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304146.195208:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1789304146.195220:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785536256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304146.195228:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785535744:12345-0@lo:400:kworker.0 Request processed in 41us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304146.195235:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00080000:3.0:1789304146.195253:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304146.195258:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785536256:12345-0@lo:400:kworker.0 Request processed in 41us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304146.195264:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1789304146.195282:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785535744:0@lo:400:kworker.0 00000100:00100000:3.0:1789304146.195293:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785536256:0@lo:400:kworker.0 00000100:00100000:2.0:1789304146.195606:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785535872:12345-0@lo:400:kworker.0 Request processed in 677us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304146.195613:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1789304146.195640:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304146.195693:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785535872:0@lo:400:kworker.0 00000100:00100000:2.0:1789304146.195704:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785536000:0@lo:400:kworker.0 00000100:00100000:0.0:1789304146.195791:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785536128 00000100:00100000:0.0:1789304146.195796:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785536128 00000100:00100000:0.0:1789304146.195840:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1789304146.195846:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785536128:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789304146.195850:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304146.195893:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785536128:12345-0@lo:400:kworker.0 Request processed in 47us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304146.195901:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1789304146.196006:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785536128:0@lo:400:kworker.0 00010000:00010000:1.0:1789304146.258301:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304146.963175:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304146.963184:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304146.963189:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304146.963246:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304146.963259:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304146.963271:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304146.963300:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785536384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304146.963383:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304146.963448:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062879c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304146.964946:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785536384 00000100:00100000:1.0:1789304146.964960:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785536384 00000100:00100000:1.0:1789304146.965033:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1789304146.965043:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785536384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304146.965059:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304146.965080:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129520e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295207 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304146.965130:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129520e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295207 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304146.965142:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129520e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295207 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304146.965152:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e000, rc 0) 00000100:00100000:1.0:1789304146.965234:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785536384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304146.965241:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1789304146.965828:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785536384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304146.965849:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304146.965859:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304146.965890:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304146.965896:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304146.965903:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789304147.247749:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00010000:00010000:0.0:1789304147.282307:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304148.306432:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304148.756593:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785536512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304148.756666:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304148.760185:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785536512 00000100:00100000:0.0:1789304148.760200:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785536512 00000100:00100000:0.0:1789304148.760314:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1789304148.760326:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785536512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304148.760366:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304148.760457:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785536512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (3791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304148.760463:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00080000:2.0:1789304148.760751:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304148.762085:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785536512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304148.837219:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304148.837256:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304148.837290:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765439872 00000100:00100000:3.0:1789304148.837302:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765439872 00000100:00100000:2.0:1789304148.837323:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765439744 00000100:00100000:2.0:1789304148.837327:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765439744 00000100:00100000:2.0:1789304148.837374:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 962 00000100:00100000:3.0:1789304148.837379:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1107 00000100:00100000:2.0:1789304148.837385:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765439744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304148.837394:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765439872:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1789304148.837513:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304148.837573:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765439744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 70us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304148.837582:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 962 00000100:00100000:3.0:1789304148.842171:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765439872:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 4768us (4900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304148.842186:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1107 00000100:00100000:1.0:1789304148.844888:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304148.845128:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765440000 00000100:00100000:0.0:1789304148.845139:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765440000 00000100:00100000:0.0:1789304148.845215:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 785 00000100:00100000:0.0:1789304148.845226:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765440000:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304148.845306:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765440000:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304148.845313:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 785 00000100:00080000:2.0:1789304148.847825:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304149.330251:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304149.516600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304149.516752:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765440128 00000100:00100000:2.0:1789304149.516764:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765440128 00000100:00100000:2.0:1789304149.516827:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 545 00000100:00100000:2.0:1789304149.516838:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765440128:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304149.516960:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765440128:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 123us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304149.516967:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 545 00000100:00100000:0.0:1789304149.533624:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304149.534051:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765440256 00000100:00100000:2.0:1789304149.534063:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765440256 00000100:00100000:2.0:1789304149.534155:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 281 00000100:00100000:2.0:1789304149.534166:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765440256:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304149.534548:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765440256:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 384us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304149.534556:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 281 00000100:00100000:1.0:1789304149.538492:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304149.538609:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765440384 00000100:00100000:0.0:1789304149.538622:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765440384 00000100:00100000:0.0:1789304149.538677:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 282 00000100:00100000:0.0:1789304149.538686:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876219765440384:12345-192.168.202.29@tcp:8:lfs.0 00010000:00080000:0.0:1789304149.538726:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1599 last 0 00000020:00000080:0.0:1789304149.538773:0:6691:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231295215 00002000:00100000:0.0:1789304149.538788:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c20276000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789304149.538800:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789304149.539461:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789304149.539500:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2c20271000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789304149.539957:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765440384:12345-192.168.202.29@tcp:8:lfs.0 Request processed in 1268us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304149.539968:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 282 00000100:00100000:3.0:1789304149.547587:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304149.549303:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765440512 00000100:00100000:2.0:1789304149.549323:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765440512 00000100:00100000:2.0:1789304149.549431:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 283 00000100:00100000:2.0:1789304149.549443:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:40486:x1876219765440512:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304149.549924:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:40486:x1876219765440512:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 481us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304149.549933:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 283 00000100:00080000:0.0:1789304149.550631:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304149.553514:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304149.553678:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765440640 00000100:00100000:3.0:1789304149.553688:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765440640 00000100:00100000:3.0:1789304149.553752:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 546 00000100:00100000:3.0:1789304149.553763:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765440640:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304149.554475:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765440640:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 711us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304149.554484:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 546 00000100:00100000:1.0:1789304149.563985:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304149.564056:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765440768 00000100:00100000:3.0:1789304149.564068:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765440768 00000100:00100000:3.0:1789304149.564489:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 547 00000100:00100000:3.0:1789304149.564502:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765440768:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304149.564612:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765440768:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 112us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304149.565831:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 547 00000100:00100000:0.0:1789304149.571393:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304149.571504:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765440896 00000100:00100000:1.0:1789304149.571515:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765440896 00000100:00100000:1.0:1789304149.571611:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 284 00000100:00100000:1.0:1789304149.571627:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765440896:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304149.572569:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765440896:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 417us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304149.572584:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 284 00000100:00100000:0.0:1789304149.574888:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304149.575012:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765441024 00000100:00100000:3.0:1789304149.575026:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765441024 00000100:00100000:3.0:1789304149.575515:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 285 00000100:00100000:3.0:1789304149.575537:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:40486:x1876219765441024:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304149.575977:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:40486:x1876219765441024:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 442us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304149.575986:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 285 00000100:00100000:3.0:1789304149.580051:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304149.586253:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765441152 00000100:00100000:0.0:1789304149.586276:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765441152 00000100:00100000:0.0:1789304149.586367:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 548 00000100:00100000:0.0:1789304149.586381:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765441152:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304149.587306:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:40486:x1876219765441152:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 925us (7264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304149.587317:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 548 00000100:00100000:0.0:1789304149.645565:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304149.645792:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765441280 00000100:00100000:2.0:1789304149.645803:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765441280 00000100:00100000:2.0:1789304149.645863:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 549 00000100:00100000:2.0:1789304149.645878:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:40490:x1876219765441280:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:2.0:1789304149.645901:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304149.645925:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb723129521c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000e7 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.646000:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295223 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.646016:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295223 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.646029:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295223 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.646288:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129522a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.646297:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129522a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.646304:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129522a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647076:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647215:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647226:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304149.647257:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:2.0:1789304149.647261:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304149.647281:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647299:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295223 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647306:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295223 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647314:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295223 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647508:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304149.647513:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295223 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647592:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295223 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647607:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304149.647781:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304149.647790:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295223 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647796:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295223 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647811:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129522a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647816:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129522a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647822:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129522a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647828:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304149.647830:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129522a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647836:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129522a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647853:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c421d2900) 00010000:00010000:2.0:1789304149.647855:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304149.647858:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129522a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647863:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129522a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647900:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb723129521c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000e7 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647918:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000e7 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.647925:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304149.647927:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304149.647930:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789304149.648073:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:40490:x1876219765441280:12345-192.168.202.29@tcp:101:dd.0 Request processed in 2200us (2516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304149.648082:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 549 00000100:00100000:1.0:1789304149.669429:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304149.669640:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765441536 00000100:00100000:2.0:1789304149.669654:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765441536 00000100:00100000:2.0:1789304149.669787:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 550 00000100:00100000:2.0:1789304149.669798:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40490:x1876219765441536:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:2.0:1789304149.669817:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304149.669839:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295238 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000ee expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.670227:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129523f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.670247:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129523f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.670262:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129523f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.670278:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.670287:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.670294:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789304149.672820:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11:0x0], index 1: 0 00010000:00010000:2.0:1789304149.674419:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129524d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.674442:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129524d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.674460:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129524d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.674505:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129523f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.674513:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129523f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.675268:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129523f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.675275:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304149.675280:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129523f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.675289:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129523f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.675302:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304149.675305:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304149.675311:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129523f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.675318:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129523f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304149.675335:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d3a36a5 reply state 000000008dabae5b transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304149.675343:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304149.675386:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295238 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000ee expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.675401:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129524d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000ee expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304149.675409:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789304149.675411:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304149.675414:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecda00, rc 0) 00000100:00100000:2.0:1789304149.675509:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:40490:x1876219765441536:12345-192.168.202.29@tcp:101:dd.0 Request processed in 5712us (6093us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789304149.679403:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 550 00010000:00010000:3.0:1789304149.682072:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304149.682139:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304149.682148:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304149.682155:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304149.682159:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304149.682169:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304149.682187:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c421d2600) 00010000:00010000:3.0:1789304149.682190:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304149.682197:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304149.682203:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295246 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304149.690713:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304149.691439:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765441664 00000100:00100000:0.0:1789304149.691451:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765441664 00000100:00100000:0.0:1789304149.691530:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 286 00000100:00100000:0.0:1789304149.691541:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:40490:x1876219765441664:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789304149.691561:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304149.691584:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129525b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000f5 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304149.691613:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789304149.691635:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=1599s v=(0 0) 00010000:00010000:0.0:1789304149.691640:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304149.691650:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129525b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000f5 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304149.691682:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129525b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000f5 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304149.691695:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afba00, rc 0) 00000100:00100000:0.0:1789304149.691760:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:40490:x1876219765441664:12345-192.168.202.29@tcp:101:dd.0 Request processed in 221us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304149.691767:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 286 00000100:00100000:2.0:1789304149.710319:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304149.710427:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765441792 00000100:00100000:0.0:1789304149.710438:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765441792 00002000:00100000:0.0:1789304149.710500:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x11:0x0] (0->1048575) req@ffff9e2b01159880 x1876219765441792/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:215/0 lens 488/0 e 0 to 0 dl 1789304160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789304149.710513:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b01159880 with x1876219765441792 ext(0->1048575) 00002000:00010000:0.0:1789304149.710530:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b01159880 00000100:00100000:0.0:1789304149.710564:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:0.0:1789304149.710578:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765441792:12345-192.168.202.29@tcp:4:dd.0 00000100:00100000:3.0:1789304149.778652:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304149.778676:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785536640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304149.778747:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304149.780825:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785536640 00000100:00100000:2.0:1789304149.780848:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785536640 00000100:00100000:2.0:1789304149.780928:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:2.0:1789304149.780940:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785536640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304149.780989:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304149.781081:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785536640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304149.781118:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00080000:0.0:1789304149.781795:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304149.783156:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785536640:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789304149.826593:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00080000:2.0:1789304149.904825:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967329 is committed 00000100:00100000:0.0:1789304149.905267:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765441792:12345-192.168.202.29@tcp:4:dd.0 Request processed in 194688us (194955us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789304149.905280:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 12 00002000:00100000:0.0:1789304149.905294:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x11:0x0] (0->1048575) req@ffff9e2b01159880 x1876219765441792/t4294967329(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:215/0 lens 488/448 e 0 to 0 dl 1789304160 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789304149.905304:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b01159880 with x1876219765441792 ext(0->1048575) 00002000:00010000:0.0:1789304149.905311:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b01159880 00000100:00100000:1.0:1789304149.916595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304149.916737:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765441920 00000100:00100000:3.0:1789304149.916749:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765441920 00000100:00100000:3.0:1789304149.916819:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 551 00000100:00100000:3.0:1789304149.916829:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:40490:x1876219765441920:12345-192.168.202.29@tcp:44:dd.0 00000001:00080000:3.0:1789304150.015405:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000100:00100000:1.0:1789304150.015649:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:40490:x1876219765441920:12345-192.168.202.29@tcp:44:dd.0 Request processed in 98815us (99057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304150.015661:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 551 00000100:00100000:3.0:1789304150.020269:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304150.020945:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765442048 00000100:00100000:0.0:1789304150.020957:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765442048 00000100:00100000:0.0:1789304150.021019:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 287 00000100:00100000:0.0:1789304150.021030:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765442048:12345-192.168.202.29@tcp:16:dd.0 00000100:00100000:0.0:1789304150.021163:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765442048:12345-192.168.202.29@tcp:16:dd.0 Request processed in 135us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304150.021170:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 287 00000100:00100000:0.0:1789304150.025859:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304150.026035:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765442304 00000100:00100000:2.0:1789304150.026047:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765442304 00000100:00100000:2.0:1789304150.026153:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:2.0:1789304150.026174:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:40490:x1876219765442304:12345-192.168.202.29@tcp:35:dd.0 00000001:00080000:2.0:1789304150.026572:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000100:00080000:3.0:1789304150.026697:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304150.032562:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:40490:x1876219765442304:12345-192.168.202.29@tcp:35:dd.0 Request processed in 6377us (6707us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1789304150.032579:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 59 00000020:00080000:2.0:1789304150.032588:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789304150.355277:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304151.310142:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967510 is committed 00000100:00100000:1.0:1789304151.314297:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785537152:0@lo:400:kworker.0 00000100:00100000:2.0:1789304151.314352:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785536768:0@lo:400:kworker.0 00000100:00100000:1.0:1789304151.314364:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304151.314384:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304151.314427:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785536896:0@lo:400:kworker.0 00000100:00100000:3.0:1789304151.314455:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304151.314485:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785537152 00000100:00100000:3.0:1789304151.314491:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785537152 00000100:00100000:1.0:1789304151.314591:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304151.314598:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785537024:0@lo:400:kworker.0 00000100:00100000:1.0:1789304151.314626:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304151.314656:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785537024 00000100:00100000:1.0:1789304151.314673:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785537024 00000100:00100000:3.0:1789304151.314730:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785536896 00000100:00100000:3.0:1789304151.314734:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785536896 00000100:00100000:3.0:1789304151.314752:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:3.0:1789304151.314759:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785537152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304151.314807:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785537152:12345-0@lo:400:kworker.0 Request processed in 48us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304151.314813:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:3.0:1789304151.314840:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1789304151.314846:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785536896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304151.314868:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785536896:12345-0@lo:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304151.314873:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1789304151.315036:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785536896:0@lo:400:kworker.0 00000100:00100000:3.0:1789304151.315043:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785537408:0@lo:400:kworker.0 00000100:00100000:3.0:1789304151.315063:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304151.315451:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785537408 00000100:00100000:1.0:1789304151.315455:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785537408 00000100:00100000:1.0:1789304151.315480:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:1.0:1789304151.315488:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785537024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304151.315531:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785537024:12345-0@lo:400:kworker.0 Request processed in 45us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304151.315537:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:1.0:1789304151.315550:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1789304151.315556:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785537408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304151.315596:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785537408:12345-0@lo:400:kworker.0 Request processed in 40us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304151.315602:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00080000:3.0:1789304151.315835:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304151.315839:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304151.315842:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304151.315873:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785537408:0@lo:400:kworker.0 00000100:00100000:3.0:1789304151.315962:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785537024:0@lo:400:kworker.0 00000100:00100000:3.0:1789304151.315973:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785537152:0@lo:400:kworker.0 00000100:00100000:2.0:1789304151.317435:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785537280:0@lo:400:kworker.0 00000100:00100000:2.0:1789304151.317489:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304151.317538:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785537280 00000100:00100000:2.0:1789304151.317543:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785537280 00000100:00100000:2.0:1789304151.317704:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1789304151.317714:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785537280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304151.317762:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785537280:12345-0@lo:400:kworker.0 Request processed in 51us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304151.317768:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1789304151.317789:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785536768 00000100:00100000:2.0:1789304151.317793:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785536768 00000100:00100000:2.0:1789304151.317814:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:2.0:1789304151.317819:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785536768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304151.317856:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785536768:12345-0@lo:400:kworker.0 Request processed in 37us (3471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304151.317862:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:2.0:1789304151.317907:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785536768:0@lo:400:kworker.0 00000100:00100000:2.0:1789304151.317918:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785537280:0@lo:400:kworker.0 00000100:00080000:3.0:1789304151.319613:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304151.383644:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304152.413404:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304152.704742:0:69467:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1602382648258ns, next at 1582138329942ns, rc = 0 00000004:00080000:1.0:1789304152.704920:0:69467:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1602382828269ns, next at 1502152491902ns, rc = 0 00000004:00080000:3.0:1789304152.706763:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 48 committed 00000004:00080000:3.0:1789304152.706788:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 43 committed 00010000:00010000:1.0:1789304153.430440:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304153.874467:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785537536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304153.874542:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304153.874648:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785537536 00000100:00100000:3.0:1789304153.874657:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785537536 00000100:00100000:3.0:1789304153.874720:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1789304153.874730:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785537536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304153.874770:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00080000:1.0:1789304153.882076:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304153.894397:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785537536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 19661us (19846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304153.894413:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:2.0:1789304153.906036:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785537536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304153.955810:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304153.955897:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304153.955930:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304153.955959:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304153.955985:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765442560 00000100:00100000:1.0:1789304153.955996:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765442560 00000100:00100000:1.0:1789304153.956061:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1111 00000100:00100000:1.0:1789304153.956072:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765442560:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304153.956182:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765442560:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 112us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304153.956190:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1111 00000100:00080000:1.0:1789304153.956212:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304153.956456:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765442688 00000100:00100000:0.0:1789304153.956461:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765442688 00000100:00100000:0.0:1789304153.956503:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765442816 00000100:00100000:0.0:1789304153.956506:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765442816 00000100:00100000:0.0:1789304153.956530:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 788 00000100:00100000:0.0:1789304153.956537:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765442688:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304153.956564:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765442688:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304153.956571:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 788 00000100:00100000:0.0:1789304153.956585:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 789 00000100:00100000:0.0:1789304153.956591:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765442816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304153.956614:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765442816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304153.956619:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 789 00000100:00080000:1.0:1789304153.956915:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304153.956918:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304153.957350:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765442432 00000100:00100000:3.0:1789304153.957357:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765442432 00000100:00100000:3.0:1789304153.957430:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 964 00000100:00100000:3.0:1789304153.957438:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765442432:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304153.957484:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765442432:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 48us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304153.957491:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 964 00010000:00010000:2.0:1789304154.452363:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304154.460387:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304154.460501:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765442944 00000100:00100000:3.0:1789304154.460511:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765442944 00000100:00100000:3.0:1789304154.460568:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 552 00000100:00100000:3.0:1789304154.460578:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:40682:x1876219765442944:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304154.460679:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:40682:x1876219765442944:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304154.460686:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 552 00000100:00100000:0.0:1789304154.474967:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304154.475070:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765443072 00000100:00100000:2.0:1789304154.475081:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765443072 00000100:00100000:2.0:1789304154.475175:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 288 00000100:00100000:2.0:1789304154.475187:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:40682:x1876219765443072:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304154.475574:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:40682:x1876219765443072:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 388us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304154.475582:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 288 00000100:00100000:0.0:1789304154.478184:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304154.478216:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765443200 00000100:00100000:0.0:1789304154.478226:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765443200 00000100:00100000:0.0:1789304154.478270:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 289 00000100:00100000:0.0:1789304154.478280:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40682:x1876219765443200:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304154.478623:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40682:x1876219765443200:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 343us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304154.478631:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 289 00000100:00100000:2.0:1789304154.483559:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304154.483635:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765443328 00000100:00100000:3.0:1789304154.483647:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765443328 00000100:00100000:3.0:1789304154.483704:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 553 00000100:00100000:3.0:1789304154.483713:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:40682:x1876219765443328:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304154.486517:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:40682:x1876219765443328:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 2794us (2956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304154.486534:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 553 00000100:00100000:2.0:1789304154.495652:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304154.495726:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765443456 00000100:00100000:3.0:1789304154.495737:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765443456 00000100:00100000:3.0:1789304154.495814:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 554 00000100:00100000:3.0:1789304154.495826:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:40682:x1876219765443456:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304154.495942:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:40682:x1876219765443456:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 117us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304154.495950:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 554 00000100:00100000:3.0:1789304154.497636:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304154.497709:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765443584 00000100:00100000:2.0:1789304154.497717:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765443584 00000100:00100000:2.0:1789304154.497775:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 290 00000100:00100000:2.0:1789304154.497785:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:40682:x1876219765443584:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304154.498228:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:40682:x1876219765443584:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 443us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304154.498236:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 290 00000100:00100000:2.0:1789304154.500238:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304154.500321:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765443712 00000100:00100000:3.0:1789304154.500331:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765443712 00000100:00100000:3.0:1789304154.500387:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 291 00000100:00100000:3.0:1789304154.500397:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40682:x1876219765443712:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304154.500730:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40682:x1876219765443712:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 334us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304154.500740:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 291 00000100:00100000:0.0:1789304154.506810:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304154.506968:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765443840 00000100:00100000:3.0:1789304154.506982:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765443840 00000100:00100000:3.0:1789304154.507052:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 555 00000100:00100000:3.0:1789304154.507062:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:40682:x1876219765443840:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304154.507536:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:40682:x1876219765443840:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 474us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304154.507544:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 555 00000100:00100000:0.0:1789304154.619871:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304154.621041:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765444096 00000100:00100000:1.0:1789304154.621054:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765444096 00000100:00100000:1.0:1789304154.621126:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 556 00000100:00100000:1.0:1789304154.621137:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:40687:x1876219765444096:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:1.0:1789304154.621205:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304154.621232:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129524d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000ee expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.621251:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:1.0:1789304154.621261:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304154.621283:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295262 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.621297:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295262 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.621307:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295262 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.621320:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.621327:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.621334:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.621635:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295270 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.621644:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295270 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.621652:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295270 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789304154.622534:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].17, 64 off9280 00000004:00080000:1.0:1789304154.622546:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1604300454717ns, next at 1605300451759ns, rc = 0 00010000:00010000:1.0:1789304154.622640:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622651:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622658:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622664:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622669:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622674:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622699:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304154.622721:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295270 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622726:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295270 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622732:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295270 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622737:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304154.622741:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295270 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622748:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295270 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622758:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:1.0:1789304154.622761:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789304154.622765:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295270 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622771:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295270 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622786:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295262 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622792:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295262 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622807:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295262 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.622808:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304154.622812:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304154.622814:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622815:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295262 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.622821:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304154.622822:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295262 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.622825:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622830:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:0.0:1789304154.622831:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304154.622832:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304154.622836:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295262 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.622839:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:1.0:1789304154.622841:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295262 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.622841:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789304154.622844:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.622850:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295277 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304154.622856:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3624034 reply state 000000004bb6aa89 transno 4294967511 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.622862:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304154.622863:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304154.622864:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789304154.622865:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304154.622952:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:40687:x1876219765444096:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1813us (3084us total) trans 4294967511 rc 0/0 00000100:00100000:1.0:1789304154.622961:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 556 00010000:00010000:0.0:1789304154.641209:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.641231:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.641239:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.641246:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304154.641251:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.641262:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.641278:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c14add900) 00010000:00010000:0.0:1789304154.641281:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304154.641286:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304154.641291:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295269 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304154.901994:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785537664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304154.902130:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304154.903161:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785537664 00000100:00100000:0.0:1789304154.903172:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785537664 00000100:00100000:0.0:1789304154.903247:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1789304154.903256:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785537664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304154.903292:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304154.903351:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785537664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304154.903359:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00080000:1.0:1789304154.904513:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304154.904570:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785537664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304155.475272:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304156.434547:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785537920:0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.434622:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304156.434693:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785538432:0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.434717:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304156.434744:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789304156.434751:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785537792:0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.434789:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304156.434814:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785538304:0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.434835:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304156.434866:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785538432 00000100:00100000:3.0:1789304156.434875:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785538432 00000100:00100000:3.0:1789304156.434929:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1789304156.434939:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785538432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.434996:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785538432:12345-0@lo:400:kworker.0 Request processed in 58us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304156.435004:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1789304156.435030:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785537792 00000100:00100000:3.0:1789304156.435034:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785537792 00000100:00100000:3.0:1789304156.435058:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1789304156.435064:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785537792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.435143:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785537792:12345-0@lo:400:kworker.0 Request processed in 70us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304156.435149:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1789304156.435176:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785537920 00000100:00100000:3.0:1789304156.435180:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785537920 00000100:00100000:3.0:1789304156.435200:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785538304 00000100:00100000:3.0:1789304156.435203:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785538304 00000100:00100000:3.0:1789304156.435219:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:3.0:1789304156.435225:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785537920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.435252:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785537920:12345-0@lo:400:kworker.0 Request processed in 27us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304156.435258:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:3.0:1789304156.435268:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:3.0:1789304156.435272:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785538304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.435294:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785538304:12345-0@lo:400:kworker.0 Request processed in 22us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304156.435299:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:3.0:1789304156.435333:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785537792:0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.435343:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785538304:0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.435352:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785537920:0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.435360:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785538432:0@lo:400:kworker.0 00000100:00100000:1.0:1789304156.435559:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785538048:0@lo:400:kworker.0 00000100:00100000:1.0:1789304156.435589:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304156.435612:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304156.435617:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785538176:0@lo:400:kworker.0 00000100:00100000:1.0:1789304156.435638:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789304156.435664:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304156.435669:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304156.435678:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785538176 00000100:00100000:1.0:1789304156.435681:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785538176 00000100:00100000:1.0:1789304156.435712:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1789304156.435719:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785538176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304156.435752:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785538176:12345-0@lo:400:kworker.0 Request processed in 34us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304156.435758:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00080000:1.0:1789304156.435792:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304156.435809:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785538176:0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.436030:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785538048 00000100:00100000:3.0:1789304156.436035:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785538048 00000100:00100000:3.0:1789304156.436086:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1789304156.436111:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785538048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304156.436157:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785538048:12345-0@lo:400:kworker.0 Request processed in 46us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304156.436163:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1789304156.436192:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785538048:0@lo:400:kworker.0 00000100:00080000:1.0:1789304156.436928:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304156.498276:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304157.273431:0:69612:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1606951337606ns, next at 1582138329942ns, rc = 0 00000004:00080000:0.0:1789304157.273602:0:69612:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1606951510829ns, next at 1605300451759ns, rc = 0 00000004:00080000:1.0:1789304157.397506:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 50 committed 00000004:00080000:1.0:1789304157.397533:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 44 committed 00000001:00080000:1.0:1789304157.397554:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000004:00080000:1.0:1789304157.397560:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 49 committed 00000100:00100000:3.0:1789304157.398033:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785538560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789304157.398144:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304157.398253:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785538560 00000100:00100000:2.0:1789304157.398263:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785538560 00000100:00100000:2.0:1789304157.398316:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789304157.398326:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785538560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789304157.398353:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:17 count 1 00010000:00010000:2.0:1789304157.398397:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304157.398421:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129525b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000f5 expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304157.398430:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x11:0x0].0x0 since=8s v=(0 0) 00010000:00010000:2.0:1789304157.398434:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304157.398439:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304157.398467:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129525b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000f5 expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304157.398481:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129525b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000f5 expref: 5 pid: 6691 timeout: 1707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304157.398493:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785538688:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789304157.398558:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110ea540 going to sleep for 11 seconds 00000100:00100000:0.0:1789304157.410906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304157.411542:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785538688:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789304157.411570:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304157.411760:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765444224 00000100:00100000:3.0:1789304157.411778:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765444224 00010000:00010000:3.0:1789304157.411841:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129525b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000f5 expref: 6 pid: 6691 timeout: 1707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789304157.412511:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304157.412753:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 318 00000100:00100000:3.0:1789304157.412776:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0386a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765444224:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789304157.412794:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304157.412801:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129525b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000f5 expref: 6 pid: 6691 timeout: 1707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304157.412817:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129525b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000f5 expref: 6 pid: 6691 timeout: 1707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304157.412842:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129525b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000f5 expref: 6 pid: 6691 timeout: 1707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304157.412858:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304157.412862:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304157.412868:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304157.412879:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304157.412907:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304157.413055:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0386a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765444224:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 292us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304157.413063:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 318 00010000:00010000:0.0:1789304157.413207:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304157.413218:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304157.413234:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304157.413243:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304157.413272:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789304157.413949:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785538560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15623us (15803us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789304157.413958:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00010000:00010000:3.0:1789304157.414871:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304157.414882:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304157.414893:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304157.414898:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304157.414910:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304157.414928:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304157.414940:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a89b8c5f/0xefc0bb723129527e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304157.414960:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304157.414962:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304157.414964:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304157.415003:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c38460a80/2, rc 0, transno 4294967330 00000100:00100000:3.0:1789304157.415014:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785538560:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789304157.522311:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304158.546870:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304158.996295:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785538816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304158.996385:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304158.996655:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785538816 00000100:00100000:1.0:1789304158.996665:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785538816 00000100:00100000:1.0:1789304158.996723:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1789304158.996733:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785538816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304158.996782:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789304158.996835:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785538816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304158.996841:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1789304158.996892:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785538816:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304158.997335:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304159.079202:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304159.079241:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304159.079271:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304159.079315:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304159.081034:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765444480 00000100:00100000:1.0:1789304159.081048:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765444480 00000100:00100000:1.0:1789304159.081235:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1115 00000100:00100000:1.0:1789304159.081246:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765444480:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304159.081328:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765444480:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 84us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304159.081335:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1115 00000100:00080000:1.0:1789304159.081359:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304159.082166:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765444736 00000100:00100000:3.0:1789304159.082173:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765444736 00000100:00100000:3.0:1789304159.082206:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765444608 00000100:00100000:3.0:1789304159.082209:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765444608 00000100:00100000:3.0:1789304159.082234:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 792 00000100:00100000:3.0:1789304159.082242:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765444736:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304159.082278:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765444736:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304159.082285:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 792 00000100:00100000:3.0:1789304159.082298:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 793 00000100:00100000:3.0:1789304159.082305:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765444608:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304159.082327:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765444608:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 23us (3012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304159.082333:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 793 00000100:00080000:3.0:1789304159.082347:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304159.082350:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304159.084184:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765444352 00000100:00100000:1.0:1789304159.084197:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765444352 00000100:00100000:1.0:1789304159.084248:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 966 00000100:00100000:1.0:1789304159.084258:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765444352:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304159.084319:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765444352:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 62us (5046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304159.084326:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 966 00010000:00010000:3.0:1789304159.572542:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304159.649236:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967330 is committed 00000100:00100000:0.0:1789304160.019911:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304160.019938:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785538944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304160.020027:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304160.020614:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785538944 00000100:00100000:3.0:1789304160.020625:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785538944 00000100:00100000:3.0:1789304160.021064:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1789304160.021076:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785538944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304160.021137:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304160.021215:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785538944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304160.021222:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1789304160.023406:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785538944:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304160.026385:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304160.598732:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304161.554467:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785539072:0@lo:400:kworker.0 00000100:00100000:3.0:1789304161.554570:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304161.555409:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785539200:0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.555452:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304161.555496:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304161.555511:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785539328:0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.555537:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304161.555568:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785539200 00000100:00100000:0.0:1789304161.555576:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785539200 00000100:00100000:0.0:1789304161.555623:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1789304161.555632:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785539200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.555684:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785539200:12345-0@lo:400:kworker.0 Request processed in 52us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304161.555691:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1789304161.555714:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785539328 00000100:00100000:0.0:1789304161.555717:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785539328 00000100:00100000:0.0:1789304161.555756:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:0.0:1789304161.555763:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785539328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.555807:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785539328:12345-0@lo:400:kworker.0 Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304161.555814:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:0.0:1789304161.556229:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785539328:0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.556241:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785539200:0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.556294:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785539456:0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.556315:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304161.556337:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785539456 00000100:00100000:0.0:1789304161.556339:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785539456 00000100:00100000:0.0:1789304161.556372:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1789304161.556377:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785539456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.556399:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785539456:12345-0@lo:400:kworker.0 Request processed in 23us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304161.556403:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00080000:0.0:1789304161.556413:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304161.556426:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785539456:0@lo:400:kworker.0 00000100:00100000:2.0:1789304161.556713:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785539072 00000100:00100000:2.0:1789304161.556720:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785539072 00000100:00100000:2.0:1789304161.556762:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1789304161.556769:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785539072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.560165:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785539712:0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.560237:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304161.560430:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785539712 00000100:00100000:0.0:1789304161.560438:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785539712 00000100:00100000:0.0:1789304161.560653:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1789304161.560666:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785539712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.560721:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785539712:12345-0@lo:400:kworker.0 Request processed in 58us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304161.560728:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00080000:0.0:1789304161.560760:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304161.560795:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000004:00080000:0.0:1789304161.560802:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c38460a80, transno 4294967330 00000100:00100000:0.0:1789304161.560813:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785539712:0@lo:400:kworker.0 00000100:00100000:1.0:1789304161.561674:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304161.561693:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785539584:0@lo:400:kworker.0 00000100:00100000:1.0:1789304161.561756:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304161.562011:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785539072:12345-0@lo:400:kworker.0 Request processed in 5240us (7439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304161.562022:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:0.0:1789304161.562171:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785539584 00000100:00100000:0.0:1789304161.562179:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785539584 00000100:00100000:0.0:1789304161.562238:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1789304161.562246:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785539584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304161.562298:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785539584:12345-0@lo:400:kworker.0 Request processed in 54us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304161.562304:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1789304161.562403:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785539584:0@lo:400:kworker.0 00000100:00080000:2.0:1789304161.562693:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304161.564827:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785539072:0@lo:400:kworker.0 00010000:00010000:2.0:1789304161.618692:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304162.642735:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304163.675489:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304164.121265:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785539840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304164.121338:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304164.121473:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785539840 00000100:00100000:2.0:1789304164.121481:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785539840 00000100:00100000:2.0:1789304164.121554:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1789304164.121564:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785539840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304164.121610:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304164.121665:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785539840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304164.121672:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:1.0:1789304164.121821:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785539840:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304164.121879:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304164.193426:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304164.193472:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304164.193507:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304164.193542:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304164.193577:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765445248 00000100:00100000:1.0:1789304164.193589:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765445248 00000100:00100000:1.0:1789304164.193646:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765445120 00000100:00100000:1.0:1789304164.193649:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765445120 00000100:00100000:1.0:1789304164.193673:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 796 00000100:00100000:1.0:1789304164.193682:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765445248:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304164.193785:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765445248:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 104us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304164.193793:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 796 00000100:00100000:1.0:1789304164.193811:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 797 00000100:00100000:1.0:1789304164.193818:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765445120:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304164.193850:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765445120:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304164.193857:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 797 00000100:00080000:1.0:1789304164.193978:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304164.193983:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304164.194292:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765444992 00000100:00100000:0.0:1789304164.194298:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765444992 00000100:00100000:0.0:1789304164.194349:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1119 00000100:00100000:0.0:1789304164.194358:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765444992:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304164.194399:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765444992:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 42us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304164.194405:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1119 00000100:00100000:2.0:1789304164.194921:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765444864 00000100:00100000:2.0:1789304164.194927:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765444864 00000100:00100000:2.0:1789304164.194970:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 968 00000100:00100000:2.0:1789304164.194978:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765444864:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304164.195026:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765444864:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 48us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304164.195032:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 968 00000100:00080000:1.0:1789304164.196338:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304164.690463:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304165.138525:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785539968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304165.138604:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304165.138755:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785539968 00000100:00100000:2.0:1789304165.138764:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785539968 00000100:00100000:2.0:1789304165.138833:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1789304165.138854:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785539968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304165.138892:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304165.138947:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785539968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304165.138954:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1789304165.139163:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785539968:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304165.139295:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304165.715940:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304166.674326:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785540224:0@lo:400:kworker.0 00000100:00100000:3.0:1789304166.674330:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785540352:0@lo:400:kworker.0 00000100:00100000:1.0:1789304166.674403:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785540480:0@lo:400:kworker.0 00000100:00100000:0.0:1789304166.674878:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785540096:0@lo:400:kworker.0 00000100:00100000:0.0:1789304166.675765:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304166.675817:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785540608:0@lo:400:kworker.0 00000100:00100000:0.0:1789304166.675847:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304166.675892:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785540608 00000100:00100000:0.0:1789304166.675899:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785540608 00000100:00100000:0.0:1789304166.675955:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1789304166.675964:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785540608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304166.676027:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785540608:12345-0@lo:400:kworker.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304166.676035:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00080000:0.0:1789304166.676061:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304166.676104:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785540608:0@lo:400:kworker.0 00000100:00100000:0.0:1789304166.676146:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785540096 00000100:00100000:0.0:1789304166.676150:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785540096 00000100:00100000:0.0:1789304166.676174:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1789304166.676179:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785540096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304166.676209:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785540096:12345-0@lo:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304166.676213:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1789304166.676238:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785540096:0@lo:400:kworker.0 00000100:00100000:2.0:1789304166.678609:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304166.678752:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785540224 00000100:00100000:0.0:1789304166.678763:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785540224 00000100:00100000:0.0:1789304166.678858:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:0.0:1789304166.678868:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785540224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304166.679029:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304166.679233:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785540480 00000100:00100000:1.0:1789304166.679238:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785540480 00000100:00100000:1.0:1789304166.679282:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1789304166.679289:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785540480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304166.679330:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785540480:12345-0@lo:400:kworker.0 Request processed in 42us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304166.679337:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00080000:1.0:1789304166.679356:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304166.679388:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785540480:0@lo:400:kworker.0 00000100:00100000:3.0:1789304166.679842:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304166.679875:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785540352 00000100:00100000:1.0:1789304166.679882:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785540352 00000100:00100000:1.0:1789304166.679915:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1789304166.679923:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785540352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304166.680058:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785540736:0@lo:400:kworker.0 00000100:00100000:2.0:1789304166.680122:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304166.680155:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785540736 00000100:00100000:2.0:1789304166.680159:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785540736 00000100:00100000:0.0:1789304166.680453:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785540224:12345-0@lo:400:kworker.0 Request processed in 1587us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304166.680461:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1789304166.680692:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785540352:12345-0@lo:400:kworker.0 Request processed in 759us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304166.680699:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1789304166.680714:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1789304166.680721:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785540736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304166.680756:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785540736:12345-0@lo:400:kworker.0 Request processed in 36us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304166.680761:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00080000:0.0:1789304166.680880:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304166.681040:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785540224:0@lo:400:kworker.0 00000100:00100000:2.0:1789304166.681051:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785540736:0@lo:400:kworker.0 00000100:00100000:3.0:1789304166.687277:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785540352:0@lo:400:kworker.0 00010000:00010000:1.0:1789304166.738385:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304167.762395:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304168.786503:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304169.235600:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304169.235623:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785540864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304169.235712:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304169.235936:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785540864 00000100:00100000:0.0:1789304169.235944:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785540864 00000100:00100000:0.0:1789304169.236012:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:0.0:1789304169.236022:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785540864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304169.236055:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304169.236138:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785540864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304169.236145:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00080000:1.0:1789304169.236280:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304169.236506:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785540864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304169.314230:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304169.314280:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304169.314328:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304169.314385:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304169.314417:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765445760 00000100:00100000:1.0:1789304169.314427:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765445760 00000100:00100000:1.0:1789304169.314485:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765445632 00000100:00100000:1.0:1789304169.314489:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765445632 00000100:00100000:1.0:1789304169.314512:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 800 00000100:00100000:1.0:1789304169.314522:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765445760:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304169.314589:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765445760:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 68us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304169.314596:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 800 00000100:00100000:1.0:1789304169.314614:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 801 00000100:00100000:1.0:1789304169.314620:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765445632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304169.314646:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765445632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304169.314652:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 801 00000100:00080000:1.0:1789304169.314688:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304169.314692:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304169.314952:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765445376 00000100:00100000:3.0:1789304169.314957:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765445376 00000100:00100000:3.0:1789304169.314997:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 970 00000100:00100000:3.0:1789304169.315005:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765445376:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304169.315035:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765445376:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304169.315041:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 970 00000100:00100000:0.0:1789304169.316842:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765445504 00000100:00100000:0.0:1789304169.316855:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765445504 00000100:00100000:0.0:1789304169.316938:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1123 00000100:00100000:0.0:1789304169.316948:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765445504:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304169.317024:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765445504:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 77us (2803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304169.317031:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1123 00000100:00080000:1.0:1789304169.317512:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304169.810676:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304170.258380:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785540992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304170.258470:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304170.258677:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785540992 00000100:00100000:2.0:1789304170.258686:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785540992 00000100:00100000:2.0:1789304170.258753:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1789304170.258762:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785540992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304170.258804:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304170.258852:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785540992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304170.258859:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00080000:1.0:1789304170.258921:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304170.258958:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3709ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785540992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304170.834507:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304171.794393:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304171.794510:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785541248:0@lo:400:kworker.0 00000100:00100000:3.0:1789304171.794606:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304171.794698:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304171.794705:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785541376:0@lo:400:kworker.0 00000100:00100000:3.0:1789304171.794736:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304171.794817:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785541248 00000100:00100000:3.0:1789304171.794828:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785541248 00000100:00100000:3.0:1789304171.794882:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1789304171.794891:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3709ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785541248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304171.794953:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3709ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785541248:12345-0@lo:400:kworker.0 Request processed in 64us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304171.794960:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1789304171.795009:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785541248:0@lo:400:kworker.0 00000100:00100000:3.0:1789304171.795040:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785541376 00000100:00100000:3.0:1789304171.795044:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785541376 00000100:00100000:3.0:1789304171.795069:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1789304171.795075:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785541376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304171.795134:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785541376:12345-0@lo:400:kworker.0 Request processed in 59us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304171.795140:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1789304171.795163:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785541376:0@lo:400:kworker.0 00000100:00100000:0.0:1789304171.795368:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304171.795378:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785541504:0@lo:400:kworker.0 00000100:00100000:0.0:1789304171.795418:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304171.795826:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785541504 00000100:00100000:3.0:1789304171.795832:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785541504 00000100:00100000:3.0:1789304171.795883:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1789304171.795891:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785541504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304171.795936:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785541504:12345-0@lo:400:kworker.0 Request processed in 47us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304171.795947:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1789304171.795982:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785541504:0@lo:400:kworker.0 00000100:00080000:0.0:1789304171.796135:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304171.796294:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785541120:0@lo:400:kworker.0 00000100:00100000:1.0:1789304171.796444:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304171.799826:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304171.799854:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785541760:0@lo:400:kworker.0 00000100:00100000:3.0:1789304171.799931:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304171.799992:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785541632:0@lo:400:kworker.0 00000100:00100000:3.0:1789304171.800019:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304171.800211:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785541760 00000100:00100000:2.0:1789304171.800218:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785541760 00000100:00100000:2.0:1789304171.800284:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1789304171.800294:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785541760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304171.800367:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785541760:12345-0@lo:400:kworker.0 Request processed in 74us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304171.800374:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1789304171.800642:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785541760:0@lo:400:kworker.0 00000100:00100000:3.0:1789304171.801168:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785541632 00000100:00100000:3.0:1789304171.801174:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785541632 00000100:00100000:3.0:1789304171.801218:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1789304171.801226:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785541632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304171.801278:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785541632:12345-0@lo:400:kworker.0 Request processed in 53us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304171.801284:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1789304171.801319:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785541632:0@lo:400:kworker.0 00000100:00080000:1.0:1789304171.801475:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304171.801481:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304171.803261:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785541120 00000100:00100000:0.0:1789304171.803282:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785541120 00000100:00100000:0.0:1789304171.803850:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1789304171.803865:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785541120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304171.803973:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785541120:12345-0@lo:400:kworker.0 Request processed in 114us (7586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304171.803980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1789304171.804980:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785541120:0@lo:400:kworker.0 00010000:00010000:1.0:1789304171.858780:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304172.882913:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304173.825562:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304173.827116:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765445888 00000100:00100000:3.0:1789304173.827130:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765445888 00000100:00080000:1.0:1789304173.827280:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304173.827368:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 557 00000100:00100000:3.0:1789304173.827381:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:40905:x1876219765445888:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304173.827493:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:40905:x1876219765445888:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 115us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304173.827500:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 557 00000100:00100000:1.0:1789304173.830556:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304173.830639:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765446016 00000100:00100000:3.0:1789304173.830649:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765446016 00000100:00100000:3.0:1789304173.830729:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 293 00000100:00100000:3.0:1789304173.830740:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:40905:x1876219765446016:12345-192.168.202.29@tcp:19:lfs.0 00000100:00080000:1.0:1789304173.830986:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304173.831259:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:40905:x1876219765446016:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 521us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304173.831265:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 293 00000100:00100000:1.0:1789304173.833515:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304173.833625:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765446144 00000100:00100000:2.0:1789304173.833637:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765446144 00000100:00100000:2.0:1789304173.833883:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 294 00000100:00100000:2.0:1789304173.833894:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:40905:x1876219765446144:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304173.834294:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:40905:x1876219765446144:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 402us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304173.834302:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 294 00000100:00080000:1.0:1789304173.834356:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304173.836629:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304173.837522:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765446272 00000100:00100000:3.0:1789304173.837533:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765446272 00000100:00100000:3.0:1789304173.837598:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 558 00000100:00100000:3.0:1789304173.837608:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:40905:x1876219765446272:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304173.838072:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:40905:x1876219765446272:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 464us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304173.838080:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 558 00000100:00100000:0.0:1789304173.841213:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304173.841274:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765446400 00000100:00100000:2.0:1789304173.841283:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765446400 00000100:00100000:2.0:1789304173.841329:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 559 00000100:00100000:2.0:1789304173.841336:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:40905:x1876219765446400:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304173.841430:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:40905:x1876219765446400:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304173.841436:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 559 00000100:00100000:1.0:1789304173.843368:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304173.843450:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765446528 00000100:00100000:2.0:1789304173.843460:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765446528 00000100:00100000:2.0:1789304173.843512:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 295 00000100:00100000:2.0:1789304173.843521:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:40905:x1876219765446528:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304173.844179:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:40905:x1876219765446528:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 656us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304173.844188:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 295 00000100:00100000:1.0:1789304173.847323:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304173.847416:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765446656 00000100:00100000:3.0:1789304173.847426:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765446656 00000100:00100000:3.0:1789304173.847519:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 296 00000100:00100000:3.0:1789304173.847530:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:40905:x1876219765446656:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304173.847965:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:40905:x1876219765446656:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 435us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304173.847974:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 296 00000100:00100000:0.0:1789304173.850139:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304173.850877:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765446784 00000100:00100000:3.0:1789304173.850892:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765446784 00000100:00100000:3.0:1789304173.850959:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 560 00000100:00100000:3.0:1789304173.850971:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:40905:x1876219765446784:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304173.851538:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:40905:x1876219765446784:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 567us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304173.851546:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 560 00010000:00010000:2.0:1789304173.914484:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304174.354790:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304174.354815:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785541888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304174.354899:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304174.355133:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785541888 00000100:00100000:1.0:1789304174.355142:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785541888 00000100:00100000:1.0:1789304174.355205:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1789304174.355225:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785541888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304174.355261:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304174.355315:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785541888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304174.355322:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1789304174.355476:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785541888:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304174.355531:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304174.436469:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304174.436498:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304174.436524:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304174.436546:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304174.436576:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765447168 00000100:00100000:3.0:1789304174.436636:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765447168 00000100:00100000:3.0:1789304174.436694:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765447296 00000100:00100000:3.0:1789304174.436698:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765447296 00000100:00100000:3.0:1789304174.436720:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 804 00000100:00100000:3.0:1789304174.436730:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765447168:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304174.436798:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765447168:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304174.436805:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 804 00000100:00100000:3.0:1789304174.436822:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 805 00000100:00100000:3.0:1789304174.436828:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765447296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304174.436851:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765447296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304174.436857:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 805 00000100:00100000:3.0:1789304174.436877:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765447040 00000100:00100000:3.0:1789304174.436881:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765447040 00000100:00100000:3.0:1789304174.436908:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1127 00000100:00100000:3.0:1789304174.436914:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765447040:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304174.436943:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765447040:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304174.436949:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1127 00000100:00100000:2.0:1789304174.437304:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765446912 00000100:00100000:2.0:1789304174.437310:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765446912 00000100:00100000:2.0:1789304174.437349:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 972 00000100:00100000:2.0:1789304174.437358:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765446912:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304174.437392:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765446912:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 35us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304174.437398:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 972 00010000:00010000:1.0:1789304174.937069:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304175.379460:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304175.379497:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785542016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304175.379566:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304175.379642:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785542016 00000100:00100000:3.0:1789304175.379661:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785542016 00000100:00100000:3.0:1789304175.379716:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:3.0:1789304175.379725:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785542016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304175.379765:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304175.379816:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785542016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304175.379823:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00080000:3.0:1789304175.379845:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304175.379883:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785542016:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304175.955809:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304176.211914:0:69880:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd996ebc50 20000000:00000080:0.0:1789304176.211934:0:69880:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02054000 uarg=0000000000000000 00010000:00010000:0.0:1789304176.213042:0:69880:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789304176.213080:0:69880:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:0.0:1789304176.213085:0:69880:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304176.213236:0:69880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000e7 expref: 5 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304176.213263:0:69880:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789304176.213284:0:69880:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304176.213299:0:69880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304176.213312:0:69880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129520e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295207 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304176.213320:0:69880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304176.213361:0:69880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129520e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295207 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304176.213376:0:69880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129520e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295207 expref: 18 pid: 5846 timeout: 1775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304176.213391:0:69880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69880:1876219785542144:0@lo:104: 00000100:00100000:0.0:1789304176.213453:0:69880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304176.213603:0:69880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05a08cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304176.216870:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785542144 00000100:00100000:2.0:1789304176.216887:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785542144 00000100:00100000:2.0:1789304176.216991:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789304176.217002:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02eda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:69880:x1876219785542144:12345-0@lo:104: 00010000:00010000:2.0:1789304176.217022:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304176.217169:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304176.217175:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02eda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:69880:x1876219785542144:12345-0@lo:104: Request processed in 176us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304176.217182:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00010000:00010000:3.0:1789304176.217264:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304176.217272:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217280:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304176.217285:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217294:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304176.217307:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304176.217313:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304176.217353:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217360:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304176.217381:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217389:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231295207 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129520e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217406:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304176.217408:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304176.217410:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304176.217433:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785542272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304176.217473:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304176.217526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785542272 00000100:00100000:3.0:1789304176.217530:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785542272 00010000:00010000:3.0:1789304176.217550:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129520e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295207 expref: 19 pid: 5846 timeout: 1775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304176.217571:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789304176.217578:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785542272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304176.217589:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304176.217606:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129520e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295207 expref: 19 pid: 5846 timeout: 1775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217617:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129520e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295207 expref: 19 pid: 5846 timeout: 1775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217633:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217655:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217672:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217679:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217685:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217692:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217697:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304176.217701:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217708:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217716:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304176.217731:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304176.217761:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785542272:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304176.217768:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789304176.217806:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785542272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304176.218729:0:69880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129520e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295207 expref: 18 pid: 5846 timeout: 1775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304176.218745:0:69880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69880:1876219785542144:0@lo:104: 00010000:00010000:1.0:1789304176.218762:0:69880:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304176.218772:0:69880:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304176.218778:0:69880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304176.218785:0:69880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231295285 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304176.927690:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785542528:0@lo:400:kworker.0 00000100:00100000:1.0:1789304176.927758:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304176.927807:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785543040:0@lo:400:kworker.0 00000100:00100000:1.0:1789304176.927832:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304176.927856:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789304176.927862:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785542400:0@lo:400:kworker.0 00000100:00100000:1.0:1789304176.927887:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304176.927907:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785542912:0@lo:400:kworker.0 00000100:00100000:1.0:1789304176.927927:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304176.927955:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785542528 00000100:00100000:1.0:1789304176.927962:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785542528 00000100:00100000:1.0:1789304176.928003:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785542912 00000100:00100000:1.0:1789304176.928007:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785542912 00000100:00100000:1.0:1789304176.928051:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1789304176.928060:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785542528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304176.928127:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785542528:12345-0@lo:400:kworker.0 Request processed in 67us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304176.928134:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1789304176.928152:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1789304176.928158:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785542912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304176.928184:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785542912:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304176.928190:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1789304176.928230:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785542912:0@lo:400:kworker.0 00000100:00100000:1.0:1789304176.928241:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785542528:0@lo:400:kworker.0 00000100:00100000:3.0:1789304176.929609:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785542656:0@lo:400:kworker.0 00000100:00100000:3.0:1789304176.929676:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304176.929735:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304176.929742:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785542784:0@lo:400:kworker.0 00000100:00100000:3.0:1789304176.929765:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304176.929803:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785543040 00000100:00100000:3.0:1789304176.929809:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785543040 00000100:00100000:3.0:1789304176.929846:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785542656 00000100:00100000:3.0:1789304176.929849:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785542656 00000100:00100000:3.0:1789304176.929867:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:3.0:1789304176.929874:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785543040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304176.929922:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785543040:12345-0@lo:400:kworker.0 Request processed in 48us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304176.929929:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:3.0:1789304176.929945:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1789304176.929951:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785542656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304176.929983:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785542656:12345-0@lo:400:kworker.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304176.929988:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1789304176.930006:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785542400 00000100:00100000:3.0:1789304176.930010:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785542400 00000100:00100000:3.0:1789304176.930033:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1789304176.930039:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785542400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304176.930069:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785542400:12345-0@lo:400:kworker.0 Request processed in 31us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304176.930074:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1789304176.930118:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785542784 00000100:00100000:3.0:1789304176.930122:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785542784 00000100:00100000:3.0:1789304176.930147:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:3.0:1789304176.930153:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785542784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304176.930182:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785542784:12345-0@lo:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304176.930187:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00080000:3.0:1789304176.930204:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304176.930208:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304176.930245:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785542784:0@lo:400:kworker.0 00000100:00100000:3.0:1789304176.930255:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785542656:0@lo:400:kworker.0 00000100:00100000:3.0:1789304176.930287:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785542400:0@lo:400:kworker.0 00000100:00100000:3.0:1789304176.930298:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785543040:0@lo:400:kworker.0 00010000:00010000:1.0:1789304176.978809:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304177.942076:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304177.942086:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304177.942107:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304177.942175:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304177.942188:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304177.942202:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304177.942232:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785543168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304177.942310:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304177.942366:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05ad7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789304177.942391:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785543168 00000100:00100000:3.0:1789304177.942399:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785543168 00000100:00100000:3.0:1789304177.942447:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:3.0:1789304177.942830:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785543168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304177.942910:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304177.942926:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231295293 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129528c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304177.942950:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231295293 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129528c expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304177.942962:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231295293 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129528c expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304177.942972:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304177.943023:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785543168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304177.943030:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:3.0:1789304177.943084:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785543168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304177.943124:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304177.943135:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304177.943168:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304177.943175:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304177.943182:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304178.006559:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304179.038581:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304179.122821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304179.122969:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765447424 00000100:00100000:1.0:1789304179.122981:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765447424 00000100:00100000:1.0:1789304179.123065:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 561 00000100:00100000:1.0:1789304179.123075:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:40992:x1876219765447424:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304179.123120:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304179.123145:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129529a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861000fc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.123225:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.123242:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.123257:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304179.123299:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:1.0:1789304179.123302:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304179.123320:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.123342:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129529a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000fc expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.123360:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000fc expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.123367:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:1.0:1789304179.123370:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304179.123373:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ea00, rc 0) 00000100:00100000:1.0:1789304179.123429:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:40992:x1876219765447424:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 356us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304179.123435:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 561 00000100:00080000:3.0:1789304179.127178:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304179.129306:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304179.129973:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765447680 00000100:00100000:3.0:1789304179.129984:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765447680 00000100:00100000:3.0:1789304179.130050:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 562 00000100:00100000:3.0:1789304179.130061:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40992:x1876219765447680:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304179.130141:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304179.130173:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861000fc expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304179.130190:0:5854:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231295231) 00010000:00010000:3.0:1789304179.130194:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:3.0:1789304179.130205:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304179.130231:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304179.130245:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304179.130256:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304179.174500:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002770c496 reply state 0000000039a00d24 transno 4294967512 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789304179.174504:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000100:00100000:3.0:1789304179.174517:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304179.174534:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00080000:3.0:1789304179.174800:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304179.174826:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:40992:x1876219765447680:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 44762us (45524us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789304179.174837:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 562 00010000:00010000:1.0:1789304179.174968:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.174979:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.174987:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.174993:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304179.174998:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.175006:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.175021:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:1.0:1789304179.175025:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304179.175029:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.175035:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312952a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304179.476310:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785543296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304179.476392:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304179.479419:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785543296 00000100:00100000:3.0:1789304179.479435:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785543296 00000100:00100000:0.0:1789304179.479585:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1789304179.479597:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785543296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304179.479641:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304179.479734:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785543296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (3342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304179.479742:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1789304179.479815:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785543296:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304179.479954:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304179.562255:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304179.562303:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304179.562340:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304179.562365:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304179.562393:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765448064 00000100:00100000:1.0:1789304179.562405:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765448064 00000100:00100000:0.0:1789304179.562408:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765447808 00000100:00100000:0.0:1789304179.562415:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765447808 00000100:00100000:1.0:1789304179.562465:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765448192 00000100:00100000:1.0:1789304179.562469:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765448192 00000100:00100000:1.0:1789304179.562495:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 808 00000100:00100000:1.0:1789304179.562505:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765448064:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304179.562596:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765448064:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304179.562606:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 808 00000100:00100000:0.0:1789304179.562611:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 975 00000100:00100000:1.0:1789304179.562635:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 809 00000100:00100000:0.0:1789304179.562637:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765447808:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304179.562647:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765448192:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304179.562678:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765447808:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 57us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304179.562684:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765448192:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304179.562690:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765447936 00000100:00100000:0.0:1789304179.562693:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 975 00000100:00100000:3.0:1789304179.562696:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765447936 00000100:00100000:1.0:1789304179.562696:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 809 00000100:00080000:1.0:1789304179.562724:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304179.562729:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304179.562734:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1131 00000100:00100000:3.0:1789304179.562745:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765447936:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304179.562786:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765447936:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 44us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304179.562794:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1131 00000020:00000080:3.0:1789304179.874909:0:70075:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff5df9c2c0 20000000:00000080:3.0:1789304179.874930:0:70075:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b01fb2000 uarg=0000000000000000 00010000:00010000:3.0:1789304179.875851:0:70075:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789304179.875868:0:70075:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789304179.875881:0:70075:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304179.875899:0:70075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304179.875916:0:70075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231295293 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129528c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304179.875924:0:70075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304179.875963:0:70075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231295293 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129528c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304179.875977:0:70075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231295293 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129528c expref: 18 pid: 5846 timeout: 1779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304179.876052:0:70075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70075:1876219785543424:0@lo:104: 00000100:00100000:3.0:1789304179.876227:0:70075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304179.876330:0:70075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f709e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789304179.876431:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785543424 00000100:00100000:2.0:1789304179.876439:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785543424 00000100:00100000:2.0:1789304179.876600:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789304179.876611:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:70075:x1876219785543424:12345-0@lo:104: 00010000:00010000:2.0:1789304179.876625:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304179.876690:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304179.876696:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:70075:x1876219785543424:12345-0@lo:104: Request processed in 87us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304179.876702:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789304179.876765:0:70075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70075:1876219785543424:0@lo:104: 00010000:00010000:3.0:1789304179.876782:0:70075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.876830:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304179.876837:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.876844:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304179.876848:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.876856:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304179.876863:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304179.876868:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304179.876906:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.876912:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304179.876938:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.876944:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129528c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295293 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.876961:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304179.876963:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304179.876964:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304179.876975:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785543552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304179.877018:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304179.877058:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785543552 00000100:00100000:1.0:1789304179.877061:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785543552 00010000:00010000:1.0:1789304179.877080:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231295293 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129528c expref: 19 pid: 5846 timeout: 1779 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304179.877127:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789304179.877134:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785543552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304179.877145:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304179.877150:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231295293 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129528c expref: 19 pid: 5846 timeout: 1779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877162:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231295293 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129528c expref: 19 pid: 5846 timeout: 1779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877173:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231295293 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129528c expref: 19 pid: 5846 timeout: 1779 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877185:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877192:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877207:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877213:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877220:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877226:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877232:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304179.877235:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877241:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877257:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304179.877266:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304179.877293:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785543552:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304179.877299:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789304179.877326:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785543552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304179.877408:0:70075:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304179.877415:0:70075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304179.877421:0:70075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312952af lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304180.057662:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304180.498284:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785543680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304180.498360:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304180.498597:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785543680 00000100:00100000:3.0:1789304180.498655:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785543680 00000100:00100000:3.0:1789304180.498811:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1789304180.498823:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785543680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304180.498861:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304180.498926:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785543680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304180.498934:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1789304180.498989:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785543680:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304180.500017:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304181.078168:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304181.139235:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304181.139243:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304181.139248:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304181.139295:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304181.139308:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304181.139322:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304181.139349:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785543808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304181.139420:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304181.139479:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c112d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789304181.139534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785543808 00000100:00100000:0.0:1789304181.139543:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785543808 00000100:00100000:0.0:1789304181.139606:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1789304181.139615:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785543808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304181.139629:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304181.139642:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312952bd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312952b6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304181.139665:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312952bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312952b6 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304181.139677:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312952bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312952b6 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304181.139686:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa400, rc 0) 00000100:00100000:0.0:1789304181.139738:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785543808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304181.139744:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1789304181.139827:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785543808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304181.139842:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304181.139850:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304181.139868:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304181.139872:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304181.139880:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304182.037860:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785543936:0@lo:400:kworker.0 00000100:00100000:2.0:1789304182.037938:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304182.038029:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785543936 00000100:00100000:3.0:1789304182.038038:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785543936 00000100:00100000:3.0:1789304182.038275:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1789304182.038286:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785543936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304182.041024:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785543936:12345-0@lo:400:kworker.0 Request processed in 2730us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304182.041039:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1789304182.043240:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785544320:0@lo:400:kworker.0 00000100:00100000:1.0:1789304182.043322:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304182.043368:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304182.043375:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785544448:0@lo:400:kworker.0 00000100:00100000:1.0:1789304182.043398:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304182.043441:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785544320 00000100:00100000:1.0:1789304182.043450:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785544320 00000100:00100000:1.0:1789304182.043500:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785544448 00000100:00100000:1.0:1789304182.043503:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785544448 00000100:00100000:1.0:1789304182.043526:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1789304182.043535:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785544320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304182.043613:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785544320:12345-0@lo:400:kworker.0 Request processed in 78us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304182.043620:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1789304182.043638:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:1.0:1789304182.043644:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785544448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304182.044219:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785544448:12345-0@lo:400:kworker.0 Request processed in 574us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304182.044227:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00080000:1.0:1789304182.044251:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304182.044296:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785544448:0@lo:400:kworker.0 00000100:00100000:1.0:1789304182.044307:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785544320:0@lo:400:kworker.0 00000100:00100000:2.0:1789304182.044401:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785543936:0@lo:400:kworker.0 00000100:00100000:2.0:1789304182.044808:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785544064:0@lo:400:kworker.0 00000100:00100000:2.0:1789304182.044848:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304182.044919:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785544576:0@lo:400:kworker.0 00000100:00100000:2.0:1789304182.044946:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304182.044970:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304182.044977:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785544192:0@lo:400:kworker.0 00000100:00100000:2.0:1789304182.044999:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304182.047731:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785544576 00000100:00100000:0.0:1789304182.047747:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785544576 00000100:00100000:0.0:1789304182.047818:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785544192 00000100:00100000:0.0:1789304182.047821:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785544192 00000100:00100000:0.0:1789304182.047845:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:0.0:1789304182.047856:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785544576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304182.047942:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785544576:12345-0@lo:400:kworker.0 Request processed in 89us (2994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304182.047950:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:0.0:1789304182.047966:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:0.0:1789304182.047973:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785544192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304182.048001:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785544192:12345-0@lo:400:kworker.0 Request processed in 29us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304182.048007:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00080000:2.0:1789304182.048065:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304182.048070:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304182.048113:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785544192:0@lo:400:kworker.0 00000100:00100000:2.0:1789304182.048125:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785544576:0@lo:400:kworker.0 00000100:00100000:1.0:1789304182.053207:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785544064 00000100:00100000:1.0:1789304182.053224:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785544064 00000100:00100000:1.0:1789304182.053323:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1789304182.053334:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785544064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304182.054289:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785544064:12345-0@lo:400:kworker.0 Request processed in 952us (9434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304182.054300:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1789304182.055717:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785544064:0@lo:400:kworker.0 00010000:00010000:1.0:1789304182.101358:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304182.970812:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304182.973760:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765448320 00000100:00100000:1.0:1789304182.973773:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765448320 00000100:00100000:1.0:1789304182.974402:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 563 00000100:00100000:1.0:1789304182.974415:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:41069:x1876219765448320:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:1.0:1789304182.974437:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304182.974460:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb72312952c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100103 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.974544:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.974559:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.974573:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.974602:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312952d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.974610:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312952d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.974617:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312952d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.974985:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312952d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.974995:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312952d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975003:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312952d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304182.975027:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:1.0:1789304182.975031:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304182.975052:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312952d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975064:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975070:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975076:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975085:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304182.975118:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975127:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975139:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14adde00) 00010000:00010000:1.0:1789304182.975142:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304182.975148:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975154:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312952cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975166:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312952d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975172:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312952d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975178:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312952d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975184:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304182.975186:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312952d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975192:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312952d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975203:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c14add400) 00010000:00010000:1.0:1789304182.975205:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304182.975208:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312952d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975214:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb72312952d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975244:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb72312952c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100103 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975261:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312952d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100103 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304182.975269:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:1.0:1789304182.975272:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304182.975274:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e800, rc 0) 00000100:00100000:1.0:1789304182.975347:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41069:x1876219765448320:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 935us (4558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304182.975355:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 563 00000100:00100000:1.0:1789304182.982503:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:2.0:1789304182.982886:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304182.983158:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765448576 00000100:00100000:3.0:1789304182.983168:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765448576 00000100:00100000:3.0:1789304182.983222:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 564 00000100:00100000:3.0:1789304182.983231:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:41069:x1876219765448576:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304182.983252:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304182.983272:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312952e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610010a expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.983526:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312952e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.983556:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312952e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.983568:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312952e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.984555:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.984569:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.984695:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304182.985906:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12:0x0], index 0: 0 00010000:00010000:3.0:1789304182.987642:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312952f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987670:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312952f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987686:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312952f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987761:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312952e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987770:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312952e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987777:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312952e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987782:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304182.987787:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312952e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987794:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312952e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987808:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:3.0:1789304182.987811:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304182.987816:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312952e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987827:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312952e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304182.987844:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8873380 reply state 00000000e5464036 transno 4294967513 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304182.987854:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304182.987909:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312952e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610010a expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987930:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312952f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610010a expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.987938:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304182.987940:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304182.987943:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ea00, rc 0) 00000100:00100000:3.0:1789304182.988047:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:41069:x1876219765448576:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 4816us (5552us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1789304182.988056:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 564 00000100:00100000:0.0:1789304182.990265:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6711:1876219785544704:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789304182.990336:0:6711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304182.990391:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c038539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304182.990463:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785544704 00000100:00100000:1.0:1789304182.990474:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785544704 00000100:00100000:1.0:1789304182.990551:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789304182.990561:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:6711:x1876219785544704:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789304182.990752:0:17212:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1789304182.992944:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.992962:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.992971:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.992977:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304182.992983:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.992991:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.993011:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789304182.993014:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304182.993019:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304182.993026:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312952ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304182.995545:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304182.995958:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765448832 00000100:00100000:2.0:1789304182.995970:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765448832 00000100:00100000:2.0:1789304182.996027:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 565 00000100:00100000:2.0:1789304182.996038:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:41069:x1876219765448832:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:2.0:1789304182.996130:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304182.996161:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312952f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610010a expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304182.996181:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:2.0:1789304182.996191:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304182.996237:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304182.996251:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304182.996261:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304182.996386:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044681c51 reply state 00000000964dcc39 transno 4294967514 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304182.996396:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304182.996490:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:41069:x1876219765448832:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 454us (963us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789304182.996498:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 565 00000100:00100000:2.0:1789304182.998524:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:2.0:1789304182.998975:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304182.998990:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304182.999000:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304182.999007:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304182.999012:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304182.999021:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304182.999041:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304182.999044:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304182.999049:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304182.999056:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295303 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304182.999787:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765448960 00000100:00100000:2.0:1789304182.999871:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765448960 00000100:00100000:2.0:1789304183.000916:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 566 00000100:00100000:2.0:1789304183.000930:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:41069:x1876219765448960:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:2.0:1789304183.000957:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304183.000982:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129530a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100111 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.001055:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129530a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100111 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.001070:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129530a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100111 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.001114:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304183.001118:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789304183.001123:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789304183.001201:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:41069:x1876219765448960:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 274us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304183.001208:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 566 00000100:00100000:2.0:1789304183.012537:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304183.012720:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765449088 00000100:00100000:0.0:1789304183.012734:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765449088 00000100:00080000:3.0:1789304183.012877:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304183.012936:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 298 00000100:00100000:0.0:1789304183.012948:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765449088:12345-192.168.202.29@tcp:2:touch.60003 00000100:00100000:0.0:1789304183.014758:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765449088:12345-192.168.202.29@tcp:2:touch.60003 Request processed in 1802us (2232us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789304183.014772:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 298 00000100:00100000:2.0:1789304183.022738:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304183.023556:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:6711:x1876219785544704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 32992us (33216us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789304183.023568:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789304183.023928:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765449344 00000100:00100000:3.0:1789304183.023939:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765449344 00000100:00100000:3.0:1789304183.023986:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 60 00000100:00100000:3.0:1789304183.023997:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:41069:x1876219765449344:12345-192.168.202.29@tcp:35:touch.60003 00000100:00100000:3.0:1789304183.024333:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:41069:x1876219765449344:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 336us (1602us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789304183.024340:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 60 00000100:00100000:1.0:1789304183.026370:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6711:1876219785544704:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789304183.026390:0:6711:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x12:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:2.0:1789304183.071045:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304183.071356:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765449472 00000100:00100000:3.0:1789304183.071366:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765449472 00000100:00100000:0.0:1789304183.071717:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 567 00000100:00100000:0.0:1789304183.071730:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:41073:x1876219765449472:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:0.0:1789304183.071757:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304183.071779:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295311 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100118 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.071859:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295318 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.071878:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295318 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.071889:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295318 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.071905:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129531f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.071911:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129531f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.071917:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129531f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072014:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072024:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072031:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304183.072070:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2f:0x0]: returning size 0 00000004:00200000:0.0:1789304183.072075:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304183.072133:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072145:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072157:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295318 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072163:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295318 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072170:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295318 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072175:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304183.072180:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295318 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072187:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295318 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072198:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:0.0:1789304183.072201:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304183.072205:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295318 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072212:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295318 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072225:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129531f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072230:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129531f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072235:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129531f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072240:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304183.072243:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129531f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072248:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129531f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072253:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c0558d300) 00010000:00010000:0.0:1789304183.072255:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304183.072258:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129531f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072264:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129531f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072290:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295311 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100118 expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072302:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295326 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100118 expref: 11 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.072309:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:0.0:1789304183.072311:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304183.072314:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa600, rc 0) 00000100:00100000:0.0:1789304183.072375:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:41073:x1876219765449472:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 648us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304183.072383:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 567 00000100:00100000:2.0:1789304183.075018:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304183.075233:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765449600 00000100:00100000:0.0:1789304183.075245:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765449600 00000100:00100000:0.0:1789304183.075296:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 299 00000100:00100000:0.0:1789304183.075305:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765449600:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:0.0:1789304183.075325:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304183.075344:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb723129532d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610011f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304183.075383:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x6aa69d77, atime: 0x6aa69d77, ctime: 0x6aa69d77, blocks: 0x1 00010000:00010000:0.0:1789304183.075402:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=1632s v=(0 0) 00010000:00010000:0.0:1789304183.075406:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304183.075415:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb723129532d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610011f expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.075432:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb723129532d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610011f expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304183.075445:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789304183.075506:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765449600:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 202us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304183.075515:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 299 00000100:00100000:1.0:1789304183.084070:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304183.084355:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765449856 00000100:00100000:3.0:1789304183.084366:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765449856 00000100:00100000:2.0:1789304183.084573:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 568 00000100:00100000:2.0:1789304183.084586:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:41073:x1876219765449856:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:2.0:1789304183.084646:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304183.084677:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295326 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100118 expref: 11 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.084703:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129530a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100111 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.084714:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304183.084727:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304183.084754:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295334 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.084771:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295334 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.084783:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295334 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.084871:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.084880:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.084887:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.085004:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295342 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.085012:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295342 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.085019:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295342 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304183.086556:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 64 off9344 00000004:00080000:2.0:1789304183.086569:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1632764477882ns, next at 1633764475287ns, rc = 0 00010000:00010000:2.0:1789304183.086753:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086767:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086778:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086790:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086797:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086803:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086876:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304183.086904:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295342 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086912:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295342 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086918:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295342 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086923:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304183.086928:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295342 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086935:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295342 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086947:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9e2c421d2300) 00010000:00010000:2.0:1789304183.086950:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304183.086954:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295342 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086965:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295342 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086984:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295334 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086990:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295334 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.086996:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295334 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.087000:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304183.087003:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295334 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.087009:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295334 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.087017:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:2.0:1789304183.087019:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304183.087021:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295334 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304183.087027:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295334 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304183.087037:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd076729 reply state 00000000d656aae2 transno 4294967516 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304183.087045:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304183.087133:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:41073:x1876219765449856:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 2548us (3072us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789304183.087142:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 568 00010000:00010000:1.0:1789304183.087685:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304183.087693:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304183.087699:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304183.087703:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304183.087710:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304183.087720:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9e2c421d2300) 00010000:00010000:1.0:1789304183.087723:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304183.087726:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304183.087731:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295349 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304183.087749:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304183.087751:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304183.087752:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304183.090081:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304183.090143:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304183.090152:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304183.090158:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304183.090163:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304183.090171:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304183.090188:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c421d2d00) 00010000:00010000:3.0:1789304183.090191:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304183.090196:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304183.090202:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129533b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304183.124908:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304184.154251:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304184.595829:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304184.595857:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785544832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304184.595934:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304184.597170:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785544832 00000100:00100000:2.0:1789304184.597185:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785544832 00000100:00100000:2.0:1789304184.597261:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1789304184.597272:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785544832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304184.597313:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304184.597391:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785544832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304184.597399:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00080000:2.0:1789304184.597426:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304184.597471:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785544832:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789304184.656611:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000004:00080000:1.0:1789304184.656623:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 45 committed 00000100:00100000:0.0:1789304184.656915:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785544960:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789304184.657442:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304184.658066:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785544960 00000100:00100000:0.0:1789304184.658075:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785544960 00000100:00100000:0.0:1789304184.658162:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789304184.658173:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785544960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789304184.658264:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:18 count 1 00010000:00010000:0.0:1789304184.658292:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304184.658315:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb723129532d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610011f expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304184.658324:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789304184.658328:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304184.658332:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304184.658362:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb723129532d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610011f expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304184.658625:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb723129532d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610011f expref: 6 pid: 6692 timeout: 1734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304184.658641:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876219785545088:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304184.659059:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05b6a000 going to sleep for 11 seconds 00000100:00080000:2.0:1789304184.661143:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304184.668552:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304184.668622:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876219785545088:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789304184.668659:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304184.669066:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765449984 00000100:00100000:3.0:1789304184.669076:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765449984 00010000:00010000:3.0:1789304184.669138:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb723129532d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610011f expref: 7 pid: 6692 timeout: 1734 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304184.669172:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 321 00000100:00100000:3.0:1789304184.669182:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765449984:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789304184.669197:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304184.669205:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb723129532d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610011f expref: 7 pid: 6692 timeout: 1734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304184.669218:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb723129532d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610011f expref: 7 pid: 6692 timeout: 1734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304184.669242:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb723129532d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610011f expref: 7 pid: 6692 timeout: 1734 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304184.669256:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304184.669261:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304184.669266:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304184.669276:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304184.669302:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304184.672189:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304184.672216:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304184.672229:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304184.672236:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304184.672264:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789304184.672594:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1876219785544960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14416us (15147us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789304184.672603:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00010000:1.0:1789304184.672746:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304184.672755:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304184.672772:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304184.672776:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304184.672787:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304184.672804:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304184.672811:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231295350 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304184.672830:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304184.672831:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304184.672833:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304184.673780:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765449984:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 4593us (5231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304184.673792:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 321 00000004:00080000:3.0:1789304184.673864:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c411e7b80/2, rc 0, transno 4294967333 00000100:00100000:3.0:1789304184.673871:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785544960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304184.674374:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304184.674482:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304184.674501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304184.674532:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765450368 00000100:00100000:0.0:1789304184.674540:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765450368 00000100:00100000:3.0:1789304184.675756:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765450240 00000100:00100000:3.0:1789304184.675766:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765450240 00000100:00100000:3.0:1789304184.675917:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1135 00000100:00100000:3.0:1789304184.675938:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765450240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304184.676171:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765450240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 234us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304184.676180:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1135 00000100:00100000:3.0:1789304184.676206:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765450112 00000100:00100000:3.0:1789304184.676211:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765450112 00000100:00100000:3.0:1789304184.676238:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 978 00000100:00100000:3.0:1789304184.676244:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765450112:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304184.676271:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765450112:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304184.676276:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 978 00000100:00080000:2.0:1789304184.677908:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304184.677918:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304184.677999:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 812 00000100:00100000:2.0:1789304184.678013:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765450368:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304184.678071:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765450368:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 63us (3567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304184.678077:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 812 00000020:00000080:2.0:1789304184.757239:0:70319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc1ad58f0 20000000:00000080:2.0:1789304184.757254:0:70319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3fb8c000 uarg=0000000000000000 00010000:00010000:2.0:1789304184.757936:0:70319:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789304184.757984:0:70319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:2.0:1789304184.757989:0:70319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304184.758001:0:70319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312952d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100103 expref: 5 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.758026:0:70319:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789304184.758043:0:70319:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304184.758058:0:70319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.758072:0:70319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312952bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312952b6 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.758080:0:70319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.758153:0:70319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312952bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312952b6 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.758170:0:70319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312952bd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312952b6 expref: 18 pid: 5847 timeout: 1784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304184.758183:0:70319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70319:1876219785545216:0@lo:104: 00000100:00100000:2.0:1789304184.758246:0:70319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304184.758304:0:70319:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789304184.759884:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785545216 00000100:00100000:3.0:1789304184.759900:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785545216 00000100:00100000:3.0:1789304184.759962:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789304184.759972:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:70319:x1876219785545216:12345-0@lo:104: 00010000:00010000:3.0:1789304184.759988:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304184.760116:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304184.760122:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:70319:x1876219785545216:12345-0@lo:104: Request processed in 152us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304184.760128:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00010000:00010000:1.0:1789304184.760323:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304184.760331:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304184.760338:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304184.760342:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304184.760351:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304184.760698:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304184.760706:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:2.0:1789304184.760740:0:70319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70319:1876219785545216:0@lo:104: 00010000:00010000:1.0:1789304184.760753:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304184.760759:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304184.760764:0:70319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304184.760812:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785545344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304184.760856:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304184.760934:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785545344 00000100:00100000:2.0:1789304184.760939:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785545344 00010000:00010000:2.0:1789304184.760976:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312952bd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312952b6 expref: 19 pid: 5847 timeout: 1784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304184.761004:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789304184.761011:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785545344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304184.761022:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304184.761027:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312952bd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312952b6 expref: 19 pid: 5847 timeout: 1784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761036:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312952bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312952b6 expref: 19 pid: 5847 timeout: 1784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761050:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312952bd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312952b6 expref: 19 pid: 5847 timeout: 1784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761065:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761072:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761087:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761111:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761118:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761125:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761131:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304184.761135:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761143:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761157:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.761166:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304184.761660:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304184.761669:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb72312952b6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312952bd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304184.761686:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304184.761688:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304184.761690:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304184.767886:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785545344:12345-0@lo:103:ldlm_bl.0 Request processed in 6864us (7017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304184.767901:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:2.0:1789304184.767965:0:70319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.767977:0:70319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304184.767984:0:70319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231295357 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304184.770217:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785545344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304185.179482:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304185.212985:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967333 is committed 00000001:00080000:0.0:1789304185.212999:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00000100:00100000:2.0:1789304185.621560:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785545472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304185.621636:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304185.621966:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785545472 00000100:00100000:0.0:1789304185.621975:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785545472 00000100:00100000:0.0:1789304185.622050:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:0.0:1789304185.622061:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785545472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304185.622124:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304185.622176:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785545472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304185.622183:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:2.0:1789304185.622500:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:2.0:1789304185.622530:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c411e7b80, transno 4294967333 00000100:00100000:2.0:1789304185.622555:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785545472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304186.195283:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304186.450243:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304186.450253:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304186.450258:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304186.450320:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304186.450338:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304186.450349:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304186.450558:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785545600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304186.450640:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304186.450696:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c371b2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789304186.453242:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785545600 00000100:00100000:0.0:1789304186.453256:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785545600 00000100:00100000:0.0:1789304186.453315:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1789304186.453326:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785545600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304186.453347:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304186.453368:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295365 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129535e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304186.453398:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295365 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129535e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304186.453409:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295365 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129535e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304186.453419:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa600, rc 0) 00000100:00100000:0.0:1789304186.453520:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785545600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304186.453526:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1789304186.453555:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785545600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304186.453577:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304186.453587:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304186.453609:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304186.453615:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304186.453623:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304187.154541:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785545856:0@lo:400:kworker.0 00000100:00100000:0.0:1789304187.154608:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304187.154668:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304187.154674:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785545984:0@lo:400:kworker.0 00000100:00100000:0.0:1789304187.154698:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304187.154729:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785545984 00000100:00100000:0.0:1789304187.154736:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785545984 00000100:00100000:0.0:1789304187.154786:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1789304187.154796:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785545984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304187.154839:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785545984:12345-0@lo:400:kworker.0 Request processed in 46us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304187.154846:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00080000:0.0:1789304187.154866:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304187.154894:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785545984:0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.154963:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785546112:0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.154991:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304187.155019:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789304187.155024:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785545728:0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.155043:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304187.155057:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785546240:0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.155073:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304187.155115:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785546112 00000100:00100000:3.0:1789304187.155118:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785546112 00000100:00100000:3.0:1789304187.155145:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785545728 00000100:00100000:3.0:1789304187.155147:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785545728 00000100:00100000:3.0:1789304187.155160:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1789304187.155166:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785546112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.155200:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785546112:12345-0@lo:400:kworker.0 Request processed in 34us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304187.155206:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:3.0:1789304187.155217:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1789304187.155222:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785545728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.155244:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785545728:12345-0@lo:400:kworker.0 Request processed in 23us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304187.155250:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1789304187.155265:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785545856 00000100:00100000:3.0:1789304187.155268:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785545856 00000100:00100000:3.0:1789304187.155290:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785546240 00000100:00100000:3.0:1789304187.155292:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785546240 00000100:00100000:3.0:1789304187.155306:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:3.0:1789304187.155311:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785545856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.155339:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785545856:12345-0@lo:400:kworker.0 Request processed in 28us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304187.155345:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:3.0:1789304187.155353:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1789304187.155358:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785546240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.155379:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785546240:12345-0@lo:400:kworker.0 Request processed in 21us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304187.155384:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00080000:3.0:1789304187.155403:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304187.155405:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304187.155407:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304187.155422:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785545728:0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.155429:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785546240:0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.155436:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785546112:0@lo:400:kworker.0 00000100:00100000:3.0:1789304187.155462:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785545856:0@lo:400:kworker.0 00010000:00010000:1.0:1789304187.219332:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304187.806980:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304187.807076:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765450496 00000100:00100000:3.0:1789304187.807086:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765450496 00000100:00100000:3.0:1789304187.807162:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 569 00000100:00100000:3.0:1789304187.807169:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41165:x1876219765450496:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304187.807188:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304187.807209:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129536c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100126 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304187.807274:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295373 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304187.807286:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304187.807295:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304187.807326:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:3.0:1789304187.807328:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304187.807342:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295373 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304187.807361:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129536c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100126 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304187.807379:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295373 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100126 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304187.807387:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304187.807390:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304187.807394:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f000, rc 0) 00000100:00100000:3.0:1789304187.807450:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:41165:x1876219765450496:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 280us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304187.807457:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 569 00000100:00080000:2.0:1789304187.807733:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304187.810723:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304187.810844:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765450752 00000100:00100000:1.0:1789304187.810857:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765450752 00000100:00100000:1.0:1789304187.810916:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 570 00000100:00100000:1.0:1789304187.810924:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:41165:x1876219765450752:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789304187.810973:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304187.810998:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295373 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100126 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304187.811022:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312952d9) 00010000:00010000:1.0:1789304187.811026:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:1.0:1789304187.811036:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304187.811059:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304187.811071:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304187.811081:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789304187.871856:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000004:00010000:1.0:1789304187.873392:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000646fda86 reply state 0000000077fcc11d transno 4294967517 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304187.873410:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304187.873434:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00080000:1.0:1789304187.873810:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789304187.873831:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:41165:x1876219765450752:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 62904us (63113us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789304187.873841:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 570 00010000:00010000:1.0:1789304187.873877:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304187.873887:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304187.873895:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304187.873906:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304187.873911:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304187.873921:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304187.873938:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14adde00) 00010000:00010000:1.0:1789304187.873942:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304187.873947:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304187.873953:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129537a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.242274:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304188.672901:0:70516:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcef61c090 20000000:00000080:1.0:1789304188.672921:0:70516:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c40f3a400 uarg=0000000000000000 00010000:00010000:0.0:1789304188.676958:0:70516:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304188.677038:0:70516:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304188.677057:0:70516:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304188.677077:0:70516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304188.677746:0:70516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295365 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129535e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304188.677759:0:70516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304188.677880:0:70516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295365 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129535e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304188.677896:0:70516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295365 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129535e expref: 18 pid: 5847 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304188.677910:0:70516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70516:1876219785546368:0@lo:104: 00000100:00100000:0.0:1789304188.678044:0:70516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304188.678182:0:70516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c08b2de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789304188.678371:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785546368 00000100:00100000:2.0:1789304188.678380:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785546368 00000100:00100000:2.0:1789304188.678489:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789304188.678500:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:70516:x1876219785546368:12345-0@lo:104: 00010000:00010000:2.0:1789304188.678513:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304188.678630:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304188.678636:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:70516:x1876219785546368:12345-0@lo:104: Request processed in 139us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304188.678643:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789304188.678710:0:70516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70516:1876219785546368:0@lo:104: 00010000:00010000:0.0:1789304188.678732:0:70516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.678980:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304188.678989:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.678997:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304188.679002:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.679011:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304188.679018:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304188.679023:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304188.679062:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.679069:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789304188.679122:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785546496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304188.679161:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789304188.679356:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.679364:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb723129535e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295365 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.679381:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304188.679383:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304188.679384:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304188.681025:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785546496 00000100:00100000:1.0:1789304188.681039:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785546496 00010000:00010000:1.0:1789304188.681078:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295365 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129535e expref: 19 pid: 5847 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304188.681143:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789304188.681151:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785546496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304188.681166:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304188.681171:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295365 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129535e expref: 19 pid: 5847 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681715:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295365 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129535e expref: 19 pid: 5847 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681739:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295365 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129535e expref: 19 pid: 5847 timeout: 1788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681754:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681762:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681781:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681789:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681796:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681803:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681820:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304188.681823:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681830:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681852:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304188.681863:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304188.681990:0:70516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304188.681999:0:70516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304188.682005:0:70516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295381 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304188.684393:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785546496:12345-0@lo:103:ldlm_bl.0 Request processed in 3233us (5221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304188.684407:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789304188.687383:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785546496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304189.271033:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304189.715612:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304189.715637:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785546624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304189.715712:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304189.717338:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785546624 00000100:00100000:3.0:1789304189.717353:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785546624 00000100:00080000:0.0:1789304189.717416:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304189.717431:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1789304189.717441:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785546624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304189.717536:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304189.717630:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02ed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785546624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304189.717637:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:0.0:1789304189.717658:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785546624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304189.793405:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304189.793443:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304189.793443:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765450880 00000100:00100000:1.0:1789304189.793453:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765450880 00000100:00100000:3.0:1789304189.793482:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304189.793508:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304189.793527:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765451136 00000100:00100000:3.0:1789304189.793530:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765451136 00000100:00100000:1.0:1789304189.793530:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 980 00000100:00100000:1.0:1789304189.793540:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765450880:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304189.793566:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765451264 00000100:00100000:3.0:1789304189.793568:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765451264 00000100:00100000:3.0:1789304189.793589:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 815 00000100:00100000:3.0:1789304189.793608:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765451136:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304189.793619:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765450880:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304189.793628:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 980 00000100:00100000:3.0:1789304189.793637:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765451136:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304189.793643:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 815 00000100:00100000:3.0:1789304189.793654:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 816 00000100:00100000:3.0:1789304189.793659:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765451264:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304189.793683:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765451264:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304189.793688:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 816 00000100:00100000:3.0:1789304189.793706:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765451008 00000100:00100000:3.0:1789304189.793710:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765451008 00000100:00100000:3.0:1789304189.793737:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1139 00000100:00100000:3.0:1789304189.793744:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765451008:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304189.793786:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765451008:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 42us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304189.793801:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1139 00000100:00080000:3.0:1789304189.793822:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789304189.793827:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304189.793829:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1789304190.163530:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304190.163538:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304190.163544:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304190.163592:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304190.163605:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304190.163617:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304190.163641:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785546752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304190.163707:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304190.163761:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c08b2d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789304190.163963:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785546752 00000100:00100000:3.0:1789304190.163973:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785546752 00000100:00100000:3.0:1789304190.164027:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1789304190.164037:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785546752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304190.164051:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304190.164064:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129538f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295388 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304190.164117:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129538f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295388 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304190.164128:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129538f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295388 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304190.164147:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304190.164194:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785546752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304190.164201:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1789304190.164798:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785546752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304190.164816:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304190.164825:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304190.164848:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304190.164853:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304190.164861:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304190.294601:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304190.741520:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785546880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304190.741592:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304190.741634:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785546880 00000100:00100000:3.0:1789304190.741645:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785546880 00000100:00100000:3.0:1789304190.741789:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1789304190.741798:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785546880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304190.741835:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304190.742019:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785546880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304190.742027:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00080000:0.0:1789304190.742124:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304190.742157:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41372d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785546880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304191.315325:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304191.428569:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304191.436340:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765451392 00000100:00100000:1.0:1789304191.436356:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765451392 00000100:00100000:1.0:1789304191.436435:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 571 00000100:00100000:1.0:1789304191.436446:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:41241:x1876219765451392:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:1.0:1789304191.436481:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1789304191.436485:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304191.436505:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295396 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610012d expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.436576:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb723129539d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.436591:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb723129539d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.436605:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb723129539d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.436622:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312953a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.436629:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312953a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.436636:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312953a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.441900:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.441922:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.441936:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304191.441988:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:1.0:1789304191.441993:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304191.442015:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.442029:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb723129539d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.442036:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb723129539d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.442043:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb723129539d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.442054:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304191.442059:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb723129539d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.442067:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb723129539d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443172:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:1.0:1789304191.443178:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304191.443185:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb723129539d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443193:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb723129539d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443208:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312953a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443215:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312953a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443316:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312953a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443324:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304191.443328:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312953a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443335:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312953a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443350:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c14add700) 00010000:00010000:1.0:1789304191.443352:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304191.443355:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312953a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443361:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312953a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443402:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295396 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610012d expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443417:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610012d expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304191.443425:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:1.0:1789304191.443427:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304191.443430:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ea00, rc 0) 00000100:00100000:1.0:1789304191.443521:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41372a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41241:x1876219765451392:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 7076us (14960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304191.443531:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 571 00000100:00100000:3.0:1789304192.279454:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41371c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785547392:0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.279527:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304192.279588:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789304192.279594:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785547008:0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.279623:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304192.279649:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785547520:0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.279671:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304192.279701:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785547136:0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.279721:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304192.279737:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785547648:0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.279758:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304192.279776:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304192.279781:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785547264:0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.279801:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304192.279828:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785547392 00000100:00100000:3.0:1789304192.279835:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785547392 00000100:00100000:3.0:1789304192.279886:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785547520 00000100:00100000:3.0:1789304192.279889:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785547520 00000100:00100000:3.0:1789304192.279910:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785547136 00000100:00100000:3.0:1789304192.279913:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785547136 00000100:00100000:3.0:1789304192.279927:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1789304192.279935:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785547392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.279988:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41372680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785547392:12345-0@lo:400:kworker.0 Request processed in 53us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304192.279996:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1789304192.280013:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1789304192.280019:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785547520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.280045:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41373100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785547520:12345-0@lo:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304192.280050:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1789304192.280060:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1789304192.280065:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785547136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.280115:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41370380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785547136:12345-0@lo:400:kworker.0 Request processed in 50us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304192.280120:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1789304192.280141:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785547648 00000100:00100000:3.0:1789304192.280144:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785547648 00000100:00100000:3.0:1789304192.280165:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785547264 00000100:00100000:3.0:1789304192.280167:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785547264 00000100:00100000:3.0:1789304192.280183:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:3.0:1789304192.280188:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785547648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.280215:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41372d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785547648:12345-0@lo:400:kworker.0 Request processed in 27us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304192.280221:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:3.0:1789304192.280231:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1789304192.280237:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785547264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.280261:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785547264:12345-0@lo:400:kworker.0 Request processed in 25us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304192.280266:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1789304192.280309:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785547264:0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.280318:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785547136:0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.280325:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785547648:0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.280348:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785547520:0@lo:400:kworker.0 00000100:00100000:3.0:1789304192.280356:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785547392:0@lo:400:kworker.0 00000100:00100000:1.0:1789304192.280582:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785547008 00000100:00100000:1.0:1789304192.280587:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785547008 00000100:00100000:1.0:1789304192.280624:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1789304192.280631:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785547008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304192.280672:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785547008:12345-0@lo:400:kworker.0 Request processed in 43us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304192.280678:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1789304192.280715:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41370700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785547008:0@lo:400:kworker.0 00000100:00080000:2.0:1789304192.281540:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304192.281546:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304192.281548:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304192.339330:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304192.914980:0:70761:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0f01cad0 20000000:00000080:2.0:1789304192.915003:0:70761:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c4126f000 uarg=0000000000000000 00010000:00010000:2.0:1789304192.915478:0:70761:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789304192.915513:0:70761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:2.0:1789304192.915517:0:70761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304192.915529:0:70761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610012d expref: 5 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304192.915555:0:70761:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789304192.915572:0:70761:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304192.915587:0:70761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304192.915606:0:70761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129538f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295388 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304192.915613:0:70761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304192.915651:0:70761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129538f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295388 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304192.915666:0:70761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129538f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295388 expref: 18 pid: 5847 timeout: 1792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304192.915680:0:70761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70761:1876219785547776:0@lo:104: 00000100:00100000:2.0:1789304192.915745:0:70761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304192.915852:0:70761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03f4acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304192.915901:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785547776 00000100:00100000:0.0:1789304192.915910:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785547776 00000100:00100000:0.0:1789304192.916005:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789304192.916016:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:70761:x1876219785547776:12345-0@lo:104: 00010000:00010000:0.0:1789304192.916029:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304192.916124:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304192.916130:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:70761:x1876219785547776:12345-0@lo:104: Request processed in 118us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304192.916139:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00010000:00010000:1.0:1789304192.916206:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304192.916213:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916221:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304192.916225:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916234:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304192.916242:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304192.916248:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304192.916277:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916283:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304192.916319:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916326:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231295388 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129538f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916340:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304192.916342:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304192.916344:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304192.916486:0:70761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70761:1876219785547776:0@lo:104: 00010000:00010000:2.0:1789304192.916505:0:70761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304192.916569:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785547904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304192.916604:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304192.916685:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785547904 00000100:00100000:1.0:1789304192.916690:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785547904 00010000:00010000:1.0:1789304192.916711:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129538f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295388 expref: 19 pid: 5847 timeout: 1792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304192.916770:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789304192.916777:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785547904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304192.916787:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304192.916791:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129538f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295388 expref: 19 pid: 5847 timeout: 1792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916801:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129538f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295388 expref: 19 pid: 5847 timeout: 1792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916811:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129538f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295388 expref: 19 pid: 5847 timeout: 1792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916822:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916830:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916842:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916849:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916856:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916867:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916873:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304192.916877:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916884:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916907:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304192.916915:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304192.916943:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785547904:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304192.916949:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789304192.917044:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785547904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304192.917063:0:70761:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304192.917070:0:70761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304192.917076:0:70761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312953b2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304193.365311:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304194.386453:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304194.387213:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304194.387218:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304194.387223:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304194.387264:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304194.387274:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304194.387286:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304194.387313:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785548032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304194.387379:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304194.387452:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c19aaa240 going to sleep for 11 seconds 00000100:00100000:1.0:1789304194.387508:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785548032 00000100:00100000:1.0:1789304194.387516:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785548032 00000100:00100000:1.0:1789304194.387582:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1789304194.387593:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785548032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304194.387607:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304194.387620:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e000/0xefc0bb72312953c0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312953b9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304194.387642:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e000/0xefc0bb72312953c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312953b9 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304194.387657:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb72312953c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312953b9 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304194.387666:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e000, rc 0) 00000100:00100000:1.0:1789304194.387716:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785548032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304194.387722:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1789304194.387795:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785548032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304194.387813:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304194.387823:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304194.387840:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304194.387845:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304194.387852:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304194.839619:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785548160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304194.839686:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304194.839799:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785548160 00000100:00100000:3.0:1789304194.839808:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785548160 00000100:00100000:3.0:1789304194.839925:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1789304194.839934:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785548160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304194.839968:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304194.840013:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785548160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304194.840020:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00080000:1.0:1789304194.840067:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304194.840121:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785548160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304194.917896:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304194.917945:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304194.917988:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304194.918002:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765451776 00000100:00100000:1.0:1789304194.918011:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765451648 00000100:00100000:2.0:1789304194.918013:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765451776 00000100:00100000:1.0:1789304194.918014:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765451648 00000100:00100000:2.0:1789304194.918083:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 819 00000100:00100000:2.0:1789304194.918169:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765451776:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304194.918235:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765451776:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304194.918242:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 819 00000100:00100000:3.0:1789304194.922797:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765451520 00000100:00100000:3.0:1789304194.922811:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765451520 00000100:00100000:3.0:1789304194.922989:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 984 00000100:00100000:3.0:1789304194.923001:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765451520:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304194.923078:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765451520:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (5198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304194.923086:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 984 00000100:00100000:2.0:1789304194.924919:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304194.925012:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765451904 00000100:00100000:3.0:1789304194.925022:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765451904 00000100:00100000:1.0:1789304194.925685:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1143 00000100:00100000:1.0:1789304194.925698:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765451648:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304194.925776:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765451648:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (7787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304194.925783:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1143 00000100:00080000:1.0:1789304194.925808:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304194.925813:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304194.925816:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304194.930108:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 301 00000100:00100000:2.0:1789304194.930135:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765451904:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:2.0:1789304194.930177:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231295215 00000100:00080000:2.0:1789304194.930187:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2c20271000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789304194.930232:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967330 00010000:00010000:1.0:1789304194.930280:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304194.931325:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765451904:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 1197us (6408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304194.931335:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 301 00000001:00100000:1.0:1789304195.401937:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304195.401945:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2c20276000/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:2.0:1789304195.402037:0:490:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c20276000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:2.0:1789304195.402788:0:490:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c20271000 for lustre-OST0001 00010000:00010000:2.0:1789304195.410294:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304195.592741:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304195.592809:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765452032 00000100:00100000:3.0:1789304195.592818:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765452032 00000100:00100000:3.0:1789304195.592917:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 572 00000100:00100000:3.0:1789304195.592925:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:41332:x1876219765452032:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304195.592944:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304195.592964:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312953c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100134 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304195.593020:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312953ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304195.593030:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312953ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304195.593039:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312953ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304195.593068:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:3.0:1789304195.593070:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304195.593125:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312953ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304195.593151:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312953c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100134 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304195.593175:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312953ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100134 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304195.593184:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304195.593186:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304195.593190:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789304195.593249:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:41332:x1876219765452032:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 324us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304195.593256:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 572 00000100:00100000:0.0:1789304195.595967:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304195.596025:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765452288 00000100:00100000:1.0:1789304195.596033:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765452288 00000100:00100000:1.0:1789304195.596232:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 573 00000100:00100000:1.0:1789304195.596244:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41332:x1876219765452288:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789304195.596297:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304195.596325:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312953ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100134 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304195.596342:0:7654:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312953ab) 00010000:00010000:1.0:1789304195.596346:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:1.0:1789304195.596355:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304195.596378:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304195.596388:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304195.596395:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304195.596695:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000023408a8 reply state 0000000041e2d8c2 transno 4294967518 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304195.596702:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304195.596708:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000100:00100000:1.0:1789304195.596774:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:41332:x1876219765452288:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 532us (813us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789304195.596781:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 573 00010000:00010000:2.0:1789304195.599596:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304195.599614:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304195.599622:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304195.599627:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304195.599632:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304195.599639:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304195.599655:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:2.0:1789304195.599667:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789304195.599673:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304195.599679:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312953d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304195.872642:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785548288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304195.873437:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304195.873784:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785548288 00000100:00100000:3.0:1789304195.874031:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785548288 00000100:00080000:1.0:1789304195.874289:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304195.875868:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1789304195.875956:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785548288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304195.876004:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304195.876116:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785548288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 229us (2763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304195.876123:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1789304195.877044:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785548288:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1789304196.351470:0:70959:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3951e790 20000000:00000080:3.0:1789304196.351488:0:70959:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854c000 uarg=0000000000000000 00010000:00010000:3.0:1789304196.351986:0:70959:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789304196.352002:0:70959:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789304196.352015:0:70959:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304196.352033:0:70959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304196.352051:0:70959:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb72312953c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312953b9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304196.352060:0:70959:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304196.352352:0:70959:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8e000/0xefc0bb72312953c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312953b9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304196.352366:0:70959:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb72312953c0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312953b9 expref: 18 pid: 5846 timeout: 1796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304196.352383:0:70959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70959:1876219785548416:0@lo:104: 00000100:00100000:3.0:1789304196.352473:0:70959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304196.352569:0:70959:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789304196.352644:0:52683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789304196.352657:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785548416 00000100:00100000:2.0:1789304196.352664:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785548416 00000100:00100000:2.0:1789304196.352812:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789304196.352823:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:70959:x1876219785548416:12345-0@lo:104: 00010000:00010000:2.0:1789304196.352837:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304196.352903:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304196.352909:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:70959:x1876219785548416:12345-0@lo:104: Request processed in 90us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304196.352916:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00010000:00010000:1.0:1789304196.352988:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304196.352996:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353003:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304196.353008:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353017:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304196.353024:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304196.353030:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304196.353064:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353071:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304196.353116:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353124:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb72312953b9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312953c0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353141:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304196.353144:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304196.353146:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304196.353167:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785548544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304196.353198:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304196.353236:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785548544 00000100:00100000:1.0:1789304196.353240:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785548544 00010000:00010000:1.0:1789304196.353259:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8e000/0xefc0bb72312953c0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312953b9 expref: 19 pid: 5846 timeout: 1796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304196.353280:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789304196.353286:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03868450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785548544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304196.353296:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304196.353301:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8e000/0xefc0bb72312953c0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312953b9 expref: 19 pid: 5846 timeout: 1796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353310:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8e000/0xefc0bb72312953c0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312953b9 expref: 19 pid: 5846 timeout: 1796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353325:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353334:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353349:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353356:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353363:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353371:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353376:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304196.353380:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353388:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353397:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304196.353417:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304196.353453:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03868450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785548544:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304196.353460:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789304196.353526:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785548544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304196.353598:0:70959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb72312953c0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312953b9 expref: 18 pid: 5846 timeout: 1796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304196.353606:0:70959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70959:1876219785548416:0@lo:104: 00010000:00010000:0.0:1789304196.353619:0:70959:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304196.353624:0:70959:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304196.353628:0:70959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304196.353632:0:70959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312953dc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304196.434582:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304197.398312:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785548672:0@lo:400:kworker.0 00000100:00100000:1.0:1789304197.398406:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304197.398474:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785549184:0@lo:400:kworker.0 00000100:00100000:1.0:1789304197.398580:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304197.398615:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304197.398621:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785549056:0@lo:400:kworker.0 00000100:00100000:1.0:1789304197.398644:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304197.398674:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785548928:0@lo:400:kworker.0 00000100:00100000:1.0:1789304197.398701:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304197.398722:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789304197.398726:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785548800:0@lo:400:kworker.0 00000100:00100000:1.0:1789304197.398746:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304197.398761:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785549312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304197.398782:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304197.399223:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785549184 00000100:00100000:3.0:1789304197.399233:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785549184 00000100:00100000:3.0:1789304197.399303:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785549056 00000100:00100000:3.0:1789304197.399307:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785549056 00000100:00100000:3.0:1789304197.399327:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785548800 00000100:00100000:3.0:1789304197.399330:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785548800 00000100:00100000:3.0:1789304197.399345:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1789304197.399354:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785549184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304197.399432:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785549184:12345-0@lo:400:kworker.0 Request processed in 78us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304197.399439:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1789304197.399607:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1789304197.399613:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785549056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304197.399645:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785549056:12345-0@lo:400:kworker.0 Request processed in 33us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304197.399651:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1789304197.399662:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1789304197.399667:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785548800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304197.399702:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785548800:12345-0@lo:400:kworker.0 Request processed in 35us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304197.399707:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1789304197.399761:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785548800:0@lo:400:kworker.0 00000100:00100000:3.0:1789304197.399792:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785549056:0@lo:400:kworker.0 00000100:00100000:3.0:1789304197.399802:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785549184:0@lo:400:kworker.0 00000100:00100000:0.0:1789304197.400703:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785548928 00000100:00100000:0.0:1789304197.400716:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785548928 00000100:00100000:0.0:1789304197.400762:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785549312 00000100:00100000:0.0:1789304197.400766:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785549312 00000100:00100000:0.0:1789304197.400790:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1789304197.400803:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785548928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304197.400882:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785548928:12345-0@lo:400:kworker.0 Request processed in 84us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304197.400889:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:3.0:1789304197.400898:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785548928:0@lo:400:kworker.0 00000100:00100000:0.0:1789304197.400903:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1789304197.400909:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785549312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304197.400952:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785549312:12345-0@lo:400:kworker.0 Request processed in 42us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304197.400957:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1789304197.400987:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785548672 00000100:00100000:0.0:1789304197.400992:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785548672 00000100:00100000:0.0:1789304197.401020:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:0.0:1789304197.401026:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785548672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304197.401059:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785548672:12345-0@lo:400:kworker.0 Request processed in 33us (2666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304197.401064:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00080000:0.0:1789304197.401146:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304197.401152:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304197.401154:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304197.401961:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785549312:0@lo:400:kworker.0 00000100:00100000:3.0:1789304197.401994:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785548672:0@lo:400:kworker.0 00010000:00010000:2.0:1789304197.458301:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304197.654975:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304197.654983:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304197.654989:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304197.655040:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304197.655052:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304197.655065:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304197.655106:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785549440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304197.655192:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304197.655245:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaa000 going to sleep for 11 seconds 00000100:00100000:2.0:1789304197.655268:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785549440 00000100:00100000:2.0:1789304197.655275:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785549440 00000100:00100000:2.0:1789304197.655318:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1789304197.655326:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785549440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304197.655340:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304197.655354:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312953ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312953e3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304197.655377:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312953ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312953e3 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304197.655387:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312953ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312953e3 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304197.655408:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789304197.655460:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785549440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304197.655468:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1789304197.655525:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785549440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304197.655542:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304197.655551:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304197.655569:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304197.655574:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304197.655582:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304198.482331:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304198.529215:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00010000:00010000:3.0:1789304199.506330:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304199.528656:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304199.528767:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765452416 00000100:00100000:3.0:1789304199.528778:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765452416 00000100:00100000:3.0:1789304199.528860:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 574 00000100:00100000:3.0:1789304199.528871:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765452416:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00080000:0.0:1789304199.529961:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304199.616594:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765452416:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 87714us (87939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304199.616612:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 574 00000100:00100000:1.0:1789304199.621361:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304199.621529:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765452544 00000100:00100000:0.0:1789304199.621542:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765452544 00000100:00100000:0.0:1789304199.621627:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 302 00000100:00100000:0.0:1789304199.621641:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765452544:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:1.0:1789304199.621938:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304199.622465:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765452544:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 827us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304199.622474:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 302 00000100:00100000:3.0:1789304199.626535:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304199.626803:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765452672 00000100:00100000:0.0:1789304199.626814:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765452672 00000100:00100000:0.0:1789304199.626916:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 303 00000100:00100000:0.0:1789304199.626925:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876219765452672:12345-192.168.202.29@tcp:8:lfs.60003 00010000:00080000:0.0:1789304199.626959:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1649 last 0 00000020:00000080:0.0:1789304199.626990:0:6693:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb72312953f1 00002000:00100000:0.0:1789304199.627004:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b01e88000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789304199.627030:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789304199.627297:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789304199.627325:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2b01e8b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789304199.627411:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765452672:12345-192.168.202.29@tcp:8:lfs.60003 Request processed in 485us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304199.627418:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 303 00000100:00100000:3.0:1789304199.630067:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304199.630203:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765452800 00000100:00100000:0.0:1789304199.630212:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765452800 00000100:00100000:0.0:1789304199.630296:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 304 00000100:00100000:0.0:1789304199.630304:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41417:x1876219765452800:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304199.630662:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41417:x1876219765452800:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 358us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304199.630792:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 304 00000100:00080000:1.0:1789304199.632082:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304199.636198:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304199.636288:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765452928 00000100:00100000:3.0:1789304199.636299:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765452928 00000100:00100000:3.0:1789304199.636383:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 575 00000100:00100000:3.0:1789304199.636394:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765452928:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304199.636898:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765452928:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 505us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304199.636907:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 575 00000100:00100000:1.0:1789304199.648871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304199.648918:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765453056 00000100:00100000:1.0:1789304199.648929:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765453056 00000100:00100000:1.0:1789304199.649000:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 576 00000100:00100000:1.0:1789304199.649011:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765453056:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304199.719993:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765453056:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 70971us (71126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304199.720010:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 576 00000100:00100000:1.0:1789304199.737035:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304199.737272:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765453184 00000100:00100000:2.0:1789304199.737283:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765453184 00000100:00100000:2.0:1789304199.737487:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 305 00000100:00100000:2.0:1789304199.737498:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765453184:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304199.737834:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765453184:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 337us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304199.737843:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 305 00000100:00100000:1.0:1789304199.739421:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304199.753308:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765453312 00000100:00100000:0.0:1789304199.753326:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765453312 00000100:00100000:2.0:1789304199.761074:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 306 00000100:00100000:2.0:1789304199.761129:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:41417:x1876219765453312:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304199.761691:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:41417:x1876219765453312:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 601us (22275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304199.761699:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 306 00000100:00100000:1.0:1789304199.772323:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304199.772544:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765453440 00000100:00100000:2.0:1789304199.772555:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765453440 00000100:00100000:2.0:1789304199.772612:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 577 00000100:00100000:2.0:1789304199.772624:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765453440:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304199.773692:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:41417:x1876219765453440:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 1066us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304199.773703:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 577 00000100:00100000:1.0:1789304199.855602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304199.856743:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765453568 00000100:00100000:0.0:1789304199.856759:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765453568 00000100:00100000:0.0:1789304199.856842:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 578 00000100:00100000:0.0:1789304199.856856:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:41421:x1876219765453568:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304199.856884:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304199.856912:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312953f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610013b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857025:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312953ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857042:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312953ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857058:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312953ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857073:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295406 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857081:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857134:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857491:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129540d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857502:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857510:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304199.857540:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789304199.857545:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304199.857572:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129540d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857586:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312953ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857593:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312953ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857601:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312953ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857606:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304199.857612:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312953ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857621:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312953ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857636:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:0.0:1789304199.857639:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304199.857645:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312953ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857652:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312953ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857666:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857671:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295406 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857683:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295406 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857688:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304199.857692:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295406 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857698:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295406 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857706:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c0558d200) 00010000:00010000:0.0:1789304199.857708:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304199.857712:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295406 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857718:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295406 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857750:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312953f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610013b expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857767:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129540d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610013b expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.857775:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304199.857777:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304199.857779:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789304199.857863:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:41421:x1876219765453568:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1011us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304199.857874:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 578 00000100:00100000:1.0:1789304199.864397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304199.864639:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765453824 00000100:00100000:0.0:1789304199.864650:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765453824 00000100:00100000:0.0:1789304199.864718:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 579 00000100:00100000:0.0:1789304199.864729:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:41421:x1876219765453824:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304199.864753:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304199.864776:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295414 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100142 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.865054:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129541b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.865071:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129541b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.865083:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129541b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.865119:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.865125:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.865133:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789304199.865871:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12:0x0], index 1: 0 00010000:00010000:0.0:1789304199.866181:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295429 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866193:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866200:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866235:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129541b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866243:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129541b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866250:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129541b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866256:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304199.866261:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129541b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866268:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129541b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866281:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304199.866284:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304199.866289:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129541b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866295:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129541b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304199.866308:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf66e94e reply state 0000000099bf8b17 transno 4294967519 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304199.866316:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789304199.866347:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231295414 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100142 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866364:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295429 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100142 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.866380:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304199.866383:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304199.866386:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304199.866469:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:41421:x1876219765453824:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1742us (2081us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789304199.866478:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 579 00000100:00100000:2.0:1789304199.867005:0:8095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1876219785549696:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789304199.867055:0:8095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304199.867121:0:8095:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c07936a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789304199.867130:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785549568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304199.867153:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785549696 00000100:00100000:2.0:1789304199.867160:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785549696 00000100:00100000:3.0:1789304199.867172:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789304199.867188:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304199.867212:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785549568 00000100:00100000:3.0:1789304199.867216:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785549568 00000100:00100000:2.0:1789304199.867223:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789304199.867230:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8095:x1876219785549696:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789304199.867235:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1789304199.867240:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785549568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304199.867253:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00002000:00080000:2.0:1789304199.867270:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1789304199.867287:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785549568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304199.867293:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1789304199.867336:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785549568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789304199.880574:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304199.880595:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304199.880604:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304199.880610:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304199.880614:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304199.880622:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304199.880638:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c0558d000) 00010000:00010000:3.0:1789304199.880641:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304199.880646:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304199.880652:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295422 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304199.880705:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304199.880778:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765453952 00000100:00100000:0.0:1789304199.880789:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765453952 00000100:00100000:0.0:1789304199.880846:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 308 00000100:00100000:0.0:1789304199.880856:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41421:x1876219765453952:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304199.880874:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304199.880891:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231295437 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100149 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304199.880915:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789304199.880936:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=1649s v=(0 0) 00010000:00010000:0.0:1789304199.880941:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304199.880951:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231295437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100149 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.880974:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231295437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100149 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304199.880985:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb400, rc 0) 00000100:00100000:0.0:1789304199.881048:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:41421:x1876219765453952:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 194us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304199.881055:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 308 00000100:00100000:2.0:1789304199.898313:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8095:x1876219785549696:12345-0@lo:5:osp-pre-1-0.0 Request processed in 31076us (31250us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789304199.898327:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789304199.898853:0:8095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8095:1876219785549696:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789304199.898869:0:8095:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x12:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1789304199.925530:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304199.925623:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765454080 00000100:00100000:3.0:1789304199.925635:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765454080 00002000:00100000:3.0:1789304199.925699:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x12:0x0] (0->1048575) req@ffff9e2c36ecfb80 x1876219765454080/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:265/0 lens 488/0 e 0 to 0 dl 1789304210 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1789304199.925711:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c36ecfb80 with x1876219765454080 ext(0->1048575) 00002000:00010000:3.0:1789304199.925718:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c36ecfb80 00000100:00100000:3.0:1789304199.925814:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:3.0:1789304199.925825:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765454080:12345-192.168.202.29@tcp:4:dd.60003 00000100:00100000:1.0:1789304200.033947:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304200.034067:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765454208 00000100:00100000:1.0:1789304200.034078:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765454208 00000100:00100000:1.0:1789304200.035008:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 987 00000100:00100000:1.0:1789304200.035027:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765454208:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304200.035133:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765454208:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 112us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304200.035140:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 987 00000001:00100000:2.0:1789304200.048995:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00080000:2.0:1789304200.049019:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967331 is committed 00000100:00100000:1.0:1789304200.054029:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765454080:12345-192.168.202.29@tcp:4:dd.60003 Request processed in 128192us (128496us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789304200.054045:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00002000:00100000:1.0:1789304200.054062:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x12:0x0] (0->1048575) req@ffff9e2c36ecfb80 x1876219765454080/t4294967332(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:265/0 lens 488/448 e 0 to 0 dl 1789304210 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304200.054073:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c36ecfb80 with x1876219765454080 ext(0->1048575) 00002000:00010000:1.0:1789304200.054081:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c36ecfb80 00000100:00100000:1.0:1789304200.056995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304200.057253:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765454336 00000100:00100000:3.0:1789304200.057267:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765454336 00000100:00100000:2.0:1789304200.057523:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 580 00000100:00100000:2.0:1789304200.057536:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:41421:x1876219765454336:12345-192.168.202.29@tcp:44:dd.60003 00000001:00080000:1.0:1789304200.106639:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:0.0:1789304200.107083:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:41421:x1876219765454336:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 49544us (50092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304200.107124:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 580 00000100:00100000:3.0:1789304200.110638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304200.110800:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765454464 00000100:00100000:2.0:1789304200.110810:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765454464 00000100:00100000:2.0:1789304200.110877:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 309 00000100:00100000:2.0:1789304200.110888:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765454464:12345-192.168.202.29@tcp:16:dd.60003 00000001:00080000:1.0:1789304200.163881:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967332 is committed 00000100:00100000:3.0:1789304200.164080:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765454464:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 53186us (53442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304200.164112:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 309 00000100:00100000:1.0:1789304200.166747:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304200.167290:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765454720 00000100:00100000:2.0:1789304200.167301:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765454720 00000100:00100000:2.0:1789304200.167380:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:2.0:1789304200.167391:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:41421:x1876219765454720:12345-192.168.202.29@tcp:35:dd.60003 00000100:00100000:2.0:1789304200.167913:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:41421:x1876219765454720:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 522us (1172us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789304200.167922:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 61 00010000:00010000:2.0:1789304200.533711:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304200.978549:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304200.978570:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785549824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304200.978640:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304200.978717:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785549824 00000100:00100000:3.0:1789304200.978725:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785549824 00000100:00100000:3.0:1789304200.978999:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1789304200.979009:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785549824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304200.979048:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304200.979130:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785549824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304200.979138:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1789304200.979241:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785549824:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304200.979317:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304201.579037:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304201.829782:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000100:00100000:1.0:1789304202.514363:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785549952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.514457:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304202.514517:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785550464:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.514549:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304202.514577:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304202.514582:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785550336:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.514603:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304202.514633:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785550080:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.514653:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304202.514670:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785550592:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.514691:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304202.514706:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304202.514711:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785550208:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.514729:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304202.514760:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785550464 00000100:00100000:1.0:1789304202.514767:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785550464 00000100:00100000:1.0:1789304202.514813:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785550336 00000100:00100000:1.0:1789304202.514816:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785550336 00000100:00100000:1.0:1789304202.514837:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785550080 00000100:00100000:1.0:1789304202.514839:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785550080 00000100:00100000:1.0:1789304202.514854:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1789304202.514862:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785550464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.514925:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785550464:12345-0@lo:400:kworker.0 Request processed in 63us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304202.514931:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1789304202.514948:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1789304202.514953:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785550336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.514990:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785550336:12345-0@lo:400:kworker.0 Request processed in 37us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304202.514995:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1789304202.515006:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1789304202.515012:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785550080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.515041:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785550080:12345-0@lo:400:kworker.0 Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304202.515046:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1789304202.515067:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785550592 00000100:00100000:1.0:1789304202.515071:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785550592 00000100:00100000:1.0:1789304202.515119:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785550208 00000100:00100000:1.0:1789304202.515122:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785550208 00000100:00100000:1.0:1789304202.515144:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1789304202.515151:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785550592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.515180:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785550592:12345-0@lo:400:kworker.0 Request processed in 30us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304202.515186:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1789304202.515197:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1789304202.515203:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785550208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.515228:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785550208:12345-0@lo:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304202.515234:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00080000:1.0:1789304202.515248:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304202.515252:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304202.515254:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304202.515282:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785550208:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.515291:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785550080:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.515298:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967331 gen 2 00000100:00100000:1.0:1789304202.515312:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785550592:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.515336:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785550336:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.515343:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785550464:0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.515400:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785549952 00000100:00100000:1.0:1789304202.515404:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785549952 00000100:00100000:1.0:1789304202.515431:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1789304202.515437:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785549952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304202.515472:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785549952:12345-0@lo:400:kworker.0 Request processed in 35us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304202.515478:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1789304202.515511:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785549952:0@lo:400:kworker.0 00010000:00010000:2.0:1789304202.579257:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304203.269713:0:71204:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1652947619178ns, next at 1633764475287ns, rc = 0 00000004:00080000:3.0:1789304203.269836:0:71204:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1652947745190ns, next at 1605300451759ns, rc = 0 00000004:00080000:2.0:1789304203.273263:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 51 committed 00000004:00080000:2.0:1789304203.273294:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 46 committed 00010000:00010000:2.0:1789304203.605522:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304204.618287:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304204.618578:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765454848 00000100:00100000:2.0:1789304204.618589:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765454848 00000100:00100000:2.0:1789304204.618663:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 581 00000100:00100000:2.0:1789304204.618676:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:41614:x1876219765454848:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304204.618781:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:41614:x1876219765454848:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 109us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304204.618789:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 581 00000100:00080000:3.0:1789304204.620147:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304204.620659:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304204.620729:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765454976 00000100:00100000:3.0:1789304204.620737:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765454976 00000100:00100000:3.0:1789304204.620803:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 310 00000100:00100000:3.0:1789304204.620813:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41614:x1876219765454976:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:2.0:1789304204.621233:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304204.621720:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41614:x1876219765454976:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 905us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304204.621728:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 310 00000100:00100000:2.0:1789304204.623517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304204.623697:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765455104 00000100:00100000:3.0:1789304204.623708:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765455104 00000100:00100000:3.0:1789304204.623768:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 311 00000100:00100000:3.0:1789304204.623777:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41614:x1876219765455104:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304204.624142:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41614:x1876219765455104:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 365us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304204.624149:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 311 00000100:00080000:2.0:1789304204.624267:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304204.628719:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304204.635620:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304204.637413:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765455232 00000100:00100000:1.0:1789304204.637428:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765455232 00000100:00100000:1.0:1789304204.637499:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 582 00000100:00100000:1.0:1789304204.637509:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:41614:x1876219765455232:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304204.638140:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:41614:x1876219765455232:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 631us (2528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304204.638150:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 582 00000100:00100000:3.0:1789304204.643806:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304204.644031:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765455360 00000100:00100000:1.0:1789304204.644041:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765455360 00000100:00100000:1.0:1789304204.644122:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 583 00000100:00100000:1.0:1789304204.644132:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:41614:x1876219765455360:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304204.644238:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:41614:x1876219765455360:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 108us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304204.644243:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 583 00000100:00100000:1.0:1789304204.647730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304204.647829:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765455488 00000100:00100000:3.0:1789304204.647838:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765455488 00000100:00100000:3.0:1789304204.647890:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 312 00000100:00100000:3.0:1789304204.647898:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41614:x1876219765455488:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304204.648511:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41614:x1876219765455488:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 418us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304204.648519:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 312 00000100:00100000:3.0:1789304204.653869:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304204.653929:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765455616 00000100:00100000:1.0:1789304204.653939:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765455616 00000100:00100000:1.0:1789304204.653990:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 313 00000100:00100000:1.0:1789304204.653997:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41614:x1876219765455616:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304204.654477:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41614:x1876219765455616:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 477us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304204.654489:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 313 00000100:00100000:0.0:1789304204.656826:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304204.656877:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765455744 00000100:00100000:2.0:1789304204.656885:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765455744 00000100:00100000:2.0:1789304204.656933:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 584 00000100:00100000:2.0:1789304204.656940:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:41614:x1876219765455744:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304204.657492:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:41614:x1876219765455744:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 549us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304204.657500:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 584 00000100:00100000:3.0:1789304204.733281:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304204.733430:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765456000 00000100:00100000:0.0:1789304204.733442:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765456000 00000100:00100000:0.0:1789304204.733510:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 585 00000100:00100000:0.0:1789304204.733521:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:41618:x1876219765456000:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:0.0:1789304204.733580:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304204.733610:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295429 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100142 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.733628:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304204.733639:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304204.733663:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129543e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.733684:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129543e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.733695:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129543e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.733711:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.733719:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.733725:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.736444:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129544c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.736464:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129544c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.736476:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129544c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789304204.737555:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].18, 64 off9344 00000004:00080000:0.0:1789304204.737567:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1654415475829ns, next at 1655415473340ns, rc = 0 00010000:00010000:0.0:1789304204.737661:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737673:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737687:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737696:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737702:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737709:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737736:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789304204.737764:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129544c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737771:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129544c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737778:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129544c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737785:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304204.737790:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129544c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737797:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129544c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737809:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:0.0:1789304204.737812:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789304204.737818:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129544c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737824:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129544c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737844:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129543e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737850:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129543e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737857:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129543e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737862:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304204.737864:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129543e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737870:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129543e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737878:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304204.737881:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304204.737884:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129543e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304204.737889:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129543e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304204.737900:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046e4950f reply state 00000000748994d2 transno 4294967521 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304204.737915:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304204.738008:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:41618:x1876219765456000:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 4486us (4734us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789304204.738017:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 585 00010000:00010000:3.0:1789304204.738462:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304204.738470:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304204.738482:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304204.738485:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304204.738491:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304204.738501:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:3.0:1789304204.738504:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304204.738507:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304204.738513:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295453 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304204.738530:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304204.738533:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304204.738534:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304204.741355:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304204.741373:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304204.741382:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304204.741389:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304204.741394:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304204.741401:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304204.741417:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff9e2c0558d700) 00010000:00010000:1.0:1789304204.741420:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304204.741425:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304204.741431:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295445 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304205.076667:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785550720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304205.076743:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304205.076852:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785550720 00000100:00100000:2.0:1789304205.076861:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785550720 00000100:00100000:2.0:1789304205.076919:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1789304205.076928:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785550720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304205.076961:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789304205.077004:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785550720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304205.077011:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1789304205.077054:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785550720:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304205.077164:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304205.156076:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304205.156152:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765456128 00000100:00100000:1.0:1789304205.156163:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765456128 00000100:00100000:1.0:1789304205.156215:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 989 00000100:00100000:1.0:1789304205.156227:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765456128:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304205.156312:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765456128:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304205.156341:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 989 00010000:00010000:2.0:1789304205.650312:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304206.102202:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304206.102225:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785550848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304206.102296:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304206.102516:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785550848 00000100:00100000:0.0:1789304206.102524:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785550848 00000100:00100000:0.0:1789304206.102594:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1789304206.102607:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785550848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304206.102645:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304206.102693:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785550848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304206.102699:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00080000:0.0:1789304206.102718:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304206.102753:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785550848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304206.674435:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304206.814329:0:71350:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1656492235720ns, next at 1633764475287ns, rc = 0 00000004:00080000:3.0:1789304206.814856:0:71350:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1656492764754ns, next at 1655415473340ns, rc = 0 00000001:00080000:2.0:1789304206.855229:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000004:00080000:2.0:1789304206.855241:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 52 committed 00000100:00100000:3.0:1789304206.855567:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304206.855586:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785550976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789304206.855658:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304206.855732:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785550976 00000100:00100000:3.0:1789304206.855748:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785550976 00000100:00100000:3.0:1789304206.855789:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789304206.855798:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785550976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789304206.855824:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:18 count 1 00010000:00010000:3.0:1789304206.855847:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304206.855868:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231295437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100149 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304206.855877:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x12:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1789304206.855881:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304206.855886:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304206.855910:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231295437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100149 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304206.855923:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231295437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100149 expref: 5 pid: 17212 timeout: 1756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304206.855934:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41371c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785551104:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304206.855987:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c413a7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789304206.858931:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785551104:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304206.858962:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304206.860329:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304206.861247:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765456256 00000100:00100000:2.0:1789304206.861259:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765456256 00010000:00010000:2.0:1789304206.861304:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231295437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100149 expref: 6 pid: 17212 timeout: 1756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789304206.861475:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304206.861606:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 326 00000100:00100000:1.0:1789304206.861675:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765456256:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304206.861691:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304206.861697:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231295437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100149 expref: 6 pid: 17212 timeout: 1756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304206.861712:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231295437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100149 expref: 6 pid: 17212 timeout: 1756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304206.861732:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231295437 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100149 expref: 6 pid: 17212 timeout: 1756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304206.861748:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304206.861753:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304206.861758:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304206.861767:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304206.861802:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304206.861855:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765456256:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 239us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304206.861863:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 326 00010000:00010000:0.0:1789304206.861927:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304206.861943:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304206.861955:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304206.861964:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304206.861991:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789304206.863948:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41370700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785550976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8145us (8283us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789304206.863960:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00010000:1.0:1789304206.864572:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304206.864580:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304206.864591:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304206.864596:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304206.864607:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304206.864633:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304206.864641:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb723129545a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304206.864663:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304206.864665:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304206.864667:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304206.864822:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 53 committed 00000004:00080000:3.0:1789304206.864845:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 47 committed 00000004:00080000:3.0:1789304206.864907:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b036e9c00/2, rc 0, transno 4294967333 00000100:00100000:3.0:1789304206.864927:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785550976:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789304207.635209:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785551616:0@lo:400:kworker.0 00000100:00100000:3.0:1789304207.635275:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304207.635471:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304207.635480:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785551488:0@lo:400:kworker.0 00000100:00100000:3.0:1789304207.635512:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304207.635585:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785551616 00000100:00100000:3.0:1789304207.635593:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785551616 00000100:00100000:3.0:1789304207.635649:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1789304207.635659:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785551616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304207.635713:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785551616:12345-0@lo:400:kworker.0 Request processed in 56us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304207.635720:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00080000:3.0:1789304207.635740:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304207.635774:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785551616:0@lo:400:kworker.0 00000100:00100000:1.0:1789304207.635903:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41371c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785551232:0@lo:400:kworker.0 00000100:00100000:1.0:1789304207.635936:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304207.635966:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785551744:0@lo:400:kworker.0 00000100:00100000:1.0:1789304207.635989:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304207.636009:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789304207.636015:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785551360:0@lo:400:kworker.0 00000100:00100000:1.0:1789304207.636035:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304207.636050:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785551872:0@lo:400:kworker.0 00000100:00100000:1.0:1789304207.636069:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304207.636111:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785551232 00000100:00100000:3.0:1789304207.636116:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785551232 00000100:00100000:3.0:1789304207.636144:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1789304207.636150:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785551232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304207.636183:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785551232:12345-0@lo:400:kworker.0 Request processed in 33us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304207.636189:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1789304207.636212:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785551744 00000100:00100000:3.0:1789304207.636216:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785551744 00000100:00100000:3.0:1789304207.636243:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785551360 00000100:00100000:3.0:1789304207.636246:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785551360 00000100:00100000:3.0:1789304207.636263:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1789304207.636269:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785551744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304207.636334:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785551744:12345-0@lo:400:kworker.0 Request processed in 31us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304207.636349:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1789304207.636368:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1789304207.636374:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785551360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304207.636403:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785551360:12345-0@lo:400:kworker.0 Request processed in 29us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304207.636408:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00080000:3.0:1789304207.636428:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304207.648591:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785551488 00000100:00100000:0.0:1789304207.648607:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785551488 00000100:00100000:0.0:1789304207.650165:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785551872 00000100:00100000:0.0:1789304207.650176:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785551872 00000100:00100000:1.0:1789304207.650530:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1789304207.650544:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785551488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304207.650637:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785551488:12345-0@lo:400:kworker.0 Request processed in 98us (15124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304207.650644:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1789304207.650661:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1789304207.650667:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785551872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304207.650700:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785551872:12345-0@lo:400:kworker.0 Request processed in 34us (14631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304207.650705:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00080000:0.0:1789304207.653256:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304207.653562:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785551872:0@lo:400:kworker.0 00000100:00100000:0.0:1789304207.653580:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785551232:0@lo:400:kworker.0 00000100:00100000:0.0:1789304207.653590:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41371880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785551744:0@lo:400:kworker.0 00000100:00100000:0.0:1789304207.653618:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785551360:0@lo:400:kworker.0 00000100:00100000:0.0:1789304207.653658:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41373b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785551488:0@lo:400:kworker.0 00010000:00010000:2.0:1789304207.698711:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304208.722204:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304209.747413:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304209.751876:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967333 is committed 00000100:00100000:0.0:1789304210.194644:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785552000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304210.194718:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304210.194817:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785552000 00000100:00100000:3.0:1789304210.194826:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785552000 00000100:00100000:3.0:1789304210.194890:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1789304210.194900:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785552000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304210.194935:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304210.197599:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785552000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2693us (2872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304210.197612:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1789304210.200642:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:0.0:1789304210.200654:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b036e9c00, transno 4294967333 00000100:00100000:0.0:1789304210.200971:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785552000:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304210.201007:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304210.278733:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304210.278783:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304210.278878:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765456512 00000100:00100000:2.0:1789304210.278889:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765456512 00000100:00100000:2.0:1789304210.278963:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1153 00000100:00100000:2.0:1789304210.278973:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765456512:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304210.279066:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765456512:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 94us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304210.279073:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1153 00000100:00100000:3.0:1789304210.279602:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304210.279655:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304210.279703:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765456384 00000100:00100000:2.0:1789304210.279709:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765456384 00000100:00100000:2.0:1789304210.279751:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 991 00000100:00100000:2.0:1789304210.279759:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765456384:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304210.279796:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765456384:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304210.279802:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 991 00000100:00100000:0.0:1789304210.301330:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765456768 00000100:00100000:0.0:1789304210.301349:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765456768 00000100:00100000:0.0:1789304210.301445:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 826 00000100:00100000:0.0:1789304210.301459:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765456768:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304210.301561:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765456768:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 106us (22776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304210.301568:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 826 00000100:00100000:0.0:1789304210.301591:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765456640 00000100:00100000:0.0:1789304210.301595:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765456640 00000100:00100000:0.0:1789304210.301621:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 827 00000100:00100000:0.0:1789304210.301628:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765456640:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304210.301654:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765456640:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (22000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304210.301660:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 827 00000100:00080000:0.0:1789304210.301814:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304210.301819:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304210.301822:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304210.777766:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304211.218392:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304211.218421:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785552128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304211.218505:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304211.218648:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785552128 00000100:00100000:0.0:1789304211.218658:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785552128 00000100:00100000:0.0:1789304211.218729:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1789304211.218739:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785552128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304211.218775:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304211.218823:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785552128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304211.218829:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1789304211.218928:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785552128:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304211.221715:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304211.795347:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304212.754396:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785552256:0@lo:400:kworker.0 00000100:00100000:1.0:1789304212.754478:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304212.754707:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785552384:0@lo:400:kworker.0 00000100:00100000:2.0:1789304212.754743:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304212.754804:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785552384 00000100:00100000:2.0:1789304212.754812:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785552384 00000100:00100000:2.0:1789304212.754860:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1789304212.754870:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785552384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304212.754925:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785552384:12345-0@lo:400:kworker.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304212.754932:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1789304212.754977:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785552384:0@lo:400:kworker.0 00000100:00100000:3.0:1789304212.755361:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785552256 00000100:00100000:3.0:1789304212.755366:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785552256 00000100:00100000:3.0:1789304212.755406:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1789304212.755414:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785552256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.755665:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785552640:0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.755696:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304212.755718:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304212.755724:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785552512:0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.755749:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304212.755775:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785552512 00000100:00100000:0.0:1789304212.755779:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785552512 00000100:00100000:0.0:1789304212.755811:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1789304212.755818:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785552512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.755851:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785552512:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304212.755857:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1789304212.755887:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785552512:0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.755903:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785552896:0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.755924:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304212.755939:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304212.755943:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785552768:0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.755961:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304212.755983:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785552896 00000100:00100000:0.0:1789304212.755986:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785552896 00000100:00100000:0.0:1789304212.756016:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1789304212.756023:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785552896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.756056:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785552896:12345-0@lo:400:kworker.0 Request processed in 34us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304212.756062:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1789304212.756078:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785552640 00000100:00100000:0.0:1789304212.756081:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785552640 00000100:00100000:0.0:1789304212.756155:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785552768 00000100:00100000:0.0:1789304212.756158:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785552768 00000100:00100000:0.0:1789304212.756180:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1789304212.756186:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785552640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.756220:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785552640:12345-0@lo:400:kworker.0 Request processed in 35us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304212.756226:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1789304212.756238:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1789304212.756244:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785552768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.756282:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785552768:12345-0@lo:400:kworker.0 Request processed in 39us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304212.756288:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1789304212.756315:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785552640:0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.756334:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785552768:0@lo:400:kworker.0 00000100:00100000:0.0:1789304212.756342:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785552896:0@lo:400:kworker.0 00000100:00080000:0.0:1789304212.756366:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304212.756370:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304212.757064:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785552256:12345-0@lo:400:kworker.0 Request processed in 1649us (2585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304212.757073:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1789304212.757468:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785552256:0@lo:400:kworker.0 00010000:00010000:3.0:1789304212.818697:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304213.842878:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304214.866275:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304215.314641:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304215.314663:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785553024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304215.314732:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304215.314880:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785553024 00000100:00100000:1.0:1789304215.314888:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785553024 00000100:00100000:1.0:1789304215.314961:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1789304215.314971:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785553024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304215.315005:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304215.315055:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785553024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304215.315063:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00080000:0.0:1789304215.315353:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304215.315390:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785553024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304215.393454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304215.393503:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304215.393544:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304215.393583:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304215.393617:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765457280 00000100:00100000:3.0:1789304215.393626:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765457280 00000100:00100000:3.0:1789304215.393684:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765457152 00000100:00100000:3.0:1789304215.393687:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765457152 00000100:00100000:3.0:1789304215.393708:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 830 00000100:00100000:3.0:1789304215.393717:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765457280:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304215.393801:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765457280:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304215.393808:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 830 00000100:00100000:3.0:1789304215.393826:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 831 00000100:00100000:3.0:1789304215.393832:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765457152:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304215.393853:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765457152:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304215.393859:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 831 00000100:00080000:3.0:1789304215.393962:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304215.393967:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304215.394290:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765456896 00000100:00100000:1.0:1789304215.394295:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765456896 00000100:00100000:1.0:1789304215.394330:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 993 00000100:00100000:1.0:1789304215.394337:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765456896:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304215.394365:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765456896:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304215.394371:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 993 00000100:00100000:2.0:1789304215.394667:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765457024 00000100:00100000:2.0:1789304215.394673:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765457024 00000100:00100000:2.0:1789304215.394718:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1157 00000100:00100000:2.0:1789304215.394725:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765457024:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304215.394768:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41373b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765457024:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 44us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304215.394774:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1157 00000100:00080000:3.0:1789304215.395568:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304215.897555:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304216.339976:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304216.340001:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785553152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304216.340079:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304216.340324:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785553152 00000100:00100000:0.0:1789304216.340334:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785553152 00000100:00100000:0.0:1789304216.340504:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1789304216.340553:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785553152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304216.340617:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304216.340698:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41371c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785553152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304216.340705:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00080000:3.0:1789304216.340970:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304216.341031:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785553152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304216.914774:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304217.874763:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785553280:0@lo:400:kworker.0 00000100:00100000:1.0:1789304217.874840:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304217.875073:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785553280 00000100:00100000:3.0:1789304217.875083:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785553280 00000100:00100000:3.0:1789304217.875156:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1789304217.875166:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785553280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304217.875755:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785553408:0@lo:400:kworker.0 00000100:00100000:2.0:1789304217.875794:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304217.875838:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785553408 00000100:00100000:2.0:1789304217.875843:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785553408 00000100:00100000:2.0:1789304217.875888:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:2.0:1789304217.875903:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785553408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304217.875945:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785553408:12345-0@lo:400:kworker.0 Request processed in 43us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304217.875952:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:2.0:1789304217.875992:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785553408:0@lo:400:kworker.0 00000100:00100000:3.0:1789304217.876463:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785553280:12345-0@lo:400:kworker.0 Request processed in 1297us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304217.876471:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1789304217.876865:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785553920:0@lo:400:kworker.0 00000100:00100000:3.0:1789304217.877047:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785553536:0@lo:400:kworker.0 00000100:00100000:3.0:1789304217.877082:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304217.877124:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304217.877129:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785553664:0@lo:400:kworker.0 00000100:00100000:3.0:1789304217.877151:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304217.877177:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785553536 00000100:00100000:3.0:1789304217.877195:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785553536 00000100:00100000:3.0:1789304217.877241:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1789304217.877248:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785553536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304217.877519:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41371180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785553536:12345-0@lo:400:kworker.0 Request processed in 272us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304217.877526:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1789304217.877564:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785553536:0@lo:400:kworker.0 00000100:00100000:0.0:1789304217.877664:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304217.877688:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304217.877693:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785553792:0@lo:400:kworker.0 00000100:00100000:0.0:1789304217.877713:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304217.877739:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785553664 00000100:00100000:0.0:1789304217.877742:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785553664 00000100:00100000:0.0:1789304217.877776:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785553792 00000100:00100000:0.0:1789304217.877778:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785553792 00000100:00100000:0.0:1789304217.877800:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1789304217.877806:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785553664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304217.877838:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785553664:12345-0@lo:400:kworker.0 Request processed in 33us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304217.877844:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1789304217.877855:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1789304217.877862:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785553792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304217.878135:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785553792:12345-0@lo:400:kworker.0 Request processed in 273us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304217.878142:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00080000:0.0:1789304217.878158:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304217.878175:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785553792:0@lo:400:kworker.0 00000100:00100000:0.0:1789304217.878391:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785553664:0@lo:400:kworker.0 00000100:00100000:3.0:1789304217.878465:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785553920 00000100:00100000:3.0:1789304217.878470:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785553920 00000100:00100000:3.0:1789304217.878511:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1789304217.878519:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785553920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304217.878555:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785553920:12345-0@lo:400:kworker.0 Request processed in 37us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304217.878560:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00080000:0.0:1789304217.878673:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304217.878691:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785553920:0@lo:400:kworker.0 00000100:00100000:1.0:1789304217.878761:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785553280:0@lo:400:kworker.0 00010000:00010000:0.0:1789304217.938272:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304218.962961:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304219.987532:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304220.434615:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304220.434640:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785554048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304220.434766:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304220.434888:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785554048 00000100:00100000:2.0:1789304220.434896:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785554048 00000100:00100000:2.0:1789304220.434964:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1789304220.434973:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785554048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304220.435005:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304220.435050:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785554048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304220.435057:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1789304220.435117:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02eda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785554048:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304220.435585:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304220.521234:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304220.521272:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304220.521304:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304220.521343:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304220.521515:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765457536 00000100:00100000:2.0:1789304220.521525:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765457536 00000100:00100000:2.0:1789304220.521600:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1161 00000100:00100000:2.0:1789304220.521610:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765457536:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304220.521684:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765457536:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304220.521693:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1161 00000100:00100000:1.0:1789304220.521838:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765457408 00000100:00100000:1.0:1789304220.521843:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765457408 00000100:00100000:1.0:1789304220.521880:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 995 00000100:00100000:1.0:1789304220.521887:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765457408:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304220.521914:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765457408:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304220.521920:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 995 00000100:00080000:0.0:1789304220.522051:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304220.522159:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765457792 00000100:00100000:3.0:1789304220.522164:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765457792 00000100:00100000:3.0:1789304220.522229:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765457664 00000100:00100000:3.0:1789304220.522233:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765457664 00000100:00100000:3.0:1789304220.522265:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 834 00000100:00100000:3.0:1789304220.522273:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765457792:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304220.522303:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765457792:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304220.522309:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 834 00000100:00100000:3.0:1789304220.522323:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 835 00000100:00100000:3.0:1789304220.522330:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765457664:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304220.522353:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765457664:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304220.522358:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 835 00000100:00080000:0.0:1789304220.522799:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304220.522803:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304220.872851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304220.873336:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765457920 00000100:00100000:2.0:1789304220.873348:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765457920 00000100:00100000:2.0:1789304220.873411:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 586 00000100:00100000:2.0:1789304220.873421:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:41795:x1876219765457920:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304220.873544:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:41795:x1876219765457920:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 124us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304220.873551:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 586 00000100:00100000:3.0:1789304220.879756:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304220.879937:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765458048 00000100:00100000:0.0:1789304220.879948:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765458048 00000100:00100000:0.0:1789304220.880025:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 315 00000100:00100000:0.0:1789304220.880037:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:41795:x1876219765458048:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304220.880472:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:41795:x1876219765458048:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 437us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304220.880481:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 315 00000100:00100000:3.0:1789304220.884275:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304220.885476:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765458176 00000100:00100000:2.0:1789304220.885492:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765458176 00000100:00100000:2.0:1789304220.885559:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 316 00000100:00100000:2.0:1789304220.885570:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41795:x1876219765458176:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304220.885954:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41795:x1876219765458176:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 385us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304220.885973:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 316 00000100:00100000:1.0:1789304220.888732:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304220.888835:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765458304 00000100:00100000:2.0:1789304220.888845:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765458304 00000100:00100000:2.0:1789304220.888907:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 587 00000100:00100000:2.0:1789304220.888918:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:41795:x1876219765458304:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304220.890060:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:41795:x1876219765458304:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 1138us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304220.890070:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 587 00000100:00100000:0.0:1789304220.904476:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304220.904795:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765458432 00000100:00100000:2.0:1789304220.904804:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765458432 00000100:00100000:2.0:1789304220.904864:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 588 00000100:00100000:2.0:1789304220.904875:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:41795:x1876219765458432:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304220.905167:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:41795:x1876219765458432:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 293us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304220.905188:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 588 00000100:00100000:3.0:1789304220.925422:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304220.928677:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765458560 00000100:00100000:0.0:1789304220.928693:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765458560 00000100:00100000:0.0:1789304220.928779:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 317 00000100:00100000:0.0:1789304220.928790:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:41795:x1876219765458560:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304220.929644:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:41795:x1876219765458560:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 852us (4228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304220.929653:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 317 00000100:00100000:1.0:1789304220.940734:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304220.941184:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765458688 00000100:00100000:0.0:1789304220.941196:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765458688 00000100:00100000:0.0:1789304220.941274:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 318 00000100:00100000:0.0:1789304220.941284:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41795:x1876219765458688:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304220.941671:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41795:x1876219765458688:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 388us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304220.941678:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 318 00000100:00100000:0.0:1789304220.949244:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304220.949421:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765458816 00000100:00100000:1.0:1789304220.949432:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765458816 00000100:00100000:1.0:1789304220.949494:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 589 00000100:00100000:1.0:1789304220.949506:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41795:x1876219765458816:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304220.949988:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41795:x1876219765458816:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 482us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304220.949996:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 589 00010000:00010000:0.0:1789304221.010556:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304221.030140:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304221.030554:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765458944 00000100:00100000:2.0:1789304221.030565:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765458944 00000100:00100000:2.0:1789304221.030630:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 590 00000100:00100000:2.0:1789304221.030640:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:41796:x1876219765458944:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304221.030660:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304221.030682:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295461 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100150 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.030764:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295468 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.030779:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.030790:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304221.030827:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:2.0:1789304221.030831:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304221.030949:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295468 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.030977:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295461 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100150 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.031005:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295468 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100150 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.031014:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:2.0:1789304221.031017:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304221.031021:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789304221.031384:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:41796:x1876219765458944:12345-192.168.202.29@tcp:101:rm.0 Request processed in 745us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304221.031392:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 590 00000100:00100000:2.0:1789304221.035970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304221.036050:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765459200 00000100:00100000:0.0:1789304221.036060:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765459200 00000100:00100000:0.0:1789304221.036146:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 591 00000100:00100000:0.0:1789304221.036405:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:41796:x1876219765459200:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304221.036428:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304221.036451:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129546f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100157 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304221.036543:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00010000:0.0:1789304221.036900:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129546f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100157 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304221.036919:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:0.0:1789304221.036923:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789304221.036928:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129546f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100157 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304221.036945:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afae00, rc 0) 00000100:00100000:0.0:1789304221.037014:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:41796:x1876219765459200:12345-192.168.202.29@tcp:101:rm.0 Request processed in 858us (1052us total) trans 4294967522 rc 301/301 00000100:00100000:0.0:1789304221.037022:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 591 00000100:00100000:0.0:1789304221.042402:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304221.042475:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765459328 00000100:00100000:3.0:1789304221.042486:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765459328 00000100:00100000:3.0:1789304221.042544:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:3.0:1789304221.042554:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:41796:x1876219765459328:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:2.0:1789304221.053999:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:41796:x1876219765459328:12345-192.168.202.29@tcp:37:rm.0 Request processed in 11436us (11597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304221.054014:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:2.0:1789304221.058258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304221.058435:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765459584 00000100:00100000:0.0:1789304221.058447:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765459584 00000100:00100000:0.0:1789304221.058509:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 63 00000100:00100000:0.0:1789304221.058519:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:41796:x1876219765459584:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:0.0:1789304221.059062:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:41796:x1876219765459584:12345-192.168.202.29@tcp:35:rm.0 Request processed in 542us (810us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789304221.059069:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 63 00000100:00100000:0.0:1789304221.064743:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304221.064843:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765459840 00000100:00100000:2.0:1789304221.065027:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765459840 00000100:00100000:2.0:1789304221.065367:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 592 00000100:00100000:2.0:1789304221.065381:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:41796:x1876219765459840:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304221.065446:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789304221.065473:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295468 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100150 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.065496:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129540d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610013b expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.065511:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231295063) 00010000:00010000:2.0:1789304221.065515:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:2.0:1789304221.065526:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304221.065552:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129547d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.065565:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129547d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.065575:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129547d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.065586:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295484 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.065592:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295484 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.065598:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295484 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066643:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129548b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066659:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129548b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066668:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129548b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066711:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129548b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066719:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129548b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066726:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129548b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066731:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304221.066736:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129548b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066743:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129548b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066753:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c421d2800) 00010000:00010000:2.0:1789304221.066756:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304221.066760:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129548b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066766:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb723129548b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066783:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129547d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066789:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129547d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066795:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129547d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066800:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304221.066803:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129547d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066809:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129547d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066816:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:2.0:1789304221.066819:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304221.066822:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129547d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066827:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129547d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066838:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295484 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066844:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295484 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066862:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295484 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066868:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304221.066871:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295484 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066876:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295484 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066884:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c421d2900) 00010000:00010000:2.0:1789304221.066886:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304221.066890:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295484 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304221.066896:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295484 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304221.067005:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:41796:x1876219765459840:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1625us (2269us total) trans 0 rc -13/-13 00000100:00100000:2.0:1789304221.067013:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 592 00000100:00100000:0.0:1789304221.458380:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304221.458402:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785554176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304221.458472:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304221.459355:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785554176 00000100:00100000:1.0:1789304221.459367:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785554176 00000100:00100000:1.0:1789304221.459430:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1789304221.459439:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785554176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304221.459475:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304221.459535:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785554176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304221.459542:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1789304221.459585:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785554176:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789304221.459642:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304222.034385:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304222.532217:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000100:00100000:3.0:1789304223.001376:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b032ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785554304:0@lo:400:kworker.0 00000100:00100000:3.0:1789304223.001464:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304223.001527:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304223.001533:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785554432:0@lo:400:kworker.0 00000100:00100000:3.0:1789304223.001563:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304223.001600:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785554304 00000100:00100000:3.0:1789304223.001608:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785554304 00000100:00100000:3.0:1789304223.001654:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:3.0:1789304223.001662:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785554304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304223.001710:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785554304:12345-0@lo:400:kworker.0 Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304223.001717:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:3.0:1789304223.001766:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b032ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785554304:0@lo:400:kworker.0 00000100:00100000:3.0:1789304223.001802:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785554432 00000100:00100000:3.0:1789304223.001805:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785554432 00000100:00100000:3.0:1789304223.001834:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:3.0:1789304223.001840:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785554432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304223.001875:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785554432:12345-0@lo:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304223.001881:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:3.0:1789304223.001910:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785554432:0@lo:400:kworker.0 00000100:00100000:2.0:1789304223.002443:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785554688:0@lo:400:kworker.0 00000100:00100000:2.0:1789304223.002476:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304223.002502:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304223.002508:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785554560:0@lo:400:kworker.0 00000100:00100000:2.0:1789304223.002533:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304223.002559:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785554560 00000100:00100000:2.0:1789304223.002563:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785554560 00000100:00100000:2.0:1789304223.002602:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1789304223.002610:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785554560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304223.002645:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785554560:12345-0@lo:400:kworker.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304223.002651:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00080000:2.0:1789304223.002667:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304223.002685:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785554560:0@lo:400:kworker.0 00000100:00100000:2.0:1789304223.002702:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0301f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785554816:0@lo:400:kworker.0 00000100:00100000:2.0:1789304223.002723:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304223.002742:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304223.002747:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785554944:0@lo:400:kworker.0 00000100:00100000:2.0:1789304223.002769:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304223.003371:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785554688 00000100:00100000:0.0:1789304223.003378:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785554688 00000100:00100000:0.0:1789304223.004268:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785554816 00000100:00100000:0.0:1789304223.004277:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785554816 00000100:00100000:2.0:1789304223.004326:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1789304223.004337:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785554688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304223.004415:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785554688:12345-0@lo:400:kworker.0 Request processed in 81us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304223.004422:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1789304223.004463:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785554688:0@lo:400:kworker.0 00000100:00100000:1.0:1789304223.011410:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785554944 00000100:00100000:1.0:1789304223.011431:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785554944 00000100:00100000:1.0:1789304223.011504:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1789304223.011515:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785554944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304223.011627:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785554944:12345-0@lo:400:kworker.0 Request processed in 115us (8856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304223.011634:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1789304223.011685:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785554944:0@lo:400:kworker.0 00000100:00080000:3.0:1789304223.011940:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304223.011946:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304223.014231:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1789304223.014258:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785554816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304223.014401:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785554816:12345-0@lo:400:kworker.0 Request processed in 157us (11675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304223.014409:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:3.0:1789304223.014616:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0301f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785554816:0@lo:400:kworker.0 00010000:00010000:2.0:1789304223.058341:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304224.083248:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304224.092944:0:71615:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1dbfcfd0 20000000:00000080:2.0:1789304224.092959:0:71615:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c013f6c00 uarg=0000000000000000 00010000:00010000:2.0:1789304224.098526:0:71615:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304224.098548:0:71615:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304224.098562:0:71615:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304224.098582:0:71615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304224.098601:0:71615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312953ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312953e3 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304224.098610:0:71615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304224.098647:0:71615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312953ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312953e3 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304224.098663:0:71615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312953ea lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312953e3 expref: 18 pid: 5847 timeout: 1823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304224.098677:0:71615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0301d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71615:1876219785555072:0@lo:104: 00000100:00100000:2.0:1789304224.098744:0:71615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304224.099204:0:71615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c387c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304224.112689:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785555072 00000100:00100000:3.0:1789304224.112706:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785555072 00000100:00100000:3.0:1789304224.112879:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789304224.112890:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:71615:x1876219785555072:12345-0@lo:104: 00010000:00010000:3.0:1789304224.112907:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113006:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304224.113012:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:71615:x1876219785555072:12345-0@lo:104: Request processed in 125us (14268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304224.113017:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00010000:00010000:3.0:1789304224.113039:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304224.113045:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113053:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304224.113058:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113066:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304224.113073:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304224.113079:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304224.113157:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113163:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304224.113183:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113190:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb72312953e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312953ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113206:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304224.113208:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304224.113209:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304224.113228:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785555200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304224.113264:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304224.113319:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785555200 00000100:00100000:3.0:1789304224.113323:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785555200 00010000:00010000:3.0:1789304224.113342:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312953ea lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312953e3 expref: 19 pid: 5847 timeout: 1823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304224.113363:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789304224.113370:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785555200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304224.113382:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304224.113386:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312953ea lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312953e3 expref: 19 pid: 5847 timeout: 1823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113397:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312953ea lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312953e3 expref: 19 pid: 5847 timeout: 1823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113415:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113423:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113439:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113445:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113452:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113458:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113463:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304224.113467:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113474:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113484:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304224.113494:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304224.113521:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785555200:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304224.113528:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789304224.113559:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785555200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304224.114010:0:71615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312953ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312953e3 expref: 18 pid: 5847 timeout: 1823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304224.114023:0:71615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0301d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71615:1876219785555072:0@lo:104: 00010000:00010000:0.0:1789304224.114037:0:71615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304224.114046:0:71615:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304224.114053:0:71615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304224.114059:0:71615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231295492 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304225.106498:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304225.143631:0:71663:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc972232c0 20000000:00000080:1.0:1789304225.143649:0:71663:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c2e908800 uarg=0000000000000000 00010000:00010000:1.0:1789304225.144885:0:71663:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304225.144904:0:71663:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304225.144918:0:71663:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304225.144939:0:71663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304225.144954:0:71663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304225.144966:0:71663:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304225.144972:0:71663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304225.144978:0:71663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304225.144985:0:71663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304225.144990:0:71663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304225.144994:0:71663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304225.145001:0:71663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304225.145407:0:71663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304225.145416:0:71663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304225.145422:0:71663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb7231295499 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304225.554516:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304225.554538:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0301f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785555328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304225.554602:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304225.554756:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785555328 00000100:00100000:0.0:1789304225.554764:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785555328 00000100:00100000:0.0:1789304225.554820:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1789304225.554831:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785555328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304225.554864:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304225.554908:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785555328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304225.554917:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1789304225.555202:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0301f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785555328:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304225.555608:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304225.634029:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304225.634071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304225.634413:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765460352 00000100:00100000:2.0:1789304225.634425:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765460352 00000100:00100000:3.0:1789304225.634525:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304225.634559:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304225.634585:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765459968 00000100:00100000:3.0:1789304225.634589:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765459968 00000100:00100000:3.0:1789304225.634637:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 997 00000100:00100000:3.0:1789304225.634648:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765459968:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304225.634727:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765459968:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304225.634734:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 997 00000100:00100000:3.0:1789304225.634764:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765460224 00000100:00100000:3.0:1789304225.634769:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765460224 00000100:00100000:1.0:1789304225.634864:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765460096 00000100:00100000:1.0:1789304225.634869:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765460096 00000100:00100000:2.0:1789304225.634949:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 838 00000100:00100000:2.0:1789304225.634957:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765460352:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304225.634987:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765460352:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304225.634993:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 838 00000100:00080000:0.0:1789304225.635056:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304225.635061:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304225.635063:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304225.635432:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 839 00000100:00100000:3.0:1789304225.635440:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765460224:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304225.635469:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765460224:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304225.635479:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 839 00000100:00100000:1.0:1789304225.635596:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1165 00000100:00100000:1.0:1789304225.635604:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765460096:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304225.635634:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765460096:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304225.635640:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1165 10000000:01000000:3.0:1789304225.683157:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304225.683165:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304225.683171:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304225.683229:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304225.683244:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304225.683256:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304225.683282:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785555456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304225.683353:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304225.683417:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c079360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304225.683439:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785555456 00000100:00100000:3.0:1789304225.683447:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785555456 00000100:00100000:3.0:1789304225.683492:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1789304225.683503:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785555456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304225.683517:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304225.683531:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312954a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312954a0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304225.683555:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312954a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312954a0 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304225.683584:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312954a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312954a0 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304225.683599:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304225.683634:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785555456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304225.683641:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1789304225.683684:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785555456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304225.683699:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304225.683722:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304225.683744:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304225.683750:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304225.683758:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304226.143397:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304226.579756:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304226.579783:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785555584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304226.579862:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304226.580042:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785555584 00000100:00100000:0.0:1789304226.580061:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785555584 00000100:00080000:1.0:1789304226.580104:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304226.580164:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1789304226.580177:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785555584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304226.580215:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304226.580273:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785555584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304226.580281:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1789304226.580573:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785555584:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304227.154465:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304228.115301:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785555968:0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.115374:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304228.115449:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789304228.115455:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785555840:0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.115501:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304228.115522:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785556352:0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.115544:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304228.115576:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785555968 00000100:00100000:1.0:1789304228.115584:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785555968 00000100:00100000:1.0:1789304228.115640:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785556352 00000100:00100000:1.0:1789304228.115644:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785556352 00000100:00100000:1.0:1789304228.115667:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1789304228.115676:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785555968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.115728:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785555968:12345-0@lo:400:kworker.0 Request processed in 53us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304228.115735:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1789304228.115752:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1789304228.115758:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785556352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.115782:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785556352:12345-0@lo:400:kworker.0 Request processed in 25us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304228.115788:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1789304228.115806:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785555840 00000100:00100000:1.0:1789304228.115809:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785555840 00000100:00100000:1.0:1789304228.115833:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1789304228.115839:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785555840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.115867:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785555840:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304228.115872:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00080000:1.0:1789304228.115890:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304228.115899:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304228.115946:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785555840:0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.115956:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785556352:0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.115964:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785555968:0@lo:400:kworker.0 00000100:00100000:3.0:1789304228.116314:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785556096:0@lo:400:kworker.0 00000100:00100000:3.0:1789304228.116348:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304228.116389:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789304228.116395:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785555712:0@lo:400:kworker.0 00000100:00100000:3.0:1789304228.116422:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304228.116445:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785556224:0@lo:400:kworker.0 00000100:00100000:3.0:1789304228.116470:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304228.116496:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785555712 00000100:00100000:3.0:1789304228.116500:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785555712 00000100:00100000:3.0:1789304228.116530:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1789304228.116536:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785555712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304228.116572:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785555712:12345-0@lo:400:kworker.0 Request processed in 36us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304228.116579:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1789304228.116616:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785555712:0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.117457:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785556096 00000100:00100000:1.0:1789304228.117465:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785556096 00000100:00100000:1.0:1789304228.117617:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785556224 00000100:00100000:1.0:1789304228.117621:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785556224 00000100:00100000:2.0:1789304228.117670:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1789304228.117681:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785556096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304228.117749:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785556096:12345-0@lo:400:kworker.0 Request processed in 71us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304228.117756:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:3.0:1789304228.117839:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785556096:0@lo:400:kworker.0 00000100:00080000:0.0:1789304228.119666:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304228.119888:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:1.0:1789304228.120013:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785556224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.120138:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785556224:12345-0@lo:400:kworker.0 Request processed in 241us (3667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304228.120272:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785556224:0@lo:400:kworker.0 00000100:00100000:1.0:1789304228.120325:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00010000:00010000:0.0:1789304228.178896:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304228.690858:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304228.690924:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765460480 00000100:00100000:1.0:1789304228.690936:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765460480 00000100:00080000:0.0:1789304228.690999:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304228.691032:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 593 00000100:00100000:1.0:1789304228.691043:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:41911:x1876219765460480:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304228.691065:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304228.691129:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312954ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610015e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304228.691196:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312954b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304228.691211:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312954b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304228.691226:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312954b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304228.691266:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789304228.691271:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304228.691298:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312954b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304228.691326:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312954ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610015e expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304228.691346:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312954b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610015e expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304228.691355:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:1.0:1789304228.691357:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304228.691361:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8fa00, rc 0) 00000100:00100000:1.0:1789304228.691428:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:41911:x1876219765460480:12345-192.168.202.29@tcp:101:rm.0 Request processed in 386us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304228.691435:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 593 00000100:00100000:3.0:1789304228.694285:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304228.694381:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765460608 00000100:00100000:0.0:1789304228.694394:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765460608 00000100:00100000:0.0:1789304228.694464:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 594 00000100:00100000:0.0:1789304228.694476:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:41911:x1876219765460608:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304228.694498:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304228.694518:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312954bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100165 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.694582:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312954c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.694598:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312954c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.694610:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312954c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.694627:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312954ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.694635:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312954ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.694642:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312954ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.694963:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312954d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.694973:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312954d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.694981:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312954d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304228.695017:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789304228.695021:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304228.695041:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312954d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695055:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312954c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695067:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312954c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695074:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312954c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695080:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304228.695085:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312954c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695137:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312954c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695149:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:0.0:1789304228.695152:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304228.695158:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312954c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695164:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312954c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695176:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312954ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695182:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312954ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695188:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312954ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695193:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304228.695197:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312954ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695203:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312954ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695210:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c0558de00) 00010000:00010000:0.0:1789304228.695212:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304228.695215:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312954ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695221:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312954ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695250:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312954bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100165 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695263:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312954d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100165 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.695271:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558da00) 00010000:00010000:0.0:1789304228.695273:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304228.695276:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789304228.695346:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:41911:x1876219765460608:12345-192.168.202.29@tcp:101:rm.0 Request processed in 872us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304228.695353:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 594 00000100:00100000:3.0:1789304228.704875:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304228.704989:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765460864 00000100:00100000:1.0:1789304228.705001:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765460864 00000100:00100000:1.0:1789304228.705244:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 595 00000100:00100000:1.0:1789304228.705255:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:41911:x1876219765460864:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304228.705278:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304228.705301:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312954d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304228.705393:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00010000:1.0:1789304228.705635:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312954d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610016c expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304228.705650:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:1.0:1789304228.705653:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789304228.705659:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312954d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610016c expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304228.705672:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e000, rc 0) 00000100:00100000:1.0:1789304228.705741:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:41911:x1876219765460864:12345-192.168.202.29@tcp:101:rm.0 Request processed in 487us (876us total) trans 4294967524 rc 301/301 00000100:00100000:1.0:1789304228.705748:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 595 00000100:00100000:0.0:1789304228.710344:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304228.710460:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765460992 00000100:00100000:2.0:1789304228.710476:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765460992 00000100:00100000:2.0:1789304228.710544:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 64 00000100:00100000:2.0:1789304228.710554:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:41911:x1876219765460992:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:2.0:1789304228.719352:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:41911:x1876219765460992:12345-192.168.202.29@tcp:37:rm.0 Request processed in 8787us (9011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304228.719368:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 64 00000100:00100000:1.0:1789304228.722672:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304228.722823:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765461248 00000100:00100000:0.0:1789304228.722833:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765461248 00000100:00100000:0.0:1789304228.722901:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 65 00000100:00100000:0.0:1789304228.722913:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:41911:x1876219765461248:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:0.0:1789304228.723233:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:41911:x1876219765461248:12345-192.168.202.29@tcp:35:rm.0 Request processed in 322us (569us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789304228.723242:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 65 00000100:00100000:0.0:1789304228.727857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304228.728150:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765461504 00000100:00100000:2.0:1789304228.728171:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765461504 00000100:00100000:2.0:1789304228.728231:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 596 00000100:00100000:2.0:1789304228.728241:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:41911:x1876219765461504:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304228.728298:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304228.728327:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312954d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100165 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.728346:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c0558da00) 00010000:00010000:2.0:1789304228.728362:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312954b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610015e expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.728370:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:2.0:1789304228.728375:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304228.728400:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.728412:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.728421:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.728432:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.728439:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.728445:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.728755:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312954f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.728765:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312954f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.728782:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312954f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304228.729508:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00010000:2.0:1789304228.729526:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312954f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729534:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312954f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729541:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312954f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729547:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304228.729552:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312954f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729560:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312954f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729571:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:2.0:1789304228.729573:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304228.729577:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312954f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729588:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312954f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729608:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729614:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729620:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729625:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304228.729628:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729633:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729639:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304228.729641:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304228.729644:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.729649:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304228.729659:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029ded302 reply state 00000000dba4120c transno 4294967526 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304228.729666:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304228.729744:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:41911:x1876219765461504:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1502us (1895us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789304228.729752:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 596 00010000:00010000:3.0:1789304228.735302:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.735321:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.735330:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.735336:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304228.735341:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.735348:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.735367:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c421d2200) 00010000:00010000:3.0:1789304228.735370:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304228.735374:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.735381:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312954ed lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304228.806885:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304228.806990:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765461632 00000100:00100000:2.0:1789304228.807014:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765461632 00000100:00100000:2.0:1789304228.807139:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 597 00000100:00100000:2.0:1789304228.807411:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:41915:x1876219765461632:12345-192.168.202.29@tcp:101:mkdir.0 00010000:00010000:2.0:1789304228.807437:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304228.807461:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100173 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.807528:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295502 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.807542:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.807554:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304228.807591:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789304228.807594:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304228.807614:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295502 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.807636:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312954fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100173 expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.807654:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295502 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100173 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.807668:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304228.807671:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304228.807675:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd600, rc 0) 00000100:00100000:2.0:1789304228.807738:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:41915:x1876219765461632:12345-192.168.202.29@tcp:101:mkdir.0 Request processed in 591us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304228.807745:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 597 00000100:00100000:1.0:1789304228.817413:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304228.817588:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304228.825843:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765461760 00000100:00100000:0.0:1789304228.825860:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765461760 00000100:00100000:0.0:1789304228.825926:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765462016 00000100:00100000:0.0:1789304228.825930:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765462016 00000100:00100000:0.0:1789304228.825968:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 598 00000100:00100000:0.0:1789304228.825980:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:2354:x1876219765461760:12345-192.168.202.29@tcp:41:mkdir.0 00000004:00000024:0.0:1789304228.826026:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789304228.826136:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:2354:x1876219765461760:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 158us (8732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304228.826504:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 598 00000100:00100000:3.0:1789304228.826515:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 599 00000100:00100000:3.0:1789304228.826530:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:41915:x1876219765462016:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:3.0:1789304228.826571:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304228.826600:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295502 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100173 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.826621:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:3.0:1789304228.826635:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304228.826710:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295509 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.826725:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295509 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.826735:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295509 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.826747:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.826754:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.826762:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304228.827701:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00010000:3.0:1789304228.827717:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295509 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.827726:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295509 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.827734:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295509 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.827741:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304228.827746:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295509 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.827754:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295509 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.827767:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304228.827770:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304228.827775:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295509 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.827781:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295509 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304228.827797:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5bb11a0 reply state 00000000bbb84496 transno 4294967527 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304228.827812:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304228.827897:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:41915:x1876219765462016:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 1370us (10307us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789304228.827905:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 599 00010000:00010000:2.0:1789304228.838078:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.838151:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.838160:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.838166:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304228.838172:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.838180:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.838197:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c2ea19900) 00010000:00010000:2.0:1789304228.838201:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304228.838207:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.838213:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295510 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304228.903707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304228.903847:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765462144 00000100:00100000:2.0:1789304228.903857:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765462144 00000100:00100000:2.0:1789304228.903964:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 600 00000100:00100000:2.0:1789304228.903975:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:41919:x1876219765462144:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:2.0:1789304228.904009:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304228.904033:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610017a expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.904137:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129551e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.904167:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129551e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.904182:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129551e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304228.904234:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789304228.904239:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304228.904262:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129551e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.904286:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610017a expref: 11 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.904304:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129551e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610017a expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304228.904313:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:2.0:1789304228.904316:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304228.904320:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecce00, rc 0) 00000100:00100000:2.0:1789304228.904380:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:41919:x1876219765462144:12345-192.168.202.29@tcp:101:chown.0 Request processed in 408us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304228.904387:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 600 00000100:00100000:1.0:1789304228.907044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304228.907292:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765462272 00000100:00100000:3.0:1789304228.907303:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765462272 00000100:00100000:3.0:1789304228.907358:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 601 00000100:00100000:3.0:1789304228.907366:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:41919:x1876219765462272:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:3.0:1789304228.907386:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304228.907406:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295525 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100181 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907471:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129552c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907487:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129552c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907498:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129552c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907511:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295533 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907519:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907525:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907619:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129553a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907626:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129553a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907633:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129553a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304228.907662:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:3.0:1789304228.907666:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304228.907684:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129553a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907697:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129552c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907705:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129552c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907711:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129552c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907717:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304228.907721:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129552c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907729:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129552c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907740:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:3.0:1789304228.907743:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304228.907748:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129552c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907754:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129552c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907766:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907772:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295533 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907778:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295533 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907783:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304228.907786:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295533 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907792:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295533 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907798:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304228.907800:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304228.907803:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295533 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907808:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295533 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907831:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295525 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100181 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907849:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129553a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100181 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.907856:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304228.907858:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304228.907861:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304228.907926:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:41919:x1876219765462272:12345-192.168.202.29@tcp:101:chown.0 Request processed in 559us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304228.907933:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 601 00000100:00100000:3.0:1789304228.910908:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304228.911013:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765462528 00000100:00100000:1.0:1789304228.911028:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765462528 00000100:00100000:0.0:1789304228.911307:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 602 00000100:00100000:0.0:1789304228.911323:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:41919:x1876219765462528:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:0.0:1789304228.911387:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304228.911414:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129553a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100181 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.911434:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:0.0:1789304228.911444:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304228.911474:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.911489:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304228.911499:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789304228.957469:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000004:00010000:2.0:1789304228.957617:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f97d94c reply state 00000000f207bf1f transno 4294967528 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304228.957632:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789304228.957649:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00080000:2.0:1789304228.957765:0:5852:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789304228.957785:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:41919:x1876219765462528:12345-192.168.202.29@tcp:36:chown.0 Request processed in 46461us (46880us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789304228.957794:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 602 00010000:00010000:3.0:1789304228.957904:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.957913:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.957923:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.957929:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304228.957935:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.957943:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.957958:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:3.0:1789304228.957963:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304228.957968:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304228.957975:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231295541 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.203803:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304229.772671:0:71861:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc78f49da0 20000000:00000080:3.0:1789304229.772690:0:71861:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b0208f800 uarg=0000000000000000 00010000:00010000:3.0:1789304229.773880:0:71861:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789304229.773920:0:71861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:3.0:1789304229.773924:0:71861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304229.773935:0:71861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129551e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610017a expref: 5 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304229.773959:0:71861:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789304229.773976:0:71861:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304229.773990:0:71861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304229.774003:0:71861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312954a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312954a0 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304229.774010:0:71861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304229.774050:0:71861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312954a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312954a0 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304229.774066:0:71861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312954a7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312954a0 expref: 18 pid: 5846 timeout: 1829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304229.774087:0:71861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71861:1876219785556480:0@lo:104: 00000100:00100000:3.0:1789304229.774367:0:71861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304229.774425:0:71861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f6a5780 going to sleep for 11 seconds 00000100:00100000:0.0:1789304229.774533:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785556480 00000100:00100000:0.0:1789304229.774541:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785556480 00000100:00100000:0.0:1789304229.774592:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789304229.774601:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:71861:x1876219785556480:12345-0@lo:104: 00010000:00010000:0.0:1789304229.774615:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.774680:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304229.774686:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:71861:x1876219785556480:12345-0@lo:104: Request processed in 86us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304229.774693:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00010000:00010000:0.0:1789304229.774715:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304229.774720:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.774728:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304229.774732:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.774740:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304229.774751:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304229.774756:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304229.774785:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.774792:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304229.774811:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.774818:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f400/0xefc0bb72312954a0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312954a7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.774832:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304229.774834:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304229.774836:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304229.774853:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785556608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304229.774884:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304229.774918:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785556608 00000100:00100000:0.0:1789304229.774922:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785556608 00010000:00010000:0.0:1789304229.774941:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312954a7 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312954a0 expref: 19 pid: 5846 timeout: 1829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304229.774962:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789304229.774968:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785556608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304229.774979:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304229.774983:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312954a7 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312954a0 expref: 19 pid: 5846 timeout: 1829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.774995:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312954a7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312954a0 expref: 19 pid: 5846 timeout: 1829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.775008:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.775017:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.775029:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.775036:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.775042:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.775048:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.775054:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304229.775058:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.775066:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.775075:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304229.775124:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304229.775283:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785556608:12345-0@lo:103:ldlm_bl.0 Request processed in 314us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304229.775289:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789304229.775327:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785556608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304229.775426:0:71861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312954a7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312954a0 expref: 18 pid: 5846 timeout: 1829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304229.775439:0:71861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71861:1876219785556480:0@lo:104: 00010000:00010000:2.0:1789304229.775455:0:71861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304229.775463:0:71861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304229.775469:0:71861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304229.775475:0:71861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295548 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304230.226462:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304230.678037:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304230.678064:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785556736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304230.678184:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304230.678502:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785556736 00000100:00100000:0.0:1789304230.678511:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785556736 00000100:00100000:0.0:1789304230.678580:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1789304230.678592:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785556736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304230.678632:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304230.678686:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785556736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304230.678693:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00080000:2.0:1789304230.678849:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304230.678886:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785556736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304230.753692:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304230.753733:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304230.753763:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304230.753782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304230.753811:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765463040 00000100:00100000:3.0:1789304230.753821:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765463040 00000100:00100000:3.0:1789304230.753875:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765462912 00000100:00100000:3.0:1789304230.753878:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765462912 00000100:00100000:3.0:1789304230.753900:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 842 00000100:00100000:3.0:1789304230.753909:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765463040:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304230.753979:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765463040:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 70us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304230.753987:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 842 00000100:00100000:3.0:1789304230.754005:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 843 00000100:00100000:3.0:1789304230.754011:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765462912:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304230.754036:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765462912:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304230.754043:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 843 00000100:00100000:3.0:1789304230.754061:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765462656 00000100:00100000:3.0:1789304230.754064:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765462656 00000100:00100000:3.0:1789304230.754135:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1000 00000100:00100000:0.0:1789304230.754786:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765462784 00000100:00100000:0.0:1789304230.754793:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765462784 00000100:00100000:0.0:1789304230.754845:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1169 00000100:00100000:0.0:1789304230.754856:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765462784:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304230.754901:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765462784:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 48us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304230.754908:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1169 00000100:00100000:3.0:1789304230.755017:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765462656:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304230.755046:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765462656:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304230.755052:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1000 00000100:00080000:3.0:1789304230.755339:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789304230.755344:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304230.755346:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1789304230.777548:0:71909:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff51c6d8e0 20000000:00000080:3.0:1789304230.777567:0:71909:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f6f4c00 uarg=0000000000000000 00010000:00010000:3.0:1789304230.777811:0:71909:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789304230.777826:0:71909:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789304230.777839:0:71909:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304230.777861:0:71909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304230.777877:0:71909:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304230.777889:0:71909:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304230.777894:0:71909:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304230.777900:0:71909:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304230.777907:0:71909:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304230.777912:0:71909:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304230.777917:0:71909:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304230.777924:0:71909:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304230.777936:0:71909:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304230.777944:0:71909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304230.777951:0:71909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129554f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304231.250819:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304231.444444:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304231.444453:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304231.444458:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304231.444513:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304231.444528:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304231.444539:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304231.444567:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785556864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304231.444640:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304231.444714:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0246df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789304231.444775:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785556864 00000100:00100000:0.0:1789304231.444783:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785556864 00000100:00100000:0.0:1789304231.444842:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1789304231.444851:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785556864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304231.444864:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304231.444879:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129555d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304231.444902:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129555d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295556 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304231.444913:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129555d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295556 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304231.444922:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789304231.444961:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785556864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304231.444968:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1789304231.445047:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785556864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304231.445061:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304231.445070:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304231.445277:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304231.445284:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304231.445294:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304231.698653:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785556992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304231.698726:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304231.698929:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785556992 00000100:00100000:0.0:1789304231.698948:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785556992 00000100:00100000:0.0:1789304231.699011:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1789304231.699022:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785556992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304231.699058:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304231.699139:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785556992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304231.699146:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00080000:2.0:1789304231.699608:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304231.699642:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785556992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304232.275176:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304233.234557:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785557376:0@lo:400:kworker.0 00000100:00100000:1.0:1789304233.234642:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304233.234699:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304233.234706:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785557504:0@lo:400:kworker.0 00000100:00100000:1.0:1789304233.234730:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304233.235144:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785557248:0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.235174:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304233.235195:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785557760:0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.235215:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304233.235233:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789304233.235238:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785557120:0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.235259:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304233.235279:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785557632:0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.235295:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304233.235324:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785557504 00000100:00100000:2.0:1789304233.235332:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785557504 00000100:00100000:2.0:1789304233.235380:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785557248 00000100:00100000:2.0:1789304233.235382:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785557248 00000100:00100000:2.0:1789304233.235397:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785557632 00000100:00100000:2.0:1789304233.235400:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785557632 00000100:00100000:2.0:1789304233.235416:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1789304233.235424:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785557504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.235477:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785557504:12345-0@lo:400:kworker.0 Request processed in 54us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304233.235484:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1789304233.235500:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:2.0:1789304233.235506:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785557248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.235536:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785557248:12345-0@lo:400:kworker.0 Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304233.235541:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:2.0:1789304233.235552:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1789304233.235558:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785557632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.235582:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785557632:12345-0@lo:400:kworker.0 Request processed in 25us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304233.235588:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1789304233.235607:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785557376 00000100:00100000:2.0:1789304233.235611:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785557376 00000100:00100000:2.0:1789304233.235637:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785557760 00000100:00100000:2.0:1789304233.235641:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785557760 00000100:00100000:2.0:1789304233.235661:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:2.0:1789304233.235667:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785557376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.235697:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785557376:12345-0@lo:400:kworker.0 Request processed in 30us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304233.235703:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:2.0:1789304233.235713:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1789304233.235719:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785557760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.235745:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785557760:12345-0@lo:400:kworker.0 Request processed in 26us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304233.235751:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1789304233.235928:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785557120 00000100:00100000:2.0:1789304233.235933:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785557120 00000100:00100000:2.0:1789304233.235954:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1789304233.235959:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785557120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.235999:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785557120:12345-0@lo:400:kworker.0 Request processed in 40us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304233.236006:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00080000:2.0:1789304233.236031:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304233.236035:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304233.236037:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304233.236079:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785557504:0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.236116:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785557376:0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.236154:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785557120:0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.236163:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785557632:0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.236171:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785557248:0@lo:400:kworker.0 00000100:00100000:2.0:1789304233.236180:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785557760:0@lo:400:kworker.0 00010000:00010000:0.0:1789304233.299718:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304233.540022:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304233.540080:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765463168 00000100:00100000:2.0:1789304233.540123:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765463168 00000100:00100000:2.0:1789304233.540624:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:2.0:1789304233.540636:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:5593:x1876219765463168:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304233.540653:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304233.540658:0:5837:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb723129551e) 00010000:00010000:2.0:1789304233.540660:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304233.540726:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:5593:x1876219765463168:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 92us (714us total) trans 0 rc 116/116 00000100:00100000:2.0:1789304233.540734:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00080000:2.0:1789304233.540759:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304234.329599:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304235.349408:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304235.372281:0:72155:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf77efda0 20000000:00000080:3.0:1789304235.372305:0:72155:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f762000 uarg=0000000000000000 00010000:00010000:3.0:1789304235.372807:0:72155:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789304235.372821:0:72155:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789304235.372835:0:72155:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304235.372853:0:72155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304235.372869:0:72155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129555d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295556 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304235.372877:0:72155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304235.372916:0:72155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129555d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295556 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304235.372935:0:72155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129555d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295556 expref: 18 pid: 5846 timeout: 1835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304235.372949:0:72155:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72155:1876219785557888:0@lo:104: 00000100:00100000:3.0:1789304235.373011:0:72155:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304235.373082:0:72155:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789304235.373082:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785557888 00000100:00100000:2.0:1789304235.373129:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785557888 00000100:00100000:2.0:1789304235.373175:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789304235.373183:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:72155:x1876219785557888:12345-0@lo:104: 00010000:00010000:2.0:1789304235.373196:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304235.373471:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304235.373478:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:72155:x1876219785557888:12345-0@lo:104: Request processed in 296us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304235.373486:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789304235.373746:0:72155:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72155:1876219785557888:0@lo:104: 00010000:00010000:3.0:1789304235.373766:0:72155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380340:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304235.380355:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380367:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304235.380372:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380383:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304235.380389:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304235.380395:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304235.380452:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380458:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304235.380483:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380489:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231295556 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129555d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380508:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304235.380510:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304235.380512:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304235.380647:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785558016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304235.380713:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304235.380801:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785558016 00000100:00100000:0.0:1789304235.380810:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785558016 00010000:00010000:0.0:1789304235.380844:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129555d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295556 expref: 19 pid: 5846 timeout: 1835 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304235.380879:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789304235.380888:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785558016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304235.380900:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304235.380905:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129555d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295556 expref: 19 pid: 5846 timeout: 1835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380916:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129555d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295556 expref: 19 pid: 5846 timeout: 1835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380930:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb000/0xefc0bb723129555d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295556 expref: 19 pid: 5846 timeout: 1835 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380943:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380952:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380968:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380975:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380982:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380988:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.380993:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304235.380997:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.381004:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.381025:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304235.381036:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304235.381081:0:72155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304235.381111:0:72155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304235.381118:0:72155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231295564 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304235.381118:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785558016:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304235.381125:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789304235.381252:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785558016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304235.794610:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785558144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304235.794689:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304235.794888:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785558144 00000100:00100000:0.0:1789304235.794897:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785558144 00000100:00100000:0.0:1789304235.794969:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1789304235.794981:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785558144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304235.795018:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304235.795085:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785558144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304235.795136:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00080000:3.0:1789304235.795315:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304235.797956:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785558144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304235.873900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304235.873943:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304235.873969:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304235.873996:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304235.874021:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765463296 00000100:00100000:3.0:1789304235.874032:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765463296 00000100:00100000:3.0:1789304235.874115:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1003 00000100:00100000:3.0:1789304235.874125:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765463296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304235.874194:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765463296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304235.874201:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1003 00000100:00100000:0.0:1789304235.874934:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765463424 00000100:00100000:0.0:1789304235.874943:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765463424 00000100:00100000:2.0:1789304235.875070:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765463680 00000100:00100000:2.0:1789304235.875075:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765463680 00000100:00100000:0.0:1789304235.875222:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1173 00000100:00100000:0.0:1789304235.875232:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765463424:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304235.875283:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765463424:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 53us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304235.875289:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1173 00000100:00080000:3.0:1789304235.882662:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304235.882674:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304235.883008:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765463552 00000100:00100000:2.0:1789304235.883018:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765463552 00000100:00100000:2.0:1789304235.883066:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 846 00000100:00100000:2.0:1789304235.883077:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765463680:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304235.883171:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765463680:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 96us (9227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304235.883179:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 846 00000100:00100000:2.0:1789304235.883197:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 847 00000100:00100000:2.0:1789304235.883204:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765463552:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304235.883241:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765463552:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (9244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304235.883247:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 847 00000100:00080000:3.0:1789304235.885121:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304236.378415:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304236.823278:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304236.823318:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785558272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304236.823388:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304236.823459:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785558272 00000100:00100000:3.0:1789304236.823470:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785558272 00000100:00100000:3.0:1789304236.823532:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1789304236.823541:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785558272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304236.823576:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304236.823625:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785558272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304236.823632:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00080000:3.0:1789304236.823652:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304236.823700:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785558272:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1789304237.266216:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304237.266224:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304237.266230:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304237.266282:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304237.266296:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304237.266314:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304237.266343:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785558400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304237.266419:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304237.266495:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304237.266623:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785558400 00000100:00100000:0.0:1789304237.266632:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785558400 00000100:00100000:0.0:1789304237.266690:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1789304237.266700:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785558400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304237.266724:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304237.266738:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295572 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129556b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304237.266764:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295572 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129556b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304237.266783:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295572 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129556b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304237.266791:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb800, rc 0) 00000100:00100000:0.0:1789304237.266853:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785558400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304237.266859:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1789304237.266974:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785558400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304237.266999:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304237.267008:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304237.267038:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304237.267044:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304237.267052:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304237.395354:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304238.354415:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785558656:0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.354500:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304238.354549:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785559168:0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.354576:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304238.354600:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304238.354606:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785558784:0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.354625:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304238.354653:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785558656 00000100:00100000:0.0:1789304238.354660:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785558656 00000100:00100000:0.0:1789304238.354704:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1789304238.354727:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785558656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.354781:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785558656:12345-0@lo:400:kworker.0 Request processed in 57us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304238.354788:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1789304238.354810:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785559168 00000100:00100000:0.0:1789304238.354814:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785559168 00000100:00100000:0.0:1789304238.354842:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785558784 00000100:00100000:0.0:1789304238.354844:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785558784 00000100:00100000:0.0:1789304238.354861:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1789304238.354867:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785559168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.354898:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785559168:12345-0@lo:400:kworker.0 Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304238.354904:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1789304238.354914:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:0.0:1789304238.354920:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785558784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.354946:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785558784:12345-0@lo:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304238.354951:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00080000:0.0:1789304238.354979:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304238.354984:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304238.355028:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785558784:0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.355041:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785558656:0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.355049:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785559168:0@lo:400:kworker.0 00000100:00100000:3.0:1789304238.355529:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785558528:0@lo:400:kworker.0 00000100:00100000:3.0:1789304238.355571:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304238.355610:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785559040:0@lo:400:kworker.0 00000100:00100000:3.0:1789304238.355635:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304238.355654:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304238.355659:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785558912:0@lo:400:kworker.0 00000100:00100000:3.0:1789304238.355680:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304238.355756:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785558528 00000100:00100000:0.0:1789304238.355762:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785558528 00000100:00100000:0.0:1789304238.355801:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1789304238.355808:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785558528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.355844:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785558528:12345-0@lo:400:kworker.0 Request processed in 38us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304238.355850:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1789304238.355875:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785559040 00000100:00100000:0.0:1789304238.355878:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785559040 00000100:00100000:0.0:1789304238.355904:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785558912 00000100:00100000:0.0:1789304238.355907:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785558912 00000100:00100000:0.0:1789304238.355925:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1789304238.355930:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785559040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.355959:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785559040:12345-0@lo:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304238.355964:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1789304238.355975:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1789304238.355981:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785558912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.356006:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785558912:12345-0@lo:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304238.356023:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00080000:0.0:1789304238.356043:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304238.356064:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785558912:0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.356073:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785558528:0@lo:400:kworker.0 00000100:00100000:0.0:1789304238.356081:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785559040:0@lo:400:kworker.0 00010000:00010000:0.0:1789304238.418390:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304238.576910:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304238.576987:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765463808 00000100:00100000:1.0:1789304238.576998:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765463808 00000100:00100000:1.0:1789304238.577106:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 603 00000100:00100000:1.0:1789304238.577116:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:42097:x1876219765463808:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304238.577136:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304238.577157:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100188 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.577219:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295580 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.577234:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.577246:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304238.577282:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789304238.577286:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304238.577307:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.577327:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100188 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.577343:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295580 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100188 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.577351:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:1.0:1789304238.577354:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304238.577358:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8f400, rc 0) 00000100:00100000:1.0:1789304238.577428:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:42097:x1876219765463808:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 301us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304238.577436:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 603 00000100:00080000:3.0:1789304238.577817:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304238.579851:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304238.579924:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765463936 00000100:00100000:1.0:1789304238.579934:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765463936 00000100:00100000:1.0:1789304238.579995:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 604 00000100:00100000:1.0:1789304238.580006:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b032ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:42097:x1876219765463936:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304238.580037:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304238.580071:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295587 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610018f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580165:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129558e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580180:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129558e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580190:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129558e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580204:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295595 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580211:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580218:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580699:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129559c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580712:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129559c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580719:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129559c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304238.580753:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789304238.580758:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304238.580780:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129559c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580794:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129558e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580800:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129558e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580806:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129558e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580812:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304238.580817:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129558e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580824:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129558e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580835:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:1.0:1789304238.580838:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304238.580843:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129558e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580853:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129558e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580864:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295595 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580869:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295595 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580875:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295595 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580880:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304238.580883:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295595 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580889:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295595 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580896:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c14adda00) 00010000:00010000:1.0:1789304238.580898:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304238.580901:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295595 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580906:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295595 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580935:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295587 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610018f expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580948:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129559c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610018f expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304238.580955:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14addf00) 00010000:00010000:1.0:1789304238.580957:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304238.580960:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ea00, rc 0) 00000100:00100000:1.0:1789304238.581032:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b032ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:42097:x1876219765463936:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 1028us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304238.581040:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 604 00000100:00100000:1.0:1789304238.584847:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304238.584922:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765464192 00000100:00100000:3.0:1789304238.584933:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765464192 00000100:00100000:3.0:1789304238.584996:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 605 00000100:00100000:3.0:1789304238.585016:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:42097:x1876219765464192:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304238.585085:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304238.585133:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129559c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610018f expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304238.585154:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14addf00) 00010000:00010000:3.0:1789304238.585167:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304238.585193:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304238.585205:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304238.585215:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789304238.609750:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000004:00010000:3.0:1789304238.611654:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b34ca69 reply state 000000008554d7ef transno 4294967529 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304238.611674:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304238.611691:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00080000:3.0:1789304238.611797:0:7654:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304238.611815:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:42097:x1876219765464192:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 26806us (26976us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1789304238.611823:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 605 00010000:00010000:3.0:1789304238.611863:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304238.611871:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304238.611879:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304238.611885:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304238.611890:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304238.611902:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304238.611918:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304238.611921:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304238.611925:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304238.611931:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312955a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789304239.393957:0:72350:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc688c3800 20000000:00000080:2.0:1789304239.393971:0:72350:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02057c00 uarg=0000000000000000 00010000:00010000:2.0:1789304239.394912:0:72350:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789304239.394952:0:72350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:2.0:1789304239.394956:0:72350:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304239.394968:0:72350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295580 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100188 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304239.394993:0:72350:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789304239.395019:0:72350:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304239.395034:0:72350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304239.395047:0:72350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295572 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129556b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304239.395057:0:72350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304239.395570:0:72350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295572 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129556b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304239.395590:0:72350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295572 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129556b expref: 18 pid: 5846 timeout: 1839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304239.395606:0:72350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0301ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72350:1876219785559296:0@lo:104: 00000100:00100000:2.0:1789304239.395676:0:72350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304239.395776:0:72350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c200aa480 going to sleep for 11 seconds 00000100:00100000:3.0:1789304239.395972:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785559296 00000100:00100000:3.0:1789304239.395979:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785559296 00000100:00100000:3.0:1789304239.396061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789304239.396071:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:72350:x1876219785559296:12345-0@lo:104: 00010000:00010000:3.0:1789304239.396085:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304239.396275:0:72350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0301ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72350:1876219785559296:0@lo:104: 00010000:00010000:2.0:1789304239.396295:0:72350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304239.396438:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304239.396445:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:72350:x1876219785559296:12345-0@lo:104: Request processed in 376us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304239.396452:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00010000:00010000:1.0:1789304239.396485:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304239.396491:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396498:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304239.396502:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396510:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304239.396517:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304239.396522:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304239.396558:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396563:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304239.396584:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396596:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129556b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295572 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396610:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304239.396612:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304239.396614:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304239.396626:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785559424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304239.396656:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304239.396700:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785559424 00000100:00100000:1.0:1789304239.396704:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785559424 00010000:00010000:1.0:1789304239.396723:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295572 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129556b expref: 19 pid: 5846 timeout: 1839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304239.396744:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789304239.396750:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785559424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304239.396761:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304239.396766:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295572 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129556b expref: 19 pid: 5846 timeout: 1839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396777:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295572 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129556b expref: 19 pid: 5846 timeout: 1839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396789:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231295572 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129556b expref: 19 pid: 5846 timeout: 1839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396801:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396813:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396827:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.396834:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.397037:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.397044:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.397049:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304239.397053:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.397061:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.397077:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304239.397087:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304239.397294:0:72350:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304239.397302:0:72350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304239.397307:0:72350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb72312955aa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304239.398401:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785559424:12345-0@lo:103:ldlm_bl.0 Request processed in 1638us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304239.398413:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789304239.398492:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785559424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304239.442464:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304240.466276:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304240.914900:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785559552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304240.914963:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304240.915197:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785559552 00000100:00100000:0.0:1789304240.915205:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785559552 00000100:00100000:0.0:1789304240.915278:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1789304240.915286:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785559552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304240.915321:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304240.915363:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785559552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304240.915370:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00080000:1.0:1789304240.915638:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304240.921282:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785559552:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1789304240.979829:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304240.979839:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304240.979844:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304240.979902:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304240.979914:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304240.979925:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304240.979948:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785559680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304240.980026:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304240.980146:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c06287b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789304240.985061:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785559680 00000100:00100000:3.0:1789304240.985079:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785559680 00000100:00100000:3.0:1789304240.985155:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1789304240.985165:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785559680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304240.985182:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304240.985203:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312955b8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312955b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304240.985232:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312955b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312955b1 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304240.985243:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312955b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312955b1 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304240.985252:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fe00, rc 0) 00000100:00100000:3.0:1789304240.985327:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785559680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (5300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304240.985334:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1789304240.985542:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785559680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304240.985561:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304240.985572:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304240.985594:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304240.985599:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304240.985608:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304240.994769:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304240.994811:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304240.994882:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765464448 00000100:00100000:2.0:1789304240.994893:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765464448 00000100:00100000:2.0:1789304240.994962:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1177 00000100:00100000:2.0:1789304240.994974:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765464448:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304240.995211:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765464448:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 239us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304240.995219:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1177 00000100:00080000:1.0:1789304240.995356:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304240.995406:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765464320 00000100:00100000:3.0:1789304240.995411:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765464320 00000100:00100000:3.0:1789304240.995450:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1007 00000100:00100000:3.0:1789304240.995458:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765464320:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304240.995501:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765464320:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 44us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304240.995508:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1007 00000100:00100000:3.0:1789304241.005267:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304241.005824:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765464576 00000100:00100000:2.0:1789304241.005835:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765464576 00000100:00100000:2.0:1789304241.005920:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 319 00000100:00100000:2.0:1789304241.005931:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765464576:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:2.0:1789304241.005960:0:17212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb72312950ef 00000100:00080000:2.0:1789304241.005970:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2b02d15000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789304241.006017:0:17212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967333 00000100:00100000:2.0:1789304241.006309:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765464576:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 381us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304241.006317:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 319 00010000:00010000:2.0:1789304241.006341:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789304241.006497:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304241.012600:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304241.016545:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765464704 00000100:00100000:0.0:1789304241.016560:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765464704 00000100:00100000:0.0:1789304241.016671:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 320 00000100:00100000:0.0:1789304241.016683:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765464704:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:0.0:1789304241.016713:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb72312953f1 00000100:00080000:0.0:1789304241.016723:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2b01e8b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789304241.016759:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967333 00000100:00100000:0.0:1789304241.017184:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765464704:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 503us (4592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304241.017193:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 320 00010000:00010000:0.0:1789304241.017215:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789304241.017393:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304241.490457:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304241.940849:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785559808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304241.940918:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304241.941011:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785559808 00000100:00100000:0.0:1789304241.941021:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785559808 00000100:00100000:0.0:1789304241.941077:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1789304241.941086:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785559808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304241.941147:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304241.941193:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785559808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304241.941200:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00080000:0.0:1789304241.941222:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304241.941257:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785559808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304242.178461:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304242.178855:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765464832 00000100:00100000:1.0:1789304242.178866:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765464832 00000100:00100000:1.0:1789304242.178929:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 606 00000100:00100000:1.0:1789304242.178939:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:42173:x1876219765464832:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304242.178960:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304242.178995:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312955bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100196 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.179293:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312955c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.179309:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312955c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.179324:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312955c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.179337:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312955cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.179344:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312955cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.179350:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312955cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183328:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312955d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183352:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312955d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183364:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312955d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304242.183402:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789304242.183406:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304242.183430:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312955d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183443:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312955c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183451:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312955c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183458:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312955c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183463:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304242.183467:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312955c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183474:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312955c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183485:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:1.0:1789304242.183487:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304242.183492:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312955c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183501:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312955c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183511:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312955cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183517:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312955cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183523:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312955cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183527:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304242.183530:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312955cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183536:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312955cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183543:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c14addc00) 00010000:00010000:1.0:1789304242.183545:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304242.183548:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312955cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183554:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb72312955cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183593:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb72312955bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100196 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183610:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312955d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100196 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304242.183618:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:1.0:1789304242.183620:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304242.183622:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e600, rc 0) 00000100:00100000:1.0:1789304242.183688:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:42173:x1876219765464832:12345-192.168.202.29@tcp:101:touch.0 Request processed in 4750us (5234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304242.183697:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 606 00000100:00080000:1.0:1789304242.183736:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304242.190532:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304242.190564:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765465088 00000100:00100000:3.0:1789304242.190573:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765465088 00000100:00100000:3.0:1789304242.190618:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 607 00000100:00100000:3.0:1789304242.190627:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42173:x1876219765465088:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304242.190647:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304242.190667:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312955db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610019d expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.190925:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312955e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.190940:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312955e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.190951:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312955e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.190965:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.190973:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.190990:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304242.196542:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13:0x0], index 0: 0 00010000:00010000:3.0:1789304242.196917:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312955f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.196935:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312955f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.196947:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312955f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.197001:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312955e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.197013:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312955e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.197225:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312955e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.197235:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304242.197239:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312955e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.197248:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312955e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.197263:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:3.0:1789304242.197267:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304242.197273:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312955e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.197279:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312955e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304242.197291:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000732cf83 reply state 0000000099e200a3 transno 4294967530 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304242.197301:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304242.197340:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312955db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610019d expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.197356:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312955f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610019d expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.197368:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304242.197371:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304242.197374:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e200, rc 0) 00000100:00100000:3.0:1789304242.197497:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:42173:x1876219765465088:12345-192.168.202.29@tcp:101:touch.0 Request processed in 6869us (6975us total) trans 4294967530 rc 0/0 00000100:00100000:3.0:1789304242.197506:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 607 00010000:00010000:0.0:1789304242.208116:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304242.208135:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304242.208143:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304242.208144:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:0.0:1789304242.208149:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304242.208154:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304242.208162:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304242.208180:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c2ea19e00) 00010000:00010000:0.0:1789304242.208183:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304242.208188:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304242.208199:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312955e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304242.208692:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765465344 00000100:00100000:3.0:1789304242.208700:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765465344 00000100:00100000:3.0:1789304242.208843:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 608 00000100:00100000:3.0:1789304242.208852:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:42173:x1876219765465344:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:3.0:1789304242.208901:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304242.208918:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312955f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610019d expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.208927:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304242.208932:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304242.208965:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.208987:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.208995:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304242.209305:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000502b874e reply state 0000000000deb9af transno 4294967531 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304242.209315:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304242.209406:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:42173:x1876219765465344:12345-192.168.202.29@tcp:36:touch.0 Request processed in 554us (1265us total) trans 4294967531 rc 0/0 00000100:00100000:3.0:1789304242.211365:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 608 00000100:00100000:1.0:1789304242.211531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:3.0:1789304242.211893:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.211904:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.211910:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.211916:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304242.211920:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.211927:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.211940:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304242.211943:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304242.211947:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.211952:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312955fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304242.212013:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765465472 00000100:00100000:2.0:1789304242.212075:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765465472 00000100:00100000:2.0:1789304242.212290:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 609 00000100:00100000:2.0:1789304242.212300:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:42173:x1876219765465472:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789304242.212323:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304242.212339:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295605 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001a4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.212383:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001a4 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.212392:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001a4 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.212404:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304242.212406:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789304242.212409:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecda00, rc 0) 00000100:00100000:2.0:1789304242.212480:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:42173:x1876219765465472:12345-192.168.202.29@tcp:101:touch.0 Request processed in 183us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304242.212484:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 609 00000100:00100000:1.0:1789304242.214339:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304242.214405:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765465600 00000100:00100000:2.0:1789304242.214415:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765465600 00000100:00100000:2.0:1789304242.214452:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 321 00000100:00100000:2.0:1789304242.214460:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876219765465600:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:2.0:1789304242.214489:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1691 last 0 00000020:00000080:2.0:1789304242.214514:0:17212:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb723129560c 00002000:00100000:2.0:1789304242.214524:0:17212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b02ecd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789304242.214533:0:17212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789304242.214618:0:17212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789304242.214643:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2b02ec8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789304242.214723:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765465600:12345-192.168.202.29@tcp:8:touch.0 Request processed in 263us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304242.214729:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 321 00000100:00100000:3.0:1789304242.216182:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304242.216271:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765465728 00000100:00100000:2.0:1789304242.216278:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765465728 00000100:00100000:2.0:1789304242.216328:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 322 00000100:00100000:2.0:1789304242.216334:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765465728:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:1.0:1789304242.216704:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789304242.237463:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967334 is committed 00000001:00100000:1.0:1789304242.237481:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00100000:1.0:1789304242.237487:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304242.237490:0:6723:0:(genops.c:885:class_export_put()) final put ffff9e2b02d15800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789304242.237545:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b02d15800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0000 00000020:00000080:0.0:1789304242.237598:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b02d15000 for lustre-OST0000 00000100:00100000:3.0:1789304242.237870:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:0:x1876219765465728:12345-192.168.202.29@tcp:2:touch.0 Request processed in 21529us (21685us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789304242.237882:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 322 00000100:00100000:0.0:1789304242.243919:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304242.244008:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765465984 00000100:00100000:2.0:1789304242.244020:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765465984 00000100:00100000:2.0:1789304242.244086:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 66 00000100:00100000:2.0:1789304242.244136:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:42173:x1876219765465984:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:2.0:1789304242.244539:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:42173:x1876219765465984:12345-192.168.202.29@tcp:35:touch.0 Request processed in 404us (630us total) trans 4294967532 rc 0/0 00000100:00100000:2.0:1789304242.244548:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 66 00000100:00100000:0.0:1789304242.285585:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304242.285702:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765466112 00000100:00100000:3.0:1789304242.285777:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765466112 00000100:00100000:3.0:1789304242.285882:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 610 00000100:00100000:3.0:1789304242.285893:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:42177:x1876219765466112:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304242.285920:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304242.285939:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295613 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001ab expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286027:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129561a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286043:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129561a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286054:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129561a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286068:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295621 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286076:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286082:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286397:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295628 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286412:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286420:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304242.286456:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 0 00000004:00200000:3.0:1789304242.286461:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304242.286483:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286572:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286583:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129561a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286590:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129561a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286598:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129561a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286605:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304242.286609:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129561a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286617:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129561a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286630:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:3.0:1789304242.286634:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304242.286640:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129561a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286646:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129561a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286661:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286666:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295621 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286671:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286676:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304242.286678:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286684:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295621 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286691:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304242.286694:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304242.286697:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295621 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286703:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295621 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286807:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295613 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ab expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286824:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295628 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ab expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.286832:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:3.0:1789304242.286835:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304242.286838:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fa00, rc 0) 00000100:00100000:3.0:1789304242.286910:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:42177:x1876219765466112:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1019us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304242.286919:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 610 00000100:00100000:1.0:1789304242.290301:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304242.290389:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765466240 00000100:00100000:2.0:1789304242.290399:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765466240 00000100:00100000:2.0:1789304242.290482:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 323 00000100:00100000:2.0:1789304242.290502:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765466240:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304242.290522:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304242.290541:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129562f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001b2 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304242.290566:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x6aa69db2, atime: 0x6aa69db2, ctime: 0x6aa69db2, blocks: 0x1 00010000:00010000:2.0:1789304242.290586:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=1691s v=(0 0) 00010000:00010000:2.0:1789304242.290591:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304242.290601:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129562f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b2 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.290619:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129562f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b2 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.290633:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc800, rc 0) 00000100:00100000:2.0:1789304242.290697:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765466240:12345-192.168.202.29@tcp:101:rm.0 Request processed in 206us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304242.290705:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 323 00000100:00100000:0.0:1789304242.293371:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304242.293443:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765466496 00000100:00100000:3.0:1789304242.293455:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765466496 00000100:00100000:3.0:1789304242.293516:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 611 00000100:00100000:3.0:1789304242.293526:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:42177:x1876219765466496:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:3.0:1789304242.293600:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304242.293626:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295628 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ab expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.293647:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295605 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001a4 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.293658:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:3.0:1789304242.293668:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304242.293689:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295636 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.293701:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295636 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.293722:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295636 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.293736:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.293743:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.293750:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.293855:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295644 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.293863:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.293870:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304242.295627:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9408 00000004:00080000:3.0:1789304242.295640:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1691973548926ns, next at 1692973546652ns, rc = 0 00010000:00010000:3.0:1789304242.295780:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295795:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295805:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295818:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295825:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295830:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295884:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304242.295908:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295915:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295644 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295921:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295644 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295927:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304242.295931:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295644 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295939:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295644 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295950:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789304242.295953:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304242.295958:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295644 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295967:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295644 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.295997:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295636 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.296004:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295636 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.296019:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295636 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.296025:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304242.296028:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295636 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.296033:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295636 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.296042:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:3.0:1789304242.296044:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304242.296047:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295636 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.296052:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295636 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304242.296062:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a995893f reply state 00000000926dd308 transno 4294967533 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304242.296071:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304242.296233:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:42177:x1876219765466496:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2705us (2872us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1789304242.296242:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 611 00010000:00010000:2.0:1789304242.297726:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304242.297739:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.297749:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304242.297753:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.297762:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.297775:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:2.0:1789304242.297778:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789304242.297782:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.297789:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129564b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.297810:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304242.297812:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304242.297813:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304242.300014:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.300030:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.300038:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.300044:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304242.300048:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.300055:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.300070:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304242.300073:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304242.300077:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304242.300083:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129563d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304242.518224:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304243.474667:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785560064:0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.474736:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304243.474796:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785560576:0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.474822:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304243.474848:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789304243.474854:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785559936:0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.474880:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304243.474914:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785560448:0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.474949:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304243.475004:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785560192:0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.475044:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304243.475048:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785560064 00000100:00100000:2.0:1789304243.475057:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785560064 00000100:00100000:3.0:1789304243.475072:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304243.475079:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785560320:0@lo:400:kworker.0 00000100:00100000:2.0:1789304243.475126:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785560448 00000100:00100000:3.0:1789304243.475127:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304243.475133:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785560448 00000100:00100000:3.0:1789304243.475163:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785560320 00000100:00100000:3.0:1789304243.475168:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785560320 00000100:00100000:2.0:1789304243.475177:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1789304243.475188:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785560064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.475201:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1789304243.475210:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785560448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304243.475265:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785560064:12345-0@lo:400:kworker.0 Request processed in 79us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304243.475272:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1789304243.475291:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1789304243.475299:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785560320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304243.475333:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785560320:12345-0@lo:400:kworker.0 Request processed in 35us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304243.475339:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1789304243.475409:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785560576 00000100:00100000:1.0:1789304243.475414:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785560576 00000100:00100000:1.0:1789304243.475452:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785560192 00000100:00100000:1.0:1789304243.475456:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785560192 00000100:00100000:1.0:1789304243.475479:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1789304243.475486:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785560576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.475523:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785560448:12345-0@lo:400:kworker.0 Request processed in 313us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304243.475530:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785560576:12345-0@lo:400:kworker.0 Request processed in 44us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304243.475534:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1789304243.475542:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1789304243.475562:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:1.0:1789304243.475570:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785560192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.475577:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785559936 00000100:00100000:3.0:1789304243.475583:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785559936 00000100:00100000:1.0:1789304243.475606:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785560192:12345-0@lo:400:kworker.0 Request processed in 37us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304243.475614:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1789304243.475617:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1789304243.475627:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785559936:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789304243.475639:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304243.475644:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304243.475647:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304243.475664:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785559936:12345-0@lo:400:kworker.0 Request processed in 38us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304243.475670:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1789304243.475726:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785560320:0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.475736:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785560192:0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.475767:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785559936:0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.475776:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785560448:0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.475786:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785560064:0@lo:400:kworker.0 00000100:00100000:3.0:1789304243.475794:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785560576:0@lo:400:kworker.0 00010000:00010000:2.0:1789304243.538255:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304243.914579:0:72595:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff048989c0 20000000:00000080:3.0:1789304243.914594:0:72595:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b0208d800 uarg=0000000000000000 00010000:00010000:3.0:1789304243.914911:0:72595:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789304243.914938:0:72595:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:3.0:1789304243.914941:0:72595:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304243.914951:0:72595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312955d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100196 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304243.914992:0:72595:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789304243.915008:0:72595:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304243.915025:0:72595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304243.915039:0:72595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312955b8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312955b1 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304243.915045:0:72595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304243.915076:0:72595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312955b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312955b1 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304243.915087:0:72595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312955b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312955b1 expref: 18 pid: 5845 timeout: 1843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304243.915181:0:72595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72595:1876219785560704:0@lo:104: 00000100:00100000:3.0:1789304243.915246:0:72595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304243.915294:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785560704 00000100:00100000:3.0:1789304243.915298:0:72595:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304243.915301:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785560704 00000100:00100000:2.0:1789304243.915438:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789304243.915446:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:72595:x1876219785560704:12345-0@lo:104: 00010000:00010000:2.0:1789304243.915460:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304243.915526:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304243.915533:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:72595:x1876219785560704:12345-0@lo:104: Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304243.915540:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789304243.915542:0:72595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72595:1876219785560704:0@lo:104: 00010000:00010000:3.0:1789304243.915557:0:72595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.915593:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304243.915601:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.915610:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304243.915615:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.915623:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304243.915628:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304243.915632:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304243.915662:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.915668:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789304243.915698:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785560832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304243.915698:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.915714:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e800/0xefc0bb72312955b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312955b8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304243.915733:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789304243.915875:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304243.915876:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304243.915877:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304243.915886:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785560832 00000100:00100000:1.0:1789304243.915889:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785560832 00010000:00010000:1.0:1789304243.915904:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312955b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312955b1 expref: 19 pid: 5845 timeout: 1843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304243.915925:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789304243.915932:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03868c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785560832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304243.915943:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304243.915948:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312955b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312955b1 expref: 19 pid: 5845 timeout: 1843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.915970:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312955b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312955b1 expref: 19 pid: 5845 timeout: 1843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.915982:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312955b8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312955b1 expref: 19 pid: 5845 timeout: 1843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.915994:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.916002:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.916015:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.916026:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.916031:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.916035:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.916038:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304243.916041:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.916045:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304243.916211:0:72595:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304243.916220:0:72595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.917192:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.917207:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231295652 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304243.917231:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304243.917303:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03868c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785560832:12345-0@lo:103:ldlm_bl.0 Request processed in 1369us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304243.917310:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789304243.918257:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785560832:0@lo:103:ldlm_bl.0 00000001:00080000:0.0:1789304244.051304:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967532 is committed 00000001:00080000:0.0:1789304244.051330:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967533 is committed 00000004:00080000:0.0:1789304244.051335:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 48 committed 00000100:00100000:0.0:1789304244.051470:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785560960:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304244.051536:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304244.052174:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785560960 00000100:00100000:3.0:1789304244.052184:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785560960 00000100:00100000:3.0:1789304244.052236:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789304244.052246:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785560960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789304244.052275:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:19 count 1 00010000:00010000:3.0:1789304244.052303:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304244.052329:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129562f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b2 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304244.052339:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789304244.052344:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304244.052348:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304244.052379:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129562f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b2 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304244.052394:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129562f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b2 expref: 5 pid: 6693 timeout: 1793 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304244.052408:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785561088:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304244.052478:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789304244.056819:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785561088:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304244.056860:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304244.058345:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304244.058507:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765466624 00000100:00100000:0.0:1789304244.058515:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765466624 00000100:00080000:1.0:1789304244.058548:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304244.058568:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129562f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b2 expref: 6 pid: 6693 timeout: 1793 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304244.058603:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 332 00000100:00100000:0.0:1789304244.058615:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765466624:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789304244.058631:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304244.058637:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129562f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b2 expref: 6 pid: 6693 timeout: 1793 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304244.058651:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129562f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b2 expref: 6 pid: 6693 timeout: 1793 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304244.058675:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129562f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b2 expref: 6 pid: 6693 timeout: 1793 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304244.058690:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304244.058695:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304244.058701:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304244.058711:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304244.058811:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304244.058822:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304244.058832:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304244.058840:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304244.058863:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304244.059211:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304244.059218:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304244.059227:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304244.059232:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304244.059241:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304244.059254:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304244.059533:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295659 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304244.059556:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304244.059612:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41372d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765466624:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 999us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304244.059620:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 332 00010000:00010000:2.0:1789304244.059675:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304244.059679:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304244.059681:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304244.060477:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785560960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8231us (8939us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789304244.060486:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000004:00080000:0.0:1789304244.061173:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b036e8e00/2, rc 0, transno 4294967335 00000100:00100000:0.0:1789304244.061183:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785560960:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789304244.564597:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304245.342171:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304245.342178:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304245.342183:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304245.342247:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304245.342265:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304245.342278:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304245.342304:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41370700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785561216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304245.342382:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304245.342428:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c373ea480 going to sleep for 11 seconds 00000100:00100000:2.0:1789304245.343066:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785561216 00000100:00100000:2.0:1789304245.343076:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785561216 00000100:00100000:3.0:1789304245.343673:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1789304245.343684:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785561216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304245.343701:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304245.343721:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295667 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295660 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304245.343954:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295667 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295660 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304245.343970:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295667 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295660 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304245.343980:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304245.344073:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785561216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 391us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304245.344081:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1789304245.344134:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41370700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785561216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304245.344162:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304245.344172:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304245.344207:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304245.344213:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304245.344220:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304245.586382:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789304245.588072:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304245.588079:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2b01e88000/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789304245.588130:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b01e88000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:0.0:1789304245.588174:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b01e8b800 for lustre-OST0001 00000100:00100000:1.0:1789304246.034557:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785561344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304246.034643:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304246.035290:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785561344 00000100:00100000:0.0:1789304246.035302:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785561344 00000100:00100000:0.0:1789304246.035431:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:0.0:1789304246.035445:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785561344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304246.035482:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304246.035543:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785561344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304246.035551:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:1.0:1789304246.035687:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41373800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785561344:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304246.035915:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304246.121320:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304246.121370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304246.121429:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304246.121468:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765466880 00000100:00100000:0.0:1789304246.121479:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765466880 00000100:00100000:0.0:1789304246.121551:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1181 00000100:00100000:0.0:1789304246.121564:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765466880:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304246.121657:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41371180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765466880:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 96us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304246.121665:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1181 00000100:00080000:0.0:1789304246.121686:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304246.122335:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765467008 00000100:00100000:2.0:1789304246.122342:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765467008 00000100:00100000:2.0:1789304246.122401:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 852 00000100:00100000:2.0:1789304246.122410:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765467008:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304246.122458:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41371880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765467008:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 49us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304246.122464:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 852 00000100:00100000:3.0:1789304246.122805:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765466752 00000100:00100000:3.0:1789304246.122822:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765466752 00000100:00100000:3.0:1789304246.122865:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1010 00000100:00100000:3.0:1789304246.122873:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765466752:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304246.122908:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765466752:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 36us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304246.122916:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1010 00000100:00080000:0.0:1789304246.126441:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304246.612604:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304246.652511:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304246.652596:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765467136 00000100:00100000:3.0:1789304246.652608:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765467136 00000100:00100000:3.0:1789304246.652670:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 612 00000100:00100000:3.0:1789304246.652681:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:42265:x1876219765467136:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304246.652703:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304246.652728:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129566e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001b9 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.652797:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295675 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.652811:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.652824:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304246.652863:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:3.0:1789304246.652868:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304246.652887:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.652914:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129566e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b9 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.652954:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b9 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.652962:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304246.652965:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304246.652969:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304246.653174:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42265:x1876219765467136:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 493us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304246.653182:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 612 00000100:00100000:1.0:1789304246.663517:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304246.667739:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765467392 00000100:00100000:2.0:1789304246.667753:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765467392 00000100:00100000:2.0:1789304246.667815:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 613 00000100:00100000:2.0:1789304246.667826:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42265:x1876219765467392:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:2.0:1789304246.667881:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304246.667908:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295675 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001b9 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304246.667924:0:5852:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312955d4) 00010000:00010000:2.0:1789304246.667929:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:2.0:1789304246.667951:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304246.667984:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304246.667999:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304246.668010:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304246.718008:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fc3aea8 reply state 0000000050d2b875 transno 4294967534 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304246.718028:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304246.718044:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000100:00100000:3.0:1789304246.718172:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:42265:x1876219765467392:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 50344us (54662us total) trans 4294967534 rc 0/0 00000100:00100000:3.0:1789304246.718183:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 613 00000001:00080000:0.0:1789304246.718568:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967534 is committed 00010000:00010000:3.0:1789304246.718615:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.718625:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.718634:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.718641:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304246.718645:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.718654:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.718671:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:3.0:1789304246.718674:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304246.718679:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304246.718685:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129567c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304247.058472:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785561472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304247.058545:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304247.058621:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785561472 00000100:00100000:3.0:1789304247.058629:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785561472 00000100:00100000:3.0:1789304247.058768:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1789304247.058789:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785561472:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304247.058789:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789304247.058827:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304247.058890:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785561472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304247.058898:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1789304247.061124:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785561472:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789304247.568230:0:72794:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6c793150 20000000:00000080:1.0:1789304247.568246:0:72794:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02054c00 uarg=0000000000000000 00010000:00010000:1.0:1789304247.569071:0:72794:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304247.569085:0:72794:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304247.569126:0:72794:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304247.569145:0:72794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304247.569162:0:72794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295667 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295660 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304247.569171:0:72794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304247.569210:0:72794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295667 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295660 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304247.569222:0:72794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295667 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295660 expref: 18 pid: 5845 timeout: 1847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304247.569233:0:72794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72794:1876219785561600:0@lo:104: 00000100:00100000:1.0:1789304247.569286:0:72794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304247.569332:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785561600 00000100:00100000:1.0:1789304247.569332:0:72794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789304247.569340:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785561600 00000100:00100000:3.0:1789304247.569435:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789304247.569446:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:72794:x1876219785561600:12345-0@lo:104: 00010000:00010000:3.0:1789304247.569459:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304247.569532:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304247.569538:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:72794:x1876219785561600:12345-0@lo:104: Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304247.569545:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789304247.569605:0:72794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72794:1876219785561600:0@lo:104: 00010000:00010000:1.0:1789304247.569620:0:72794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304247.569686:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304247.569694:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304247.569702:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304247.569706:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304247.569715:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304247.569722:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304247.569728:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304247.569761:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304247.569767:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304247.569785:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304247.569792:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231295660 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295667 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304247.569806:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304247.569807:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304247.569809:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304247.569819:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0301df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785561728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304247.569857:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304247.570474:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785561728 00000100:00100000:0.0:1789304247.570481:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785561728 00010000:00010000:0.0:1789304247.570506:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295667 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295660 expref: 19 pid: 5845 timeout: 1847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304247.570531:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789304247.570538:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785561728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304247.570548:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304247.570552:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295667 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295660 expref: 19 pid: 5845 timeout: 1847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570562:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295667 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295660 expref: 19 pid: 5845 timeout: 1847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570574:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295667 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295660 expref: 19 pid: 5845 timeout: 1847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570587:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570595:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570610:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570617:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570624:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570632:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570638:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304247.570642:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570649:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570659:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304247.570667:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304247.570712:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785561728:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304247.570718:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789304247.570743:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0301df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785561728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304247.570933:0:72794:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304247.570942:0:72794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304247.570949:0:72794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295683 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304247.639309:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304247.668543:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967335 is committed 00000100:00100000:3.0:1789304248.596306:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785562240:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.596387:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304248.596452:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789304248.596459:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785561856:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.596490:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304248.596514:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785562368:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.596537:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304248.596566:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785561984:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.596589:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304248.596607:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785562496:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.596632:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304248.596651:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304248.596656:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785562112:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.596677:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304248.596710:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785562240 00000100:00100000:3.0:1789304248.596718:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785562240 00000100:00100000:3.0:1789304248.596774:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785562368 00000100:00100000:3.0:1789304248.596778:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785562368 00000100:00100000:3.0:1789304248.596796:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785561984 00000100:00100000:3.0:1789304248.596798:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785561984 00000100:00100000:3.0:1789304248.596812:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1789304248.596821:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785562240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.596890:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785562240:12345-0@lo:400:kworker.0 Request processed in 69us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304248.596897:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1789304248.596926:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1789304248.596933:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785562368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.596963:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785562368:12345-0@lo:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304248.596968:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1789304248.596995:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1789304248.597000:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785561984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.597033:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785561984:12345-0@lo:400:kworker.0 Request processed in 33us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304248.597037:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1789304248.597056:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785561856 00000100:00100000:3.0:1789304248.597060:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785561856 00000100:00100000:3.0:1789304248.597080:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1789304248.597086:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785561856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.597141:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785561856:12345-0@lo:400:kworker.0 Request processed in 55us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304248.597147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1789304248.597182:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785562496 00000100:00100000:3.0:1789304248.597185:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785562496 00000100:00100000:3.0:1789304248.597211:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785562112 00000100:00100000:3.0:1789304248.597214:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785562112 00000100:00100000:3.0:1789304248.597230:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1789304248.597236:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785562496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.597267:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785562496:12345-0@lo:400:kworker.0 Request processed in 31us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304248.597272:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1789304248.597283:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1789304248.597289:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785562112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.597314:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785562112:12345-0@lo:400:kworker.0 Request processed in 26us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304248.597319:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00080000:3.0:1789304248.597338:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304248.597343:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304248.597383:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:3.0:1789304248.597391:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b036e8e00, transno 4294967335 00000100:00100000:3.0:1789304248.597405:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785562112:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.597419:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785561984:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.597428:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785562496:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.597788:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785561856:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.597801:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785562368:0@lo:400:kworker.0 00000100:00100000:3.0:1789304248.597811:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785562240:0@lo:400:kworker.0 00010000:00010000:2.0:1789304248.659288:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304249.058669:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304249.058678:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304249.058683:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304249.058730:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304249.058742:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304249.058755:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304249.058781:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37099f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785562624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304249.058862:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304249.058931:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789304249.066207:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785562624 00000100:00100000:2.0:1789304249.066225:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785562624 00000100:00100000:2.0:1789304249.066288:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1789304249.066298:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785562624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304249.066316:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304249.066337:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231295691 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129568a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304249.066368:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231295691 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129568a expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304249.066381:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231295691 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129568a expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304249.066391:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc200, rc 0) 00000100:00100000:2.0:1789304249.066494:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785562624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (7631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304249.066501:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:1.0:1789304249.067532:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37099f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785562624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304249.067561:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304249.067575:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304249.067601:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304249.067608:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304249.067616:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304249.682413:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304250.214194:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304250.214283:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765467520 00000100:00100000:3.0:1789304250.214294:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765467520 00000100:00100000:3.0:1789304250.214394:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 614 00000100:00100000:3.0:1789304250.214405:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:42342:x1876219765467520:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304250.214430:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304250.214457:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295698 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001c0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214526:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129569f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214541:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129569f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214556:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129569f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214569:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312956a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214575:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312956a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214585:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312956a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214875:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312956ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214884:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312956ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214892:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312956ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304250.214927:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:3.0:1789304250.214931:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304250.214964:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312956ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214976:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129569f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214982:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129569f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214989:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129569f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.214995:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304250.214999:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129569f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215007:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129569f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215019:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304250.215021:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304250.215026:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129569f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215033:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129569f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215044:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312956a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215050:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312956a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215056:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312956a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215061:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304250.215064:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312956a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215070:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312956a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215077:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c2ea19000) 00010000:00010000:3.0:1789304250.215080:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304250.215082:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312956a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215107:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312956a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215142:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295698 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001c0 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215157:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312956ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001c0 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.215164:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789304250.215167:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304250.215169:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f400, rc 0) 00000100:00100000:3.0:1789304250.215229:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:42342:x1876219765467520:12345-192.168.202.29@tcp:101:touch.0 Request processed in 825us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304250.215237:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 614 00000100:00080000:2.0:1789304250.216045:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304250.219204:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304250.219304:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765467776 00000100:00100000:3.0:1789304250.219314:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765467776 00000100:00100000:3.0:1789304250.219367:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 615 00000100:00100000:3.0:1789304250.219378:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:42342:x1876219765467776:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304250.219398:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304250.219419:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312956b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001c7 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219510:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312956bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219526:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312956bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219536:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312956bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219551:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312956c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219559:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312956c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219565:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312956c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304250.219579:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00010000:3.0:1789304250.219602:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312956bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219609:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312956bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219615:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312956bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219620:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304250.219625:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312956bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219632:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312956bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219645:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789304250.219649:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304250.219655:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312956bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219664:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312956bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219675:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312956c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219680:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312956c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219686:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312956c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219690:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304250.219693:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312956c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219699:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312956c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219706:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304250.219708:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304250.219711:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312956c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219716:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312956c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219751:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312956b4 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001c7 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219767:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789304250.219769:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304250.219772:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312956b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001c7 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.219781:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789304250.219835:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:42342:x1876219765467776:12345-192.168.202.29@tcp:101:touch.0 Request processed in 460us (640us total) trans 0 rc 301/301 00000100:00100000:3.0:1789304250.219842:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 615 00000100:00100000:3.0:1789304250.223241:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304250.225146:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765467904 00000100:00100000:1.0:1789304250.225173:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765467904 00000100:00100000:1.0:1789304250.225246:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 616 00000100:00100000:1.0:1789304250.225257:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42342:x1876219765467904:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304250.225283:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304250.225308:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312956c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001ce expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225408:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312956d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225431:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312956d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225443:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312956d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225460:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312956d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225468:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312956d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225474:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312956d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225497:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312956d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225505:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312956d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225512:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312956d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225519:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304250.225523:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312956d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225534:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312956d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225548:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:1.0:1789304250.225552:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304250.225556:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312956d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225562:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb72312956d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225574:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312956d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225580:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312956d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225586:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312956d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225591:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304250.225594:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312956d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225600:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312956d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225607:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c14addc00) 00010000:00010000:1.0:1789304250.225609:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304250.225612:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312956d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225621:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb72312956d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225653:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312956c9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ce expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225664:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:1.0:1789304250.225666:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304250.225669:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb72312956c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ce expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304250.225678:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e000, rc 0) 00000100:00100000:1.0:1789304250.225754:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42342:x1876219765467904:12345-192.168.202.29@tcp:101:touch.0 Request processed in 498us (2519us total) trans 0 rc 301/301 00000100:00100000:1.0:1789304250.225761:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 616 00000100:00100000:2.0:1789304250.227936:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304250.227981:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765468032 00000100:00100000:3.0:1789304250.227991:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765468032 00000100:00100000:3.0:1789304250.228172:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 617 00000100:00100000:3.0:1789304250.228184:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42342:x1876219765468032:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304250.228206:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304250.228228:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312956de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001d5 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228300:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312956e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228314:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312956e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228326:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312956e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228346:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312956ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228353:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312956ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228359:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312956ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228554:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312956e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228563:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312956e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228571:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312956e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228577:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304250.228581:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312956e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228589:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312956e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228600:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789304250.228603:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304250.228608:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312956e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228615:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312956e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228629:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312956ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228635:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312956ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228642:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312956ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228647:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304250.228649:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312956ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228655:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312956ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228663:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304250.228665:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304250.228668:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312956ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228674:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312956ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228711:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312956de lrc: 1/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001d5 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228722:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789304250.228725:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304250.228730:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312956de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001d5 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304250.228739:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f000, rc 0) 00000100:00100000:3.0:1789304250.228853:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42342:x1876219765468032:12345-192.168.202.29@tcp:101:touch.0 Request processed in 671us (921us total) trans 0 rc 301/301 00000100:00100000:3.0:1789304250.228860:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 617 00010000:00010000:0.0:1789304250.707152:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304251.156250:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304251.156273:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0301f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785562752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304251.156349:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304251.156429:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785562752 00000100:00100000:2.0:1789304251.156437:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785562752 00000100:00100000:2.0:1789304251.156495:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1789304251.156505:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785562752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304251.156541:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304251.156588:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785562752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304251.156595:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00080000:2.0:1789304251.156616:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304251.156649:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0301f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785562752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304251.234781:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304251.234822:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304251.234864:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304251.234910:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765468288 00000100:00100000:0.0:1789304251.234920:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765468288 00000100:00100000:0.0:1789304251.235002:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1185 00000100:00100000:0.0:1789304251.235013:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765468288:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304251.235117:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41370700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765468288:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304251.235125:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1185 00000100:00100000:2.0:1789304251.235355:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765468416 00000100:00100000:2.0:1789304251.235360:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765468416 00000100:00100000:2.0:1789304251.235425:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 855 00000100:00100000:2.0:1789304251.235432:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765468416:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304251.235466:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41373800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765468416:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 35us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304251.235471:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 855 00000100:00100000:3.0:1789304251.235818:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765468160 00000100:00100000:3.0:1789304251.235824:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765468160 00000100:00100000:3.0:1789304251.235860:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1013 00000100:00100000:3.0:1789304251.235867:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765468160:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304251.235910:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765468160:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 43us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304251.235915:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1013 00000100:00080000:0.0:1789304251.236298:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304251.730286:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304251.876494:0:73040:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcadf85660 20000000:00000080:0.0:1789304251.876512:0:73040:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c37280400 uarg=0000000000000000 00010000:00010000:0.0:1789304251.876732:0:73040:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789304251.876827:0:73040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:0.0:1789304251.876831:0:73040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304251.876843:0:73040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312956ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001c0 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304251.876868:0:73040:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789304251.876894:0:73040:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304251.876911:0:73040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304251.876924:0:73040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231295691 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129568a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304251.877039:0:73040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304251.877081:0:73040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231295691 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129568a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304251.877204:0:73040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231295691 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129568a expref: 18 pid: 5847 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304251.877220:0:73040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73040:1876219785562880:0@lo:104: 00000100:00100000:0.0:1789304251.877289:0:73040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304251.877347:0:73040:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05ad7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789304251.877435:0:52683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789304251.877449:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785562880 00000100:00100000:2.0:1789304251.877457:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785562880 00000100:00100000:2.0:1789304251.877539:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789304251.877548:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c4126f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:73040:x1876219785562880:12345-0@lo:104: 00010000:00010000:2.0:1789304251.877561:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304251.877669:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304251.877675:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c4126f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:73040:x1876219785562880:12345-0@lo:104: Request processed in 129us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304251.877682:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00010000:1.0:1789304251.877794:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304251.877802:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.877810:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304251.877814:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.877823:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304251.877830:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304251.877840:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304251.877876:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.877893:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304251.877918:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.877925:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129568a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295691 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.877953:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304251.877955:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304251.877956:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304251.877969:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785563008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304251.878003:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304251.878043:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785563008 00000100:00100000:1.0:1789304251.878047:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785563008 00010000:00010000:1.0:1789304251.878066:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231295691 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129568a expref: 19 pid: 5847 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304251.878087:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789304251.878119:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785563008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304251.878130:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304251.878134:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231295691 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129568a expref: 19 pid: 5847 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878145:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231295691 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129568a expref: 19 pid: 5847 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878160:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878169:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878182:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878189:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878196:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878202:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878207:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304251.878210:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878217:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878224:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304251.878232:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304251.878260:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785563008:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304251.878269:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789304251.878306:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785563008:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304251.879024:0:73040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231295691 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129568a expref: 18 pid: 5847 timeout: 1851 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304251.879041:0:73040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73040:1876219785562880:0@lo:104: 00010000:00010000:3.0:1789304251.879057:0:73040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304251.879067:0:73040:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304251.879073:0:73040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304251.879081:0:73040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312956f3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304252.178952:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785563136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304252.179024:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304252.185540:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785563136 00000100:00100000:1.0:1789304252.185553:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785563136 00000100:00080000:1.0:1789304252.185584:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304252.185634:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1789304252.185645:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785563136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304252.185679:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304252.185764:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785563136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (6739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304252.185771:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1789304252.185829:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785563136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304252.754246:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304253.715605:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785563264:0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.715700:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304253.715753:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785563776:0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.715780:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304253.715805:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789304253.715811:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785563392:0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.715831:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304253.715846:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785563904:0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.715879:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304253.715910:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785563520:0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.715934:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304253.715954:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304253.715959:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785563648:0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.715981:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304253.716017:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785563776 00000100:00100000:1.0:1789304253.716025:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785563776 00000100:00100000:1.0:1789304253.716082:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785563392 00000100:00100000:1.0:1789304253.716085:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785563392 00000100:00100000:1.0:1789304253.716120:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785563648 00000100:00100000:1.0:1789304253.716123:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785563648 00000100:00100000:1.0:1789304253.716140:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1789304253.716147:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785563776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.716198:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785563776:12345-0@lo:400:kworker.0 Request processed in 51us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304253.716205:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1789304253.716222:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1789304253.716228:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785563392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.716254:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785563392:12345-0@lo:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304253.716259:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1789304253.716269:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1789304253.716275:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785563648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.716303:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785563648:12345-0@lo:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304253.716308:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1789304253.716328:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785563904 00000100:00100000:1.0:1789304253.716332:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785563904 00000100:00100000:1.0:1789304253.718146:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785563520 00000100:00100000:1.0:1789304253.718161:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785563520 00000100:00100000:1.0:1789304253.718198:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1789304253.718209:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785563904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.718283:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785563904:12345-0@lo:400:kworker.0 Request processed in 77us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304253.718290:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1789304253.718305:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1789304253.718311:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785563520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.718339:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785563520:12345-0@lo:400:kworker.0 Request processed in 28us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304253.718345:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00080000:1.0:1789304253.718446:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304253.718452:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304253.718488:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785563648:0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.718500:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785563520:0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.718541:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785563392:0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.718552:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785563904:0@lo:400:kworker.0 00000100:00100000:1.0:1789304253.718564:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785563776:0@lo:400:kworker.0 00000100:00100000:0.0:1789304253.718834:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785563264 00000100:00100000:0.0:1789304253.718841:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785563264 00000100:00100000:0.0:1789304253.718888:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1789304253.718896:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785563264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304253.718938:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785563264:12345-0@lo:400:kworker.0 Request processed in 44us (3239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304253.718943:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1789304253.718987:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785563264:0@lo:400:kworker.0 00010000:00010000:2.0:1789304253.782549:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304253.843565:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304253.843575:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304253.843581:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304253.843637:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304253.843652:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304253.843669:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304253.843699:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ec4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785564032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304253.843774:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304253.843835:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b024b59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304253.844360:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785564032 00000100:00100000:2.0:1789304253.844369:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785564032 00000100:00100000:2.0:1789304253.844422:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1789304253.844430:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785564032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304253.844443:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304253.844457:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295701 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312956fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304253.844482:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295701 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312956fa expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304253.844494:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295701 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312956fa expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304253.844502:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789304253.844554:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785564032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304253.844560:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:1.0:1789304253.844636:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ec4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785564032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304253.844651:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304253.844660:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304253.844676:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304253.844681:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304253.844689:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304254.392673:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304254.392708:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765468544 00000100:00100000:3.0:1789304254.392717:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765468544 00000100:00100000:3.0:1789304254.392767:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 618 00000100:00100000:3.0:1789304254.392777:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:42429:x1876219765468544:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304254.392799:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304254.392820:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295708 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001dc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.392897:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb723129570f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.393055:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb723129570f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.393070:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb723129570f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304254.393156:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:3.0:1789304254.393161:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304254.393181:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb723129570f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.393208:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295708 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001dc expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.393230:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb723129570f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001dc expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.393243:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304254.393247:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304254.393251:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304254.393341:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42429:x1876219765468544:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 565us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304254.393355:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 618 00000100:00080000:3.0:1789304254.393376:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304254.395760:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304254.395822:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765468800 00000100:00100000:3.0:1789304254.395831:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765468800 00000100:00100000:3.0:1789304254.395892:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 619 00000100:00100000:3.0:1789304254.395902:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42429:x1876219765468800:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304254.395957:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304254.395985:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb723129570f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001dc expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.396003:0:7654:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312956ad) 00010000:00010000:3.0:1789304254.396007:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304254.396019:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304254.396042:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.396052:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.396060:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304254.396492:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5011205 reply state 00000000faa2933a transno 4294967535 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304254.396500:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304254.396508:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000100:00100000:3.0:1789304254.396580:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:42429:x1876219765468800:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 680us (828us total) trans 4294967535 rc 0/0 00000100:00100000:3.0:1789304254.396588:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 619 00010000:00010000:3.0:1789304254.403882:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.403901:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.403910:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.403917:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304254.403921:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.403930:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.403946:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304254.403949:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304254.403954:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304254.403960:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295716 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304254.802233:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304255.124544:0:73237:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7270fd20 20000000:00000080:2.0:1789304255.124562:0:73237:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f761800 uarg=0000000000000000 00010000:00010000:2.0:1789304255.125293:0:73237:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304255.125370:0:73237:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304255.125386:0:73237:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304255.125404:0:73237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304255.125420:0:73237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295701 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312956fa expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304255.125434:0:73237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304255.125477:0:73237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295701 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312956fa expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304255.125492:0:73237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295701 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312956fa expref: 18 pid: 5847 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304255.125505:0:73237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0301e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73237:1876219785564160:0@lo:104: 00000100:00100000:2.0:1789304255.125559:0:73237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304255.125645:0:73237:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16840 going to sleep for 11 seconds 00000100:00100000:3.0:1789304255.125686:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785564160 00000100:00100000:3.0:1789304255.125694:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785564160 00000100:00100000:3.0:1789304255.125877:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789304255.125887:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:73237:x1876219785564160:12345-0@lo:104: 00010000:00010000:3.0:1789304255.125900:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304255.125966:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304255.125972:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:73237:x1876219785564160:12345-0@lo:104: Request processed in 87us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304255.125979:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00010000:00010000:1.0:1789304255.126019:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304255.126026:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126035:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304255.126039:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126047:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304255.126056:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304255.126062:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304255.126112:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126119:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304255.126144:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126151:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312956fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295701 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126171:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304255.126173:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304255.126175:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304255.126192:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785564288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304255.126220:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304255.126259:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785564288 00000100:00100000:1.0:1789304255.126263:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785564288 00010000:00010000:1.0:1789304255.126279:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295701 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312956fa expref: 19 pid: 5847 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304255.126297:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789304255.126303:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785564288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304255.126324:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304255.126329:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295701 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312956fa expref: 19 pid: 5847 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126339:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295701 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312956fa expref: 19 pid: 5847 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126354:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126363:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126376:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126384:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126392:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126398:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126403:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304255.126407:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126414:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126422:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304255.126431:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304255.126455:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785564288:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304255.126461:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789304255.126495:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785564288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304255.126591:0:73237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295701 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312956fa expref: 18 pid: 5847 timeout: 1854 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304255.126602:0:73237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0301e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73237:1876219785564160:0@lo:104: 00010000:00010000:2.0:1789304255.126613:0:73237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304255.126631:0:73237:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304255.126639:0:73237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304255.126646:0:73237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd800/0xefc0bb723129571d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304255.833812:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304256.274621:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304256.274646:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0301e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785564416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304256.274719:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304256.275188:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785564416 00000100:00100000:2.0:1789304256.275199:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785564416 00000100:00100000:2.0:1789304256.275266:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1789304256.275277:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785564416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304256.275322:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304256.275383:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785564416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304256.275390:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00080000:3.0:1789304256.275498:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304256.275543:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0301e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785564416:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1789304256.338225:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304256.338232:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304256.338236:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304256.338286:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304256.338299:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304256.338317:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304256.338346:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785564544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304256.338415:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304256.338459:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789304256.338525:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785564544 00000100:00100000:3.0:1789304256.338535:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785564544 00000100:00100000:3.0:1789304256.338592:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1789304256.338601:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785564544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304256.338615:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304256.338688:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e800/0xefc0bb723129572b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304256.338712:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e800/0xefc0bb723129572b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295724 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304256.338727:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e800/0xefc0bb723129572b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295724 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304256.338736:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304256.338788:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785564544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304256.338794:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1789304256.338888:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40c74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785564544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304256.338903:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304256.338912:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304256.338933:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304256.338938:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304256.338946:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304256.357371:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304256.357562:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765468928 00000100:00100000:2.0:1789304256.357574:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765468928 00000100:00100000:2.0:1789304256.357628:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1017 00000100:00100000:2.0:1789304256.357639:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765468928:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304256.357753:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765468928:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 115us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304256.357761:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1017 00000100:00100000:0.0:1789304256.366424:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304256.366578:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304256.366632:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765469184 00000100:00100000:0.0:1789304256.366641:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765469184 00000100:00100000:0.0:1789304256.366707:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 858 00000100:00100000:0.0:1789304256.366720:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765469184:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304256.366793:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765469184:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304256.366801:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 858 00000100:00080000:0.0:1789304256.366823:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304256.369824:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765469056 00000100:00100000:3.0:1789304256.369839:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765469056 00000100:00100000:3.0:1789304256.370395:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1189 00000100:00100000:3.0:1789304256.370407:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765469056:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304256.370487:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765469056:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (4071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304256.370494:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1189 00000100:00080000:0.0:1789304256.372069:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304256.851374:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304257.300516:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785564672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304257.300591:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304257.300672:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785564672 00000100:00100000:3.0:1789304257.300680:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785564672 00000100:00100000:3.0:1789304257.300742:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1789304257.300754:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785564672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304257.300792:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304257.300857:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785564672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304257.300864:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00080000:3.0:1789304257.300890:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304257.300995:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785564672:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789304257.328392:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967535 is committed 00010000:00010000:2.0:1789304257.881488:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304258.100212:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304258.100296:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765469312 00000100:00100000:3.0:1789304258.100307:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765469312 00000100:00080000:0.0:1789304258.100363:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304258.100387:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 620 00000100:00100000:3.0:1789304258.100397:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765469312:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304258.100499:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765469312:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 103us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304258.100507:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 620 00000100:00100000:1.0:1789304258.105205:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304258.105279:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765469440 00000100:00100000:3.0:1789304258.105291:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765469440 00000100:00100000:3.0:1789304258.105425:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 325 00000100:00100000:3.0:1789304258.105437:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765469440:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304258.105857:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765469440:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 421us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304258.105865:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 325 00000100:00080000:0.0:1789304258.105943:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304258.111383:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304258.111585:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765469568 00000100:00100000:1.0:1789304258.111596:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765469568 00000100:00100000:1.0:1789304258.111663:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 326 00000100:00100000:1.0:1789304258.111672:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876219765469568:12345-192.168.202.29@tcp:8:lfs.0 00010000:00080000:1.0:1789304258.111867:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1707 last 0 00000020:00000080:1.0:1789304258.111911:0:6693:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231295732 00002000:00100000:1.0:1789304258.111923:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c389ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789304258.111947:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789304258.112369:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789304258.112398:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2c389e9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789304258.112500:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765469568:12345-192.168.202.29@tcp:8:lfs.0 Request processed in 827us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304258.112509:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 326 00000100:00100000:3.0:1789304258.117903:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304258.117972:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765469696 00000100:00100000:1.0:1789304258.117984:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765469696 00000100:00100000:1.0:1789304258.118064:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 327 00000100:00100000:1.0:1789304258.118075:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:42514:x1876219765469696:12345-192.168.202.29@tcp:19:lfs.0 00000100:00080000:0.0:1789304258.118403:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304258.118468:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:42514:x1876219765469696:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 395us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304258.118476:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 327 00000100:00100000:3.0:1789304258.122382:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304258.122451:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765469824 00000100:00100000:1.0:1789304258.122462:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765469824 00000100:00100000:1.0:1789304258.122521:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 621 00000100:00100000:1.0:1789304258.122532:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765469824:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304258.123462:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765469824:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 929us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304258.123472:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 621 00000100:00100000:3.0:1789304258.126864:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304258.126929:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765469952 00000100:00100000:0.0:1789304258.126939:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765469952 00000100:00100000:0.0:1789304258.127002:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 622 00000100:00100000:0.0:1789304258.127012:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765469952:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304258.127150:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765469952:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 139us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304258.127167:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 622 00000100:00100000:3.0:1789304258.129966:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304258.130049:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765470080 00000100:00100000:2.0:1789304258.130061:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765470080 00000100:00100000:2.0:1789304258.130177:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 328 00000100:00100000:2.0:1789304258.130188:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765470080:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304258.130837:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765470080:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 403us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304258.130845:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 328 00000100:00100000:1.0:1789304258.136406:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304258.136617:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765470208 00000100:00100000:3.0:1789304258.136628:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765470208 00000100:00100000:3.0:1789304258.136685:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 329 00000100:00100000:3.0:1789304258.136696:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42514:x1876219765470208:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304258.139282:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42514:x1876219765470208:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 2578us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304258.139295:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 329 00000100:00100000:3.0:1789304258.149461:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304258.149806:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765470336 00000100:00100000:1.0:1789304258.149817:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765470336 00000100:00100000:1.0:1789304258.149900:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 623 00000100:00100000:1.0:1789304258.149910:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765470336:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304258.150576:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:42514:x1876219765470336:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 664us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304258.150585:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 623 00000100:00100000:0.0:1789304258.223274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304258.223621:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765470464 00000100:00100000:1.0:1789304258.223632:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765470464 00000100:00100000:1.0:1789304258.223706:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 624 00000100:00100000:1.0:1789304258.223717:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:42518:x1876219765470464:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:1.0:1789304258.223739:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304258.223764:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295739 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001e3 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.223843:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295740 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.223858:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.223873:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.223885:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295747 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.223892:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.223897:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224267:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129574e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224277:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129574e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224284:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129574e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304258.224304:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789304258.224308:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304258.224327:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129574e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224339:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295740 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224345:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295740 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224352:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295740 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224358:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304258.224362:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295740 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224370:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295740 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224381:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:1.0:1789304258.224385:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304258.224390:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295740 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224396:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295740 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224409:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295747 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224415:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295747 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224421:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224427:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304258.224430:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295747 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224436:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295747 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224443:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c14addb00) 00010000:00010000:1.0:1789304258.224445:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304258.224448:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295747 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224453:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295747 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224485:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295739 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001e3 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224521:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129574e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001e3 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304258.224530:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14adde00) 00010000:00010000:1.0:1789304258.224532:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304258.224535:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8fa00, rc 0) 00000100:00100000:1.0:1789304258.224617:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42518:x1876219765470464:12345-192.168.202.29@tcp:101:dd.0 Request processed in 902us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304258.224625:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 624 00000100:00100000:2.0:1789304258.229928:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304258.230209:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765470720 00000100:00100000:3.0:1789304258.230220:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765470720 00000100:00100000:3.0:1789304258.230292:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 625 00000100:00100000:3.0:1789304258.230303:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42518:x1876219765470720:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:3.0:1789304258.230322:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304258.230343:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295755 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.230779:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129575c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.230796:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129575c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.230806:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129575c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.230820:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.230836:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.230843:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304258.232319:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13:0x0], index 1: 0 00010000:00010000:3.0:1789304258.232865:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129576a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.232992:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129576a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.233003:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129576a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.233045:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129575c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.233053:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129575c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.233060:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129575c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.233065:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304258.233070:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129575c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.233077:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129575c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.233232:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14adde00) 00010000:00010000:3.0:1789304258.233236:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304258.233243:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129575c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.233250:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129575c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304258.233264:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd0e8c6b reply state 000000004c3bcb2e transno 4294967536 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304258.233274:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304258.233312:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295755 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ea expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.233328:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129576a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ea expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304258.233336:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304258.233338:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304258.233341:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304258.233414:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:42518:x1876219765470720:12345-192.168.202.29@tcp:101:dd.0 Request processed in 3113us (3494us total) trans 4294967536 rc 0/0 00000100:00100000:3.0:1789304258.233423:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 625 00010000:00010000:2.0:1789304258.236439:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304258.236462:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304258.236469:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304258.236475:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304258.236480:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304258.236488:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304258.236519:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c2ea19000) 00010000:00010000:2.0:1789304258.236522:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304258.236526:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304258.236532:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295763 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304258.245277:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304258.246006:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765470848 00000100:00100000:0.0:1789304258.246017:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765470848 00000100:00100000:0.0:1789304258.246082:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 330 00000100:00100000:0.0:1789304258.246126:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42518:x1876219765470848:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789304258.246145:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304258.246169:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb7231295778 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001f1 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304258.246195:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789304258.246220:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=1707s v=(0 0) 00010000:00010000:0.0:1789304258.246224:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304258.246233:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb7231295778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f1 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304258.246252:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb7231295778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f1 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304258.246265:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:0.0:1789304258.246321:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:42518:x1876219765470848:12345-192.168.202.29@tcp:101:dd.0 Request processed in 231us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304258.246329:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 330 00000100:00100000:3.0:1789304258.268218:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304258.268952:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765470976 00000100:00100000:0.0:1789304258.268966:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765470976 00002000:00100000:0.0:1789304258.269031:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff9e2c02ea8000 x1876219765470976/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:324/0 lens 488/0 e 0 to 0 dl 1789304269 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789304258.269043:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c02ea8000 with x1876219765470976 ext(0->1048575) 00002000:00010000:0.0:1789304258.269048:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c02ea8000 00000100:00100000:0.0:1789304258.269179:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:0.0:1789304258.269190:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765470976:12345-192.168.202.29@tcp:4:dd.0 00000001:00100000:3.0:1789304258.316068:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00080000:0.0:1789304258.349148:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967334 is committed 00000100:00100000:3.0:1789304258.349238:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765470976:12345-192.168.202.29@tcp:4:dd.0 Request processed in 80043us (81025us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789304258.349251:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00002000:00100000:3.0:1789304258.349264:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff9e2c02ea8000 x1876219765470976/t4294967334(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:324/0 lens 488/448 e 0 to 0 dl 1789304269 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789304258.349273:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c02ea8000 with x1876219765470976 ext(0->1048575) 00002000:00010000:3.0:1789304258.349279:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c02ea8000 00000100:00100000:2.0:1789304258.351907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304258.351967:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765471104 00000100:00100000:0.0:1789304258.351978:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765471104 00000100:00100000:0.0:1789304258.352055:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 626 00000100:00100000:0.0:1789304258.352068:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:42518:x1876219765471104:12345-192.168.202.29@tcp:44:dd.0 00000001:00080000:3.0:1789304258.374751:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967536 is committed 00000100:00100000:1.0:1789304258.375161:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:42518:x1876219765471104:12345-192.168.202.29@tcp:44:dd.0 Request processed in 23088us (23255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304258.375172:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 626 00000100:00100000:0.0:1789304258.377845:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304258.377920:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765471232 00000100:00100000:3.0:1789304258.377932:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765471232 00000100:00100000:3.0:1789304258.378036:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 331 00000100:00100000:3.0:1789304258.378047:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765471232:12345-192.168.202.29@tcp:16:dd.0 00000100:00100000:3.0:1789304258.378224:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765471232:12345-192.168.202.29@tcp:16:dd.0 Request processed in 178us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304258.378231:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 331 00000100:00100000:0.0:1789304258.381141:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304258.381346:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765471488 00000100:00100000:3.0:1789304258.381355:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765471488 00000100:00100000:3.0:1789304258.381416:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 67 00000100:00100000:3.0:1789304258.381427:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:42518:x1876219765471488:12345-192.168.202.29@tcp:35:dd.0 00000100:00100000:3.0:1789304258.382040:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:42518:x1876219765471488:12345-192.168.202.29@tcp:35:dd.0 Request processed in 610us (902us total) trans 4294967537 rc 0/0 00000100:00100000:3.0:1789304258.382049:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 67 00000100:00100000:3.0:1789304258.834324:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785564928:0@lo:400:kworker.0 00000100:00100000:3.0:1789304258.834403:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304258.834457:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785565440:0@lo:400:kworker.0 00000100:00100000:3.0:1789304258.834482:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304258.834508:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304258.834513:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785565056:0@lo:400:kworker.0 00000100:00100000:3.0:1789304258.834535:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304258.834565:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785565440 00000100:00100000:3.0:1789304258.834572:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785565440 00000100:00100000:3.0:1789304258.834627:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785565056 00000100:00100000:3.0:1789304258.834630:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785565056 00000100:00100000:3.0:1789304258.834651:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1789304258.834659:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785565440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304258.834708:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785565440:12345-0@lo:400:kworker.0 Request processed in 49us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304258.834715:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1789304258.834733:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1789304258.834739:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785565056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304258.834764:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785565056:12345-0@lo:400:kworker.0 Request processed in 25us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304258.834770:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00080000:3.0:1789304258.834784:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304258.834812:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785565056:0@lo:400:kworker.0 00000100:00100000:3.0:1789304258.834836:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785565440:0@lo:400:kworker.0 00000100:00100000:1.0:1789304258.834921:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785564800:0@lo:400:kworker.0 00000100:00100000:1.0:1789304258.834955:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304258.834989:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785565312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304258.835010:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304258.835030:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304258.835035:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785565184:0@lo:400:kworker.0 00000100:00100000:1.0:1789304258.835052:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304258.835081:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785564928 00000100:00100000:1.0:1789304258.835084:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785564928 00000100:00100000:1.0:1789304258.835134:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785565312 00000100:00100000:1.0:1789304258.835137:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785565312 00000100:00100000:1.0:1789304258.835157:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785565184 00000100:00100000:1.0:1789304258.835161:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785565184 00000100:00100000:1.0:1789304258.835175:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1789304258.835181:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785564928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304258.835217:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785564928:12345-0@lo:400:kworker.0 Request processed in 35us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304258.835223:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1789304258.835235:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1789304258.835240:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785565312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304258.835269:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785565312:12345-0@lo:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304258.835274:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1789304258.835284:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1789304258.835290:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785565184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304258.835311:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785565184:12345-0@lo:400:kworker.0 Request processed in 22us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304258.835316:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:1.0:1789304258.835344:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304258.835360:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785565184:0@lo:400:kworker.0 00000100:00100000:1.0:1789304258.835369:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785565312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304258.835389:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785564928:0@lo:400:kworker.0 00000100:00100000:3.0:1789304258.835591:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785564800 00000100:00100000:3.0:1789304258.835595:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785564800 00000100:00100000:3.0:1789304258.835629:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1789304258.835636:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785564800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304258.835670:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785564800:12345-0@lo:400:kworker.0 Request processed in 35us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304258.835676:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1789304258.835749:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785564800:0@lo:400:kworker.0 00010000:00010000:2.0:1789304258.898865:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304259.449934:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967537 is committed 00010000:00010000:0.0:1789304259.928366:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304260.672618:0:73485:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1710350524016ns, next at 1692973546652ns, rc = 0 00000004:00080000:1.0:1789304260.672786:0:73485:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1710350694041ns, next at 1655415473340ns, rc = 0 00000004:00080000:0.0:1789304260.675577:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 54 committed 00000004:00080000:0.0:1789304260.675601:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 49 committed 00010000:00010000:2.0:1789304260.947730:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304261.395349:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304261.395374:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0301e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785565568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304261.395471:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304261.395692:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785565568 00000100:00100000:2.0:1789304261.395701:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785565568 00000100:00100000:2.0:1789304261.395762:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1789304261.395773:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785565568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304261.395823:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789304261.395884:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785565568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304261.395891:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00080000:3.0:1789304261.396257:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304261.396295:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0301e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785565568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304261.480465:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304261.480513:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304261.480544:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304261.480568:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304261.480598:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765472000 00000100:00100000:3.0:1789304261.480608:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765472000 00000100:00100000:3.0:1789304261.480665:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765471872 00000100:00100000:3.0:1789304261.480669:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765471872 00000100:00100000:3.0:1789304261.480694:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 861 00000100:00100000:3.0:1789304261.480703:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765472000:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304261.480876:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765471744 00000100:00100000:0.0:1789304261.480880:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765471744 00000100:00100000:0.0:1789304261.480918:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1193 00000100:00100000:0.0:1789304261.480928:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765471744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304261.481007:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765471744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304261.481015:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1193 00000100:00100000:0.0:1789304261.482629:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 862 00000100:00100000:0.0:1789304261.482647:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765471872:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304261.482744:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765471872:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 106us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304261.482752:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 862 00000100:00080000:0.0:1789304261.482784:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304261.482791:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304261.482804:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304261.482822:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765471616 00000100:00100000:0.0:1789304261.482831:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765471616 00000100:00100000:3.0:1789304261.483083:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765472000:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 2380us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304261.483112:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 861 00000100:00100000:0.0:1789304261.483213:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1019 00000100:00100000:0.0:1789304261.483222:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765471616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304261.483249:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765471616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304261.483255:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1019 00010000:00010000:1.0:1789304261.972273:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304261.995979:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304261.996138:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765472128 00000100:00100000:1.0:1789304261.996152:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765472128 00000100:00100000:1.0:1789304261.996206:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 627 00000100:00100000:1.0:1789304261.996216:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:42710:x1876219765472128:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304261.996331:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:42710:x1876219765472128:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 116us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304261.996338:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 627 00000100:00100000:0.0:1789304262.001682:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304262.001770:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765472256 00000100:00100000:3.0:1789304262.001781:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765472256 00000100:00100000:3.0:1789304262.001863:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 332 00000100:00100000:3.0:1789304262.001873:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:42710:x1876219765472256:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304262.002289:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:42710:x1876219765472256:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 416us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304262.002297:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 332 00000100:00100000:0.0:1789304262.010208:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304262.012665:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765472384 00000100:00100000:3.0:1789304262.012678:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765472384 00000100:00100000:3.0:1789304262.012740:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 333 00000100:00100000:3.0:1789304262.012750:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42710:x1876219765472384:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304262.013158:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42710:x1876219765472384:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 408us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304262.013166:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 333 00000100:00100000:3.0:1789304262.016600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304262.016693:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765472512 00000100:00100000:2.0:1789304262.016703:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765472512 00000100:00100000:2.0:1789304262.016761:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 628 00000100:00100000:2.0:1789304262.016771:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:42710:x1876219765472512:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304262.017225:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:42710:x1876219765472512:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 453us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304262.017234:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 628 00000100:00100000:2.0:1789304262.025372:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304262.025440:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765472640 00000100:00100000:3.0:1789304262.025450:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765472640 00000100:00100000:3.0:1789304262.025511:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 629 00000100:00100000:3.0:1789304262.025521:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0301e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:42710:x1876219765472640:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304262.025637:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0301e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:42710:x1876219765472640:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 117us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304262.025646:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 629 00000100:00100000:0.0:1789304262.027760:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304262.027849:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765472768 00000100:00100000:3.0:1789304262.027859:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765472768 00000100:00100000:3.0:1789304262.027914:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 334 00000100:00100000:3.0:1789304262.027925:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:42710:x1876219765472768:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304262.028336:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:42710:x1876219765472768:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 413us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304262.028344:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 334 00000100:00100000:3.0:1789304262.031204:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304262.031545:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765472896 00000100:00100000:1.0:1789304262.031561:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765472896 00000100:00100000:1.0:1789304262.031637:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 335 00000100:00100000:1.0:1789304262.031649:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42710:x1876219765472896:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304262.032068:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:42710:x1876219765472896:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 420us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304262.032076:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 335 00000100:00100000:3.0:1789304262.033869:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304262.034178:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765473024 00000100:00100000:1.0:1789304262.034191:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765473024 00000100:00100000:1.0:1789304262.034252:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 630 00000100:00100000:1.0:1789304262.034262:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:42710:x1876219765473024:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304262.035280:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:42710:x1876219765473024:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 1016us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304262.035289:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 630 00000100:00100000:2.0:1789304262.108786:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304262.108878:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765473280 00000100:00100000:3.0:1789304262.108890:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765473280 00000100:00100000:3.0:1789304262.108960:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 631 00000100:00100000:3.0:1789304262.108971:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:42714:x1876219765473280:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:3.0:1789304262.109036:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304262.109067:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129576a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ea expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.109124:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304262.109137:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304262.109164:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129577f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.109181:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129577f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.109190:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129577f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.109205:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.109212:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.109218:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.109536:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129578d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.109546:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129578d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.109554:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129578d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304262.110737:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 64 off9408 00000004:00080000:3.0:1789304262.110750:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1711788659344ns, next at 1712788656582ns, rc = 0 00010000:00010000:3.0:1789304262.110868:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.110882:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.110897:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.110905:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.110911:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.110917:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.110935:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304262.111189:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304262.111196:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304262.111203:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304262.111208:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304262.111217:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304262.111228:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:1.0:1789304262.111231:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304262.111236:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304262.111242:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295794 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304262.111255:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304262.111257:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304262.111259:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304262.111388:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129578d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111397:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129578d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111402:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129578d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111407:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304262.111410:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129578d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111416:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129578d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111424:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:3.0:1789304262.111427:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304262.111431:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129578d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111437:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129578d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111459:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129577f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111465:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129577f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111471:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129577f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111476:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304262.111479:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129577f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111486:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129577f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111494:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14adde00) 00010000:00010000:3.0:1789304262.111496:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304262.111500:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129577f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304262.111506:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129577f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304262.111516:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a9bc884 reply state 00000000ba1ff6e2 transno 4294967538 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304262.111532:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304262.111638:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:42714:x1876219765473280:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2666us (2863us total) trans 4294967538 rc 0/0 00000100:00100000:3.0:1789304262.111647:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 631 00010000:00010000:0.0:1789304262.116967:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304262.116988:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304262.116997:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304262.117004:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304262.117010:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304262.117019:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304262.117037:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c2ea19c00) 00010000:00010000:0.0:1789304262.117040:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304262.117045:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304262.117051:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295786 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304262.418547:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304262.418570:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785565696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304262.418631:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304262.418846:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785565696 00000100:00100000:3.0:1789304262.418853:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785565696 00000100:00100000:3.0:1789304262.418921:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1789304262.418932:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785565696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304262.418971:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304262.419035:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785565696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304262.419043:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00080000:0.0:1789304262.419146:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304262.419291:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785565696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304262.997995:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304263.956516:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785565824:0@lo:400:kworker.0 00000100:00100000:1.0:1789304263.956606:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304263.956740:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785565824 00000100:00100000:2.0:1789304263.956751:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785565824 00000100:00100000:2.0:1789304263.956841:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1789304263.956851:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785565824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304263.957283:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785566208:0@lo:400:kworker.0 00000100:00100000:3.0:1789304263.957323:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304263.957796:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785565824:12345-0@lo:400:kworker.0 Request processed in 945us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304263.957805:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1789304263.957855:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785566208 00000100:00100000:2.0:1789304263.957861:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785566208 00000100:00100000:2.0:1789304263.957916:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1789304263.957925:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785566208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304263.957970:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785566208:12345-0@lo:400:kworker.0 Request processed in 47us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304263.957977:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1789304263.958019:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785566208:0@lo:400:kworker.0 00000100:00080000:3.0:1789304263.958168:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304263.958477:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304263.958529:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785565952:0@lo:400:kworker.0 00000100:00100000:0.0:1789304263.958569:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304263.958604:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785566464:0@lo:400:kworker.0 00000100:00100000:0.0:1789304263.958628:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304263.958649:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304263.958656:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785566080:0@lo:400:kworker.0 00000100:00100000:0.0:1789304263.958676:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304263.958707:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785566464 00000100:00100000:0.0:1789304263.958711:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785566464 00000100:00100000:0.0:1789304263.958747:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785566080 00000100:00100000:0.0:1789304263.958750:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785566080 00000100:00100000:0.0:1789304263.958782:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1789304263.958790:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785566464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304263.958971:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785565952 00000100:00100000:3.0:1789304263.958976:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785565952 00000100:00100000:3.0:1789304263.959004:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1789304263.959010:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785565952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304263.959135:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785565824:0@lo:400:kworker.0 00000100:00100000:2.0:1789304263.959474:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785566336:0@lo:400:kworker.0 00000100:00100000:3.0:1789304263.959708:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785565952:12345-0@lo:400:kworker.0 Request processed in 698us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304263.959716:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1789304263.959787:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785566464:12345-0@lo:400:kworker.0 Request processed in 997us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304263.959795:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1789304263.959823:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1789304263.959848:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785566080:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789304263.960288:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304263.960514:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785566080:12345-0@lo:400:kworker.0 Request processed in 668us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304263.960523:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1789304263.960571:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785566080:0@lo:400:kworker.0 00000100:00100000:0.0:1789304263.960583:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785565952:0@lo:400:kworker.0 00000100:00100000:0.0:1789304263.960593:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785566464:0@lo:400:kworker.0 00000100:00100000:3.0:1789304263.960789:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304263.961013:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785566336 00000100:00100000:0.0:1789304263.961027:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785566336 00000100:00100000:0.0:1789304263.961283:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:0.0:1789304263.961292:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785566336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304263.961355:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785566336:12345-0@lo:400:kworker.0 Request processed in 65us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304263.961369:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1789304263.961437:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785566336:0@lo:400:kworker.0 00000100:00080000:1.0:1789304263.961648:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304264.019362:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304264.196603:0:73630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1713874508704ns, next at 1692973546652ns, rc = 0 00000004:00080000:3.0:1789304264.196710:0:73630:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1713874618300ns, next at 1712788656582ns, rc = 0 00000004:00080000:0.0:1789304264.225477:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 56 committed 00000004:00080000:0.0:1789304264.225509:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 50 committed 00000001:00080000:0.0:1789304264.225528:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967538 is committed 00000004:00080000:0.0:1789304264.225533:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 55 committed 00000100:00100000:1.0:1789304264.225908:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304264.226158:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785566592:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789304264.226231:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304264.226433:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785566592 00000100:00100000:2.0:1789304264.226441:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785566592 00000100:00100000:2.0:1789304264.226560:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789304264.226570:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785566592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789304264.226598:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:19 count 1 00010000:00010000:2.0:1789304264.226625:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304264.226650:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb7231295778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f1 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304264.226660:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x13:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1789304264.226665:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304264.226670:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304264.226782:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb7231295778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f1 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304264.226799:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb7231295778 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f1 expref: 5 pid: 17212 timeout: 1813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304264.226827:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785566720:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789304264.226907:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05ad70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304264.229454:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785566720:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304264.229487:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304264.231238:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304264.231571:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765473408 00000100:00100000:0.0:1789304264.231581:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765473408 00010000:00010000:0.0:1789304264.231649:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb7231295778 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f1 expref: 6 pid: 17212 timeout: 1813 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304264.231705:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 336 00000100:00100000:0.0:1789304264.231721:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765473408:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789304264.231737:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304264.231743:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb7231295778 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f1 expref: 6 pid: 17212 timeout: 1813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.231759:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb7231295778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f1 expref: 6 pid: 17212 timeout: 1813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.231796:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb7231295778 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f1 expref: 6 pid: 17212 timeout: 1813 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.231827:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304264.231839:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304264.231844:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.231853:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.231884:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304264.231938:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765473408:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 222us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304264.231946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 336 00010000:00010000:0.0:1789304264.231976:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.231985:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.231996:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.232004:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.232022:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789304264.232692:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785566592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6122us (6460us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789304264.232700:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:3.0:1789304264.233395:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304264.234431:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304264.234446:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.234463:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304264.234468:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.234480:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.234509:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.234518:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb723129579b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304264.234548:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304264.234550:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304264.234552:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304264.235188:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c02ea9500/2, rc 0, transno 4294967335 00000100:00100000:2.0:1789304264.235212:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785566592:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789304265.042361:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304266.067124:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304266.515030:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785566848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304266.515150:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304266.515408:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785566848 00000100:00100000:3.0:1789304266.515418:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785566848 00000100:00100000:3.0:1789304266.515503:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:3.0:1789304266.515514:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785566848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304266.515552:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789304266.515606:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785566848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304266.515613:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00080000:0.0:1789304266.516068:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304266.516133:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785566848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304266.597827:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304266.597873:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304266.597914:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304266.597947:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304266.598048:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765473792 00000100:00100000:1.0:1789304266.598061:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765473792 00000100:00100000:3.0:1789304266.598123:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765473664 00000100:00100000:3.0:1789304266.598129:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765473664 00000100:00100000:3.0:1789304266.598181:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1197 00000100:00100000:3.0:1789304266.598191:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765473664:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304266.598274:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765473664:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 85us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304266.598281:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1197 00000100:00100000:3.0:1789304266.598310:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765473920 00000100:00100000:3.0:1789304266.598314:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765473920 00000100:00100000:3.0:1789304266.598338:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 865 00000100:00100000:3.0:1789304266.598345:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765473920:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304266.598368:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765473920:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304266.598375:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 865 00000100:00100000:1.0:1789304266.598391:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 866 00000100:00100000:1.0:1789304266.598409:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765473792:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304266.598457:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765473792:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 56us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304266.598515:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765473536 00000100:00100000:2.0:1789304266.598522:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765473536 00000100:00100000:2.0:1789304266.598554:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1021 00000100:00100000:2.0:1789304266.598563:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765473536:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1789304266.598589:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304266.598595:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304266.598598:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304266.598603:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765473536:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304266.598612:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1021 00000100:00100000:1.0:1789304266.603540:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 866 00000001:00080000:2.0:1789304267.084558:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967335 is committed 00010000:00010000:0.0:1789304267.090725:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304267.538644:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304267.538673:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0281ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785566976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304267.538766:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304267.539383:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785566976 00000100:00100000:3.0:1789304267.539404:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785566976 00000100:00100000:3.0:1789304267.539486:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1789304267.539867:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785566976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304267.539903:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304267.540333:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785566976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 838us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304267.540342:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1789304267.540517:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0281ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785566976:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304267.540646:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304268.116121:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304269.080065:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0281ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785567104:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080162:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304269.080209:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0281f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785567616:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080236:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304269.080261:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789304269.080266:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0281f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785567232:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080289:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304269.080304:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0281c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785567744:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080323:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304269.080352:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0281d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785567360:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080406:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304269.080427:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304269.080433:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0281e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785567488:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080452:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304269.080485:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785567616 00000100:00100000:3.0:1789304269.080493:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785567616 00000100:00100000:3.0:1789304269.080538:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785567232 00000100:00100000:3.0:1789304269.080541:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785567232 00000100:00100000:3.0:1789304269.080554:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785567488 00000100:00100000:3.0:1789304269.080556:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785567488 00000100:00100000:3.0:1789304269.080571:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1789304269.080578:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785567616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080625:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785567616:12345-0@lo:400:kworker.0 Request processed in 47us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304269.080643:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1789304269.080659:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1789304269.080664:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785567232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080687:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785567232:12345-0@lo:400:kworker.0 Request processed in 24us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304269.080692:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1789304269.080706:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1789304269.080711:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785567488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080749:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785567488:12345-0@lo:400:kworker.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304269.080754:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1789304269.080770:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785567744 00000100:00100000:3.0:1789304269.080774:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785567744 00000100:00100000:3.0:1789304269.080797:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785567360 00000100:00100000:3.0:1789304269.080799:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785567360 00000100:00100000:3.0:1789304269.080817:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1789304269.080823:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785567744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080852:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785567744:12345-0@lo:400:kworker.0 Request processed in 30us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304269.080858:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1789304269.080868:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:3.0:1789304269.080874:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785567360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080899:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785567360:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304269.080904:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00080000:3.0:1789304269.080925:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304269.080929:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304269.080931:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304269.080984:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0281e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785567488:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.080996:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0281d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785567360:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.081032:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0281f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785567232:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.081041:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:3.0:1789304269.081046:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c02ea9500, transno 4294967335 00000100:00100000:3.0:1789304269.081056:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0281c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785567744:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.081066:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0281f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785567616:0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.081474:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785567104 00000100:00100000:3.0:1789304269.081480:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785567104 00000100:00100000:3.0:1789304269.081509:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:3.0:1789304269.081516:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785567104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304269.081557:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785567104:12345-0@lo:400:kworker.0 Request processed in 41us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304269.081563:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:3.0:1789304269.081602:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0281ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785567104:0@lo:400:kworker.0 00010000:00010000:2.0:1789304269.142016:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304270.162872:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304271.189630:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304271.635154:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785567872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304271.635231:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304271.635360:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785567872 00000100:00100000:1.0:1789304271.635369:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785567872 00000100:00100000:1.0:1789304271.635444:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:1.0:1789304271.635461:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785567872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304271.635494:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789304271.635570:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304271.646748:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785567872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11278us (11506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304271.646765:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1789304271.650292:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785567872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304271.714191:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304271.714239:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304271.714258:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765474176 00000100:00100000:0.0:1789304271.714269:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765474176 00000100:00100000:3.0:1789304271.714284:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304271.714326:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304271.714348:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1201 00000100:00100000:3.0:1789304271.714357:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765474432 00000100:00100000:3.0:1789304271.714363:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765474432 00000100:00100000:0.0:1789304271.714365:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765474176:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304271.714401:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765474304 00000100:00100000:3.0:1789304271.714406:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765474304 00000100:00100000:3.0:1789304271.714432:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 869 00000100:00100000:3.0:1789304271.714442:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765474432:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304271.714482:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765474432:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304271.714482:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765474176:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 121us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304271.714498:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1201 00000100:00100000:3.0:1789304271.714569:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 869 00000100:00100000:3.0:1789304271.714591:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 870 00000100:00100000:3.0:1789304271.714599:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765474304:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304271.714665:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765474048 00000100:00100000:2.0:1789304271.714670:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765474048 00000100:00100000:2.0:1789304271.714715:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1023 00000100:00100000:2.0:1789304271.714723:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765474048:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1789304271.714759:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304271.714763:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304271.714766:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304271.715073:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765474304:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 473us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304271.715082:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 870 00000100:00100000:2.0:1789304271.718475:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765474048:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 3739us (4177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304271.718490:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1023 00010000:00010000:2.0:1789304272.210387:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304272.660045:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304272.660069:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0281d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785568000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304272.660159:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304272.660300:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785568000 00000100:00100000:3.0:1789304272.660310:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785568000 00000100:00100000:3.0:1789304272.660382:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1789304272.660392:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785568000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304272.660426:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789304272.660477:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304272.660499:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785568000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304272.660506:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1789304272.660812:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0281d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785568000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304273.234311:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304274.194411:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304274.194483:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304274.194504:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785568256:0@lo:400:kworker.0 00000100:00100000:3.0:1789304274.194573:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304274.194730:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785568256 00000100:00100000:1.0:1789304274.194739:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785568256 00000100:00100000:1.0:1789304274.194808:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1789304274.194818:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785568256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304274.194884:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785568256:12345-0@lo:400:kworker.0 Request processed in 68us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304274.194890:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1789304274.195124:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785568256:0@lo:400:kworker.0 00000100:00100000:0.0:1789304274.199585:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785568128:0@lo:400:kworker.0 00000100:00100000:0.0:1789304274.199693:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304274.199867:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785568128 00000100:00100000:3.0:1789304274.199877:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785568128 00000100:00100000:3.0:1789304274.199937:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1789304274.199947:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785568128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304274.200045:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785568128:12345-0@lo:400:kworker.0 Request processed in 100us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304274.200062:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1789304274.200503:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785568128:0@lo:400:kworker.0 00000100:00100000:1.0:1789304274.201440:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785568768:0@lo:400:kworker.0 00000100:00100000:1.0:1789304274.201498:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304274.201541:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304274.201547:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785568640:0@lo:400:kworker.0 00000100:00100000:1.0:1789304274.201584:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304274.201858:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785568640 00000100:00100000:3.0:1789304274.201866:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785568640 00000100:00100000:3.0:1789304274.201925:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1789304274.201935:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785568640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304274.202001:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785568640:12345-0@lo:400:kworker.0 Request processed in 69us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304274.202009:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00080000:1.0:1789304274.202233:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304274.202265:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785568640:0@lo:400:kworker.0 00000100:00100000:0.0:1789304274.202342:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785568384:0@lo:400:kworker.0 00000100:00100000:0.0:1789304274.202391:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304274.202432:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304274.202438:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785568512:0@lo:400:kworker.0 00000100:00100000:0.0:1789304274.202462:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304274.202504:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785568512 00000100:00100000:0.0:1789304274.202509:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785568512 00000100:00100000:0.0:1789304274.202542:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1789304274.202549:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785568512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304274.202589:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785568512:12345-0@lo:400:kworker.0 Request processed in 40us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304274.202595:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1789304274.202633:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785568512:0@lo:400:kworker.0 00000100:00080000:1.0:1789304274.202806:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304274.202918:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785568768 00000100:00100000:2.0:1789304274.202924:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785568768 00000100:00080000:1.0:1789304274.203037:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304274.203337:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785568384 00000100:00100000:2.0:1789304274.203341:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785568384 00000100:00100000:1.0:1789304274.203511:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1789304274.203521:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785568768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304274.203584:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785568768:12345-0@lo:400:kworker.0 Request processed in 65us (2085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304274.203590:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1789304274.203640:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785568768:0@lo:400:kworker.0 00000100:00100000:2.0:1789304274.203775:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1789304274.203783:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785568384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304274.203823:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785568384:12345-0@lo:400:kworker.0 Request processed in 41us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304274.203829:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00080000:0.0:1789304274.209562:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304274.209635:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785568384:0@lo:400:kworker.0 00010000:00010000:2.0:1789304274.258358:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304275.283299:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304276.306366:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304276.754660:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785568896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304276.754736:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304276.755065:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785568896 00000100:00100000:2.0:1789304276.755075:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785568896 00000100:00100000:2.0:1789304276.755168:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1789304276.755177:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785568896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304276.755214:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304276.755266:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785568896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304276.755272:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00080000:1.0:1789304276.755328:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304276.755437:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785568896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304276.835271:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304276.835316:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304276.835361:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304276.835397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304276.835428:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765474944 00000100:00100000:3.0:1789304276.835437:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765474944 00000100:00100000:3.0:1789304276.835493:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765474816 00000100:00100000:3.0:1789304276.835497:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765474816 00000100:00100000:3.0:1789304276.835719:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 873 00000100:00100000:3.0:1789304276.835730:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765474944:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304276.835913:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765474944:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 184us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304276.835921:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 873 00000100:00100000:3.0:1789304276.835941:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 874 00000100:00100000:3.0:1789304276.835947:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765474816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304276.835973:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765474816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304276.835979:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 874 00000100:00100000:0.0:1789304276.836223:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765474560 00000100:00100000:0.0:1789304276.836228:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765474560 00000100:00100000:0.0:1789304276.836262:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1025 00000100:00100000:0.0:1789304276.836271:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765474560:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304276.836298:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765474560:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304276.836304:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1025 00000100:00100000:1.0:1789304276.836993:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765474688 00000100:00100000:1.0:1789304276.837000:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765474688 00000100:00100000:1.0:1789304276.837048:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1205 00000100:00100000:1.0:1789304276.837058:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765474688:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304276.837130:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765474688:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 74us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304276.837137:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1205 00000100:00080000:1.0:1789304276.837155:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304276.837160:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304276.837162:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304277.332256:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304277.782911:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0281ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785569024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304277.783020:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304277.783290:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785569024 00000100:00100000:2.0:1789304277.783305:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785569024 00000100:00100000:2.0:1789304277.783391:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1789304277.783403:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785569024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304277.783441:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304277.783498:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785569024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304277.783506:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00080000:1.0:1789304277.783568:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304277.783605:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0281ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785569024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304278.354440:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304279.314433:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785569280:0@lo:400:kworker.0 00000100:00100000:0.0:1789304279.314441:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785569536:0@lo:400:kworker.0 00000100:00100000:3.0:1789304279.314529:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785569152:0@lo:400:kworker.0 00000100:00100000:2.0:1789304279.314575:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785569408:0@lo:400:kworker.0 00000100:00100000:0.0:1789304279.318888:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304279.320312:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785569536 00000100:00100000:0.0:1789304279.320326:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785569536 00000100:00100000:0.0:1789304279.320413:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1789304279.320430:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785569536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304279.320523:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785569536:12345-0@lo:400:kworker.0 Request processed in 101us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304279.320530:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1789304279.320581:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785569536:0@lo:400:kworker.0 00000100:00080000:0.0:1789304279.320731:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304279.321677:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304279.321728:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785569792:0@lo:400:kworker.0 00000100:00100000:1.0:1789304279.321764:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304279.321820:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785569792 00000100:00100000:1.0:1789304279.321826:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785569792 00000100:00100000:1.0:1789304279.321869:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1789304279.321876:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785569792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304279.321923:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785569792:12345-0@lo:400:kworker.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304279.321930:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00080000:1.0:1789304279.323204:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304279.323264:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785569792:0@lo:400:kworker.0 00000100:00100000:0.0:1789304279.323667:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785569280 00000100:00100000:0.0:1789304279.323677:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785569280 00000100:00100000:0.0:1789304279.323738:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1789304279.323888:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785569280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304279.323971:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785569280:12345-0@lo:400:kworker.0 Request processed in 87us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304279.323977:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:1.0:1789304279.324128:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785569280:0@lo:400:kworker.0 00000100:00100000:3.0:1789304279.324887:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304279.324951:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785569664:0@lo:400:kworker.0 00000100:00100000:3.0:1789304279.324985:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304279.325988:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785569152 00000100:00100000:0.0:1789304279.325999:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785569152 00000100:00100000:0.0:1789304279.326065:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1789304279.326074:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785569152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304279.326175:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785569152:12345-0@lo:400:kworker.0 Request processed in 102us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304279.326183:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1789304279.326911:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785569152:0@lo:400:kworker.0 00000100:00100000:2.0:1789304279.328695:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304279.328798:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785569408 00000100:00100000:3.0:1789304279.328809:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785569408 00000100:00100000:3.0:1789304279.328880:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1789304279.328891:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785569408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304279.328952:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785569408:12345-0@lo:400:kworker.0 Request processed in 64us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304279.328959:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00080000:0.0:1789304279.329880:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304279.329978:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785569408:0@lo:400:kworker.0 00000100:00100000:1.0:1789304279.331327:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785569664 00000100:00100000:1.0:1789304279.331341:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785569664 00000100:00100000:1.0:1789304279.331423:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1789304279.331433:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0281ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785569664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304279.331555:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0281ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785569664:12345-0@lo:400:kworker.0 Request processed in 123us (6568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304279.331564:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1789304279.331737:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785569664:0@lo:400:kworker.0 00000100:00080000:0.0:1789304279.332116:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304279.378347:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304279.490797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304279.492153:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765475072 00000100:00100000:0.0:1789304279.492176:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765475072 00000100:00100000:0.0:1789304279.492296:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 632 00000100:00100000:0.0:1789304279.492308:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42932:x1876219765475072:12345-192.168.202.29@tcp:48:lfs.0 00000100:00080000:1.0:1789304279.492483:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304279.493580:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42932:x1876219765475072:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 1257us (2776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304279.493592:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 632 00000100:00100000:0.0:1789304279.501437:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304279.501673:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765475200 00000100:00100000:1.0:1789304279.501683:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765475200 00000100:00100000:1.0:1789304279.501767:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 337 00000100:00100000:1.0:1789304279.501778:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:42932:x1876219765475200:12345-192.168.202.29@tcp:19:lfs.0 00000100:00080000:0.0:1789304279.502075:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304279.502399:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:42932:x1876219765475200:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 620us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304279.502407:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 337 00000100:00100000:1.0:1789304279.506878:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304279.506963:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765475328 00000100:00100000:3.0:1789304279.506976:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765475328 00000100:00100000:3.0:1789304279.507052:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 338 00000100:00100000:3.0:1789304279.507063:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:42932:x1876219765475328:12345-192.168.202.29@tcp:19:lfs.0 00000100:00080000:0.0:1789304279.507175:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304279.507492:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:42932:x1876219765475328:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 431us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304279.507500:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 338 00000100:00100000:3.0:1789304279.509219:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304279.509311:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765475456 00000100:00100000:1.0:1789304279.509321:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765475456 00000100:00100000:1.0:1789304279.509385:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 633 00000100:00100000:1.0:1789304279.509396:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:42932:x1876219765475456:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304279.509832:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:42932:x1876219765475456:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 436us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304279.509841:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 633 00000100:00100000:0.0:1789304279.512915:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304279.513020:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765475584 00000100:00100000:2.0:1789304279.513030:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765475584 00000100:00100000:2.0:1789304279.513120:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 634 00000100:00100000:2.0:1789304279.513132:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:42932:x1876219765475584:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304279.513258:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:42932:x1876219765475584:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 122us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304279.513265:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 634 00000100:00100000:2.0:1789304279.515313:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304279.515383:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765475712 00000100:00100000:1.0:1789304279.515394:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765475712 00000100:00100000:1.0:1789304279.515522:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 339 00000100:00100000:1.0:1789304279.515535:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:42932:x1876219765475712:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304279.516087:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:42932:x1876219765475712:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 554us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304279.516127:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 339 00000100:00100000:0.0:1789304279.521506:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304279.521820:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765475840 00000100:00100000:2.0:1789304279.521831:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765475840 00000100:00100000:2.0:1789304279.521891:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 340 00000100:00100000:2.0:1789304279.521900:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:42932:x1876219765475840:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304279.525925:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:42932:x1876219765475840:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 4009us (4419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304279.525941:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 340 00000100:00100000:2.0:1789304279.542212:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304279.542658:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765475968 00000100:00100000:0.0:1789304279.542734:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765475968 00000100:00100000:0.0:1789304279.542839:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 635 00000100:00100000:0.0:1789304279.542849:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42932:x1876219765475968:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304279.543314:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:42932:x1876219765475968:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 465us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304279.543322:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 635 00010000:00010000:2.0:1789304280.411526:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304281.426219:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304281.874532:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304281.874559:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785569920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304281.874673:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304281.874789:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785569920 00000100:00100000:2.0:1789304281.874797:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785569920 00000100:00100000:2.0:1789304281.874863:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:2.0:1789304281.874874:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785569920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304281.874913:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304281.874962:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785569920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304281.874969:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00080000:0.0:1789304281.875382:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304281.875422:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785569920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304281.957038:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304281.958392:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765476096 00000100:00100000:1.0:1789304281.958396:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304281.958404:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765476096 00000100:00100000:1.0:1789304281.958422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304281.958450:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304281.958458:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1027 00000100:00100000:0.0:1789304281.958469:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765476096:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304281.958470:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765476352 00000100:00100000:1.0:1789304281.958474:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765476352 00000100:00100000:1.0:1789304281.958511:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765476480 00000100:00100000:1.0:1789304281.958513:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765476480 00000100:00100000:1.0:1789304281.958534:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 877 00000100:00100000:1.0:1789304281.958541:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765476352:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304281.958547:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765476096:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304281.958554:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1027 00000100:00100000:1.0:1789304281.958567:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765476352:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304281.958573:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 877 00000100:00100000:1.0:1789304281.958586:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 878 00000100:00100000:1.0:1789304281.958592:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765476480:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1789304281.958600:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304281.958614:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304281.958626:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765476480:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304281.958631:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 878 00000100:00100000:3.0:1789304281.958959:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765476224 00000100:00100000:3.0:1789304281.958965:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765476224 00000100:00100000:3.0:1789304281.959017:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1209 00000100:00100000:3.0:1789304281.959024:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765476224:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304281.959055:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765476224:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304281.959060:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1209 00000100:00080000:1.0:1789304281.959259:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1789304282.298532:0:73895:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc24b9120 20000000:00000080:1.0:1789304282.298552:0:73895:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3700c000 uarg=0000000000000000 00010000:00010000:1.0:1789304282.299654:0:73895:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304282.299695:0:73895:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14adde00) 00010000:00010000:1.0:1789304282.299700:0:73895:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304282.299710:0:73895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb723129574e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001e3 expref: 5 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304282.299894:0:73895:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304282.299918:0:73895:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304282.299935:0:73895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304282.299950:0:73895:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e800/0xefc0bb723129572b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295724 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304282.299959:0:73895:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304282.300000:0:73895:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e800/0xefc0bb723129572b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295724 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304282.300015:0:73895:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e800/0xefc0bb723129572b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295724 expref: 18 pid: 5846 timeout: 1881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304282.300030:0:73895:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73895:1876219785570048:0@lo:104: 00000100:00100000:1.0:1789304282.300419:0:73895:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304282.300513:0:73895:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789304282.300558:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785570048 00000100:00100000:0.0:1789304282.300566:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785570048 00000100:00100000:0.0:1789304282.300665:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789304282.300675:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:73895:x1876219785570048:12345-0@lo:104: 00010000:00010000:0.0:1789304282.300687:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304282.300808:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304282.300816:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:73895:x1876219785570048:12345-0@lo:104: Request processed in 143us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304282.300825:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00010000:00010000:2.0:1789304282.300879:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304282.300889:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.300897:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304282.300901:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.300918:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304282.300926:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304282.300932:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304282.300972:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.300979:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304282.301002:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301010:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8ea00/0xefc0bb7231295724 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129572b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301029:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304282.301031:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304282.301033:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304282.301247:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304282.301263:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785570176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304282.301304:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304282.301402:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785570176 00000100:00100000:2.0:1789304282.301408:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785570176 00010000:00010000:2.0:1789304282.301433:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e800/0xefc0bb723129572b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295724 expref: 19 pid: 5846 timeout: 1881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304282.301466:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789304282.301473:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785570176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304282.301484:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304282.301489:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e800/0xefc0bb723129572b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295724 expref: 19 pid: 5846 timeout: 1881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301498:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e800/0xefc0bb723129572b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295724 expref: 19 pid: 5846 timeout: 1881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301517:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301526:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301541:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301549:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301556:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301562:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301568:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304282.301572:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301578:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301585:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.301593:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304282.301635:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785570176:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304282.301643:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789304282.301730:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785570176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304282.301819:0:73895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e800/0xefc0bb723129572b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295724 expref: 18 pid: 5846 timeout: 1881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304282.301831:0:73895:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73895:1876219785570048:0@lo:104: 00010000:00010000:1.0:1789304282.301846:0:73895:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304282.301868:0:73895:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304282.301875:0:73895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304282.301881:0:73895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e800/0xefc0bb72312957a2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304282.450341:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304282.899040:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785570304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304282.899252:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304282.909050:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785570304 00000100:00100000:0.0:1789304282.909069:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785570304 00000100:00100000:0.0:1789304282.909217:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1789304282.909228:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785570304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304282.909272:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304282.909390:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785570304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (10137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304282.909398:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1789304282.909458:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785570304:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304282.910333:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304283.477619:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304283.858201:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304283.858210:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304283.858216:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304283.858269:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304283.858282:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304283.858293:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304283.858323:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785570432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304283.858393:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304283.858457:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304283.858966:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785570432 00000100:00100000:3.0:1789304283.858976:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785570432 00000100:00100000:3.0:1789304283.859046:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1789304283.859056:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785570432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304283.859071:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304283.859085:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312957b0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312957a9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304283.859131:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312957b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312957a9 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304283.859143:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312957b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312957a9 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304283.859153:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304283.859218:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785570432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304283.859225:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:0.0:1789304283.859800:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785570432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304283.859820:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304283.859830:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304283.859851:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304283.859856:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304283.859863:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304284.435250:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785570688:0@lo:400:kworker.0 00000100:00100000:3.0:1789304284.435329:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304284.435379:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785571200:0@lo:400:kworker.0 00000100:00100000:3.0:1789304284.435400:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304284.435419:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304284.435423:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785570816:0@lo:400:kworker.0 00000100:00100000:3.0:1789304284.435448:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304284.435479:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785570688 00000100:00100000:3.0:1789304284.435487:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785570688 00000100:00100000:3.0:1789304284.435543:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1789304284.435552:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785570688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304284.435621:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785570688:12345-0@lo:400:kworker.0 Request processed in 70us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304284.435629:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1789304284.435646:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785570944:0@lo:400:kworker.0 00000100:00100000:3.0:1789304284.435652:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785571200 00000100:00100000:3.0:1789304284.435656:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785571200 00000100:00100000:2.0:1789304284.435675:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304284.435684:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785570816 00000100:00100000:3.0:1789304284.435686:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785570816 00000100:00100000:2.0:1789304284.435697:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789304284.435702:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785570560:0@lo:400:kworker.0 00000100:00100000:3.0:1789304284.435705:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:3.0:1789304284.435711:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785571200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304284.435729:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304284.435741:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785571200:12345-0@lo:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304284.435747:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:3.0:1789304284.435758:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:3.0:1789304284.435763:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785570816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304284.435765:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785571072:0@lo:400:kworker.0 00000100:00100000:2.0:1789304284.435784:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304284.435787:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785570816:12345-0@lo:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304284.435793:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1789304284.435809:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785570944 00000100:00100000:2.0:1789304284.435813:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785570944 00000100:00100000:3.0:1789304284.435829:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785570816:0@lo:400:kworker.0 00000100:00100000:2.0:1789304284.435835:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785571072 00000100:00100000:2.0:1789304284.435836:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785571072 00000100:00100000:3.0:1789304284.435840:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785570688:0@lo:400:kworker.0 00000100:00100000:3.0:1789304284.435848:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785571200:0@lo:400:kworker.0 00000100:00100000:2.0:1789304284.435855:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1789304284.435859:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785570944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304284.435876:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1789304284.435882:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785571072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304284.435889:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785570944:12345-0@lo:400:kworker.0 Request processed in 30us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304284.435895:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1789304284.435909:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785571072:12345-0@lo:400:kworker.0 Request processed in 27us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304284.435913:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785570560 00000100:00100000:3.0:1789304284.435915:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1789304284.435917:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785570560 00000100:00100000:2.0:1789304284.435939:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1789304284.435946:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785570560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304284.435960:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785571072:0@lo:400:kworker.0 00000100:00100000:3.0:1789304284.435969:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785570944:0@lo:400:kworker.0 00000100:00100000:2.0:1789304284.435972:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785570560:12345-0@lo:400:kworker.0 Request processed in 28us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304284.435978:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1789304284.435982:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785570560:0@lo:400:kworker.0 00000100:00080000:1.0:1789304284.436058:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304284.436063:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304284.436065:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304284.499607:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304285.526141:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304285.711377:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304285.711476:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765476608 00000100:00100000:2.0:1789304285.711487:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765476608 00000100:00100000:2.0:1789304285.711584:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 636 00000100:00100000:2.0:1789304285.711595:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:43020:x1876219765476608:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304285.711617:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304285.711646:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb72312957b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001f8 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.711741:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312957be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.711767:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312957be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.711784:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312957be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304285.711837:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:2.0:1789304285.711841:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304285.711867:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312957be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.711899:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb72312957b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f8 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.711924:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312957be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f8 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.711934:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2300) 00010000:00010000:2.0:1789304285.711937:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304285.711940:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecda00, rc 0) 00000100:00100000:2.0:1789304285.712008:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:43020:x1876219765476608:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 415us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304285.712015:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 636 00000100:00080000:3.0:1789304285.712346:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304285.718057:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304285.718178:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765476864 00000100:00100000:3.0:1789304285.718188:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765476864 00000100:00100000:3.0:1789304285.718249:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 637 00000100:00100000:3.0:1789304285.718259:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:43020:x1876219765476864:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304285.718312:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304285.718342:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312957be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001f8 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304285.718358:0:5854:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb723129574e) 00010000:00010000:3.0:1789304285.718363:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2300) 00010000:00010000:3.0:1789304285.718374:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304285.718400:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304285.718413:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304285.718425:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789304285.779357:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967539 is committed 00000004:00010000:2.0:1789304285.779426:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab0baceb reply state 0000000049abb74a transno 4294967539 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304285.779441:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789304285.779459:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00080000:2.0:1789304285.779755:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789304285.779781:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:43020:x1876219765476864:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 61517us (61728us total) trans 4294967539 rc 0/0 00000100:00100000:2.0:1789304285.779794:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 637 00010000:00010000:2.0:1789304285.779836:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.779845:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.779854:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.779860:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304285.779865:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.779873:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.779892:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:2.0:1789304285.779896:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789304285.779901:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304285.779906:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312957c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789304286.482110:0:74092:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc1f0b120 20000000:00000080:2.0:1789304286.482132:0:74092:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412a8800 uarg=0000000000000000 00010000:00010000:2.0:1789304286.482629:0:74092:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304286.482643:0:74092:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304286.482656:0:74092:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304286.482680:0:74092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304286.482699:0:74092:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312957b0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312957a9 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304286.482708:0:74092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304286.482750:0:74092:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312957b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312957a9 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304286.482763:0:74092:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312957b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312957a9 expref: 18 pid: 5847 timeout: 1886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304286.482779:0:74092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74092:1876219785571328:0@lo:104: 00000100:00100000:2.0:1789304286.482851:0:74092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304286.482901:0:74092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c207523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304286.484223:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785571328 00000100:00100000:0.0:1789304286.484235:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785571328 00000100:00100000:0.0:1789304286.484290:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789304286.484298:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:74092:x1876219785571328:12345-0@lo:104: 00010000:00010000:0.0:1789304286.484314:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304286.484383:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304286.484389:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:74092:x1876219785571328:12345-0@lo:104: Request processed in 92us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304286.484395:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00010000:00010000:1.0:1789304286.485254:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304286.485264:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304286.485273:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304286.485277:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304286.485287:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304286.485299:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304286.485306:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304286.485366:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304286.485371:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304286.485392:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304286.485400:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8f400/0xefc0bb72312957a9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312957b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304286.485420:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304286.485422:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304286.485423:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304286.485439:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785571456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304286.485490:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304286.485569:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785571456 00000100:00100000:3.0:1789304286.485577:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785571456 00010000:00010000:3.0:1789304286.485609:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312957b0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312957a9 expref: 19 pid: 5847 timeout: 1886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304286.485634:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1789304286.485644:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03868850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785571456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304286.485656:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304286.485661:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312957b0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312957a9 expref: 19 pid: 5847 timeout: 1886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304286.485669:0:74092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74092:1876219785571328:0@lo:104: 00010000:00010000:3.0:1789304286.485676:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312957b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312957a9 expref: 19 pid: 5847 timeout: 1886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.485694:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312957b0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312957a9 expref: 19 pid: 5847 timeout: 1886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304286.485702:0:74092:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.485711:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.485721:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.489536:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.489556:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.489576:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.489586:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.489592:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304286.491610:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.491627:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.491660:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304286.491678:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304286.491707:0:74092:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304286.491721:0:74092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304286.491730:0:74092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312957cc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304286.491790:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03868850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785571456:12345-0@lo:103:ldlm_bl.0 Request processed in 6144us (6295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304286.491803:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789304286.492728:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785571456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304286.550746:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304286.996908:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785571584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304286.996994:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304286.997158:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785571584 00000100:00100000:3.0:1789304286.997168:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785571584 00000100:00100000:3.0:1789304286.997228:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1789304286.997237:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785571584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304286.997282:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304286.997331:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785571584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304286.997339:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00080000:3.0:1789304286.997361:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304286.997416:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785571584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304287.074126:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304287.074393:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304287.074441:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304287.074465:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304287.074543:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765477120 00000100:00100000:1.0:1789304287.074564:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765477120 00000100:00100000:1.0:1789304287.074646:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1213 00000100:00100000:1.0:1789304287.074655:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765477120:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304287.074725:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765477120:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304287.074736:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1213 00000100:00100000:1.0:1789304287.074761:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765477248 00000100:00100000:1.0:1789304287.074764:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765477248 00000100:00100000:1.0:1789304287.074784:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765477376 00000100:00100000:1.0:1789304287.074786:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765477376 00000100:00100000:1.0:1789304287.074802:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 881 00000100:00100000:1.0:1789304287.074808:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765477248:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304287.074829:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765477248:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304287.074834:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 881 00000100:00100000:1.0:1789304287.074845:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 882 00000100:00100000:1.0:1789304287.074851:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765477376:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304287.074871:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765477376:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 21us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304287.074876:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 882 00000100:00080000:0.0:1789304287.077549:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304287.077570:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304287.077573:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304287.079763:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765476992 00000100:00100000:3.0:1789304287.079778:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765476992 00000100:00100000:3.0:1789304287.081543:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1030 00000100:00100000:3.0:1789304287.081572:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765476992:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304287.081670:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765476992:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 115us (7553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304287.081677:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1030 00010000:00010000:0.0:1789304287.571526:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304288.019361:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785571712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304288.019429:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304288.019722:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785571712 00000100:00100000:0.0:1789304288.019731:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785571712 00000100:00100000:0.0:1789304288.019834:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1789304288.019844:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785571712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304288.019879:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304288.019928:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785571712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304288.019935:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:2.0:1789304288.020014:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785571712:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304288.020051:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1789304288.083203:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304288.083211:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304288.083216:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304288.083266:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304288.083280:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304288.083292:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304288.083321:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785571840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304288.083393:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304288.083446:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304288.083577:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785571840 00000100:00100000:1.0:1789304288.083586:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785571840 00000100:00100000:1.0:1789304288.083651:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1789304288.083660:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785571840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304288.083673:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304288.083686:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb72312957da lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312957d3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304288.083711:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb72312957da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312957d3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304288.083726:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb72312957da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312957d3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304288.083734:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ee00, rc 0) 00000100:00100000:1.0:1789304288.083786:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785571840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304288.083793:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1789304288.083813:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785571840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304288.083828:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304288.083837:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304288.083858:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304288.083864:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304288.083872:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304288.600203:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304289.236617:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304289.236710:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765477504 00000100:00100000:3.0:1789304289.236723:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765477504 00000100:00100000:3.0:1789304289.236796:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 638 00000100:00100000:3.0:1789304289.236807:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:43096:x1876219765477504:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304289.236828:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304289.236852:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312957e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861001ff expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.236948:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312957e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.236963:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312957e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.236977:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312957e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237006:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312957ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237014:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312957ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237021:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312957ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237363:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312957f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237373:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312957f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237380:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312957f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304289.237403:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:3.0:1789304289.237407:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304289.237427:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312957f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237439:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312957e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237446:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312957e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237453:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312957e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237462:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304289.237467:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312957e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237474:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312957e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237485:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304289.237488:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304289.237493:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312957e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237499:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312957e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237510:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312957ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237516:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312957ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237521:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312957ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237527:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304289.237530:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312957ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237548:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312957ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237558:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789304289.237561:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304289.237564:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312957ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237570:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312957ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237601:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312957e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ff expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237617:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312957f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ff expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304289.237630:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304289.237633:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304289.237635:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e200, rc 0) 00000100:00100000:3.0:1789304289.237699:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:43096:x1876219765477504:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 893us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304289.237706:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 638 00000100:00080000:1.0:1789304289.238079:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304289.554565:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785571968:0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.554676:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304289.554731:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785572480:0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.554760:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304289.556602:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785571968 00000100:00100000:0.0:1789304289.556628:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785571968 00000100:00100000:0.0:1789304289.556702:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1789304289.556712:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785571968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304289.556810:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785571968:12345-0@lo:400:kworker.0 Request processed in 99us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304289.556818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1789304289.556858:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785572224:0@lo:400:kworker.0 00000100:00100000:0.0:1789304289.556891:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304289.556919:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304289.556926:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785572352:0@lo:400:kworker.0 00000100:00100000:1.0:1789304289.558294:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785572224 00000100:00100000:1.0:1789304289.558305:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785572224 00000100:00100000:1.0:1789304289.558356:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1789304289.558365:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785572224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304289.559057:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785572224:12345-0@lo:400:kworker.0 Request processed in 692us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304289.559066:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1789304289.568517:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785571968:0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.568550:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789304289.568566:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785572096:0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.568643:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304289.568665:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785572608:0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.568691:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304289.568739:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785572480 00000100:00100000:3.0:1789304289.568749:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785572480 00000100:00100000:3.0:1789304289.568824:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785572096 00000100:00100000:3.0:1789304289.568828:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785572096 00000100:00100000:3.0:1789304289.568848:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1789304289.568856:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785572480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.568911:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785572480:12345-0@lo:400:kworker.0 Request processed in 57us (14150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304289.568918:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1789304289.568934:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1789304289.568939:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785572096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.568966:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785572096:12345-0@lo:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304289.568973:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1789304289.568991:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785572608 00000100:00100000:3.0:1789304289.568995:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785572608 00000100:00100000:3.0:1789304289.569021:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:3.0:1789304289.569027:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785572608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.569060:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785572608:12345-0@lo:400:kworker.0 Request processed in 33us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304289.569065:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00080000:3.0:1789304289.569081:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304289.569086:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304289.569122:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304289.569160:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785572224:0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.569180:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785572352 00000100:00100000:3.0:1789304289.569184:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785572352 00000100:00100000:3.0:1789304289.569209:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1789304289.569215:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785572352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.569857:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785572352:12345-0@lo:400:kworker.0 Request processed in 639us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304289.569864:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00080000:3.0:1789304289.569887:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304289.569909:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785572352:0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.569937:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785572096:0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.569947:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785572608:0@lo:400:kworker.0 00000100:00100000:3.0:1789304289.569957:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785572480:0@lo:400:kworker.0 00010000:00010000:0.0:1789304289.618409:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304290.644019:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304290.979401:0:74336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf09f5030 20000000:00000080:0.0:1789304290.979418:0:74336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412e8800 uarg=0000000000000000 00010000:00010000:0.0:1789304290.980460:0:74336:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789304290.980495:0:74336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:0.0:1789304290.980499:0:74336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304290.980510:0:74336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312957f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861001ff expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304290.980549:0:74336:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789304290.980564:0:74336:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304290.980579:0:74336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304290.980593:0:74336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb72312957da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312957d3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304290.980602:0:74336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304290.980640:0:74336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb72312957da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312957d3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304290.980655:0:74336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb72312957da lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312957d3 expref: 18 pid: 5846 timeout: 1890 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304290.980670:0:74336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74336:1876219785572736:0@lo:104: 00000100:00100000:0.0:1789304290.981053:0:74336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304290.981324:0:74336:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b024b5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789304290.981536:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785572736 00000100:00100000:1.0:1789304290.981546:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785572736 00000100:00100000:1.0:1789304290.981642:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789304290.981652:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:74336:x1876219785572736:12345-0@lo:104: 00010000:00010000:1.0:1789304290.981666:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304290.981761:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304290.981767:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:74336:x1876219785572736:12345-0@lo:104: Request processed in 117us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304290.981775:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789304290.981854:0:74336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74336:1876219785572736:0@lo:104: 00010000:00010000:2.0:1789304290.981876:0:74336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.981948:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304290.981955:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.981963:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304290.981967:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.981975:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304290.981992:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304290.981999:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304290.982038:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982045:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304290.982069:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982076:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb72312957d3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312957da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982125:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304290.982127:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304290.982129:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304290.982141:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785572864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304290.982177:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304290.982220:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785572864 00000100:00100000:3.0:1789304290.982225:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785572864 00010000:00010000:3.0:1789304290.982243:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb72312957da lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312957d3 expref: 19 pid: 5846 timeout: 1890 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304290.982263:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789304290.982269:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785572864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304290.982291:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304290.982296:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb72312957da lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312957d3 expref: 19 pid: 5846 timeout: 1890 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982307:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb72312957da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312957d3 expref: 19 pid: 5846 timeout: 1890 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982319:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb72312957da lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312957d3 expref: 19 pid: 5846 timeout: 1890 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982330:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982339:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982353:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982360:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982367:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982373:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982379:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304290.982383:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982390:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982402:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304290.982415:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304290.982444:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785572864:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304290.982451:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789304290.982481:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785572864:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304290.982716:0:74336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304290.982724:0:74336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304290.982730:0:74336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa600/0xefc0bb72312957fd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304291.666481:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304292.114479:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304292.114534:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785572992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304292.114619:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304292.114819:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785572992 00000100:00100000:3.0:1789304292.114827:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785572992 00000100:00100000:3.0:1789304292.114886:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1789304292.114895:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785572992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304292.114928:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304292.114976:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785572992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304292.114982:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:3.0:1789304292.115026:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785572992:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304292.115378:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304292.199753:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304292.199795:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304292.199807:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765477632 00000100:00100000:0.0:1789304292.199819:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765477632 00000100:00100000:1.0:1789304292.199824:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304292.199850:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304292.199866:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1033 00000100:00100000:1.0:1789304292.199870:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765477760 00000100:00100000:1.0:1789304292.199873:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765477760 00000100:00100000:0.0:1789304292.199876:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765477632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304292.199925:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1217 00000100:00100000:1.0:1789304292.199933:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765477760:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304292.199941:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765477632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304292.199948:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1033 00000100:00100000:1.0:1789304292.199961:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765477760:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304292.199966:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1217 00000100:00100000:1.0:1789304292.199983:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765477888 00000100:00100000:1.0:1789304292.199987:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765477888 00000100:00100000:1.0:1789304292.200018:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765478016 00000100:00100000:1.0:1789304292.200021:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765478016 00000100:00100000:1.0:1789304292.200044:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 885 00000100:00100000:1.0:1789304292.200051:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765477888:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304292.200077:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765477888:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304292.200083:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 885 00000100:00100000:0.0:1789304292.202281:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 886 00000100:00100000:0.0:1789304292.202299:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765478016:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:1.0:1789304292.202314:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304292.202319:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304292.202323:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304292.202369:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765478016:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 78us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304292.202376:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 886 10000000:01000000:2.0:1789304292.370267:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304292.370276:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304292.370281:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304292.370376:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304292.370389:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304292.370401:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304292.370427:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785573120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304292.370662:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304292.370781:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c411e9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789304292.371875:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785573120 00000100:00100000:1.0:1789304292.371887:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785573120 00000100:00100000:1.0:1789304292.371988:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1789304292.371999:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785573120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304292.372013:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304292.372030:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129580b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295804 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304292.372054:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129580b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295804 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304292.372065:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129580b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295804 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304292.372074:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e000, rc 0) 00000100:00100000:1.0:1789304292.372172:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785573120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304292.372179:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:2.0:1789304292.372272:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785573120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304292.372289:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304292.372298:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304292.372316:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304292.372322:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304292.372334:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304292.698395:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304293.138736:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304293.138758:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785573248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304293.138829:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304293.139070:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785573248 00000100:00100000:0.0:1789304293.139079:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785573248 00000100:00100000:0.0:1789304293.139159:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1789304293.139168:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785573248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304293.139203:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304293.139250:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785573248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304293.139257:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00080000:1.0:1789304293.139330:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304293.139366:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785573248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304293.728202:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304293.872431:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304293.872487:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765478144 00000100:00100000:3.0:1789304293.872510:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765478144 00000100:00100000:3.0:1789304293.872683:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 639 00000100:00100000:3.0:1789304293.872695:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:43188:x1876219765478144:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304293.872721:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304293.872748:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295812 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100206 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304293.872829:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295819 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304293.872850:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304293.872865:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304293.872907:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:3.0:1789304293.872912:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304293.872933:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304293.872961:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295812 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100206 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304293.872985:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100206 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304293.872994:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789304293.872998:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304293.873002:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304293.873068:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:43188:x1876219765478144:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 376us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304293.873075:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 639 00000100:00100000:2.0:1789304293.876229:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304293.876314:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765478400 00000100:00100000:3.0:1789304293.876326:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765478400 00000100:00100000:3.0:1789304293.876388:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 640 00000100:00100000:3.0:1789304293.876399:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:43188:x1876219765478400:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304293.876453:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304293.876485:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295819 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100206 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304293.876520:0:5854:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312957f6) 00010000:00010000:3.0:1789304293.876525:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789304293.876674:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304293.876711:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304293.876730:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304293.876742:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789304293.908188:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967540 is committed 00000004:00010000:3.0:1789304293.908376:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009784a037 reply state 00000000fdee68a8 transno 4294967540 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304293.908392:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304293.908410:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00080000:3.0:1789304293.908534:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304293.908566:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:43188:x1876219765478400:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 32165us (32345us total) trans 4294967540 rc 0/0 00000100:00100000:3.0:1789304293.908576:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 640 00010000:00010000:0.0:1789304293.908654:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304293.908664:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304293.908676:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304293.908684:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304293.908689:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304293.908697:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304293.908714:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:0.0:1789304293.908718:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304293.908723:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304293.908730:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295820 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304294.674856:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785573376:0@lo:400:kworker.0 00000100:00100000:2.0:1789304294.674942:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304294.675055:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785573376 00000100:00100000:3.0:1789304294.675064:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785573376 00000100:00100000:3.0:1789304294.675139:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1789304294.675150:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785573376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304294.675208:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785573376:12345-0@lo:400:kworker.0 Request processed in 60us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304294.675220:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1789304294.675307:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785573376:0@lo:400:kworker.0 00000100:00100000:1.0:1789304294.675441:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785573632:0@lo:400:kworker.0 00000100:00100000:1.0:1789304294.675474:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304294.675507:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789304294.675513:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785573504:0@lo:400:kworker.0 00000100:00100000:1.0:1789304294.675538:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304294.675556:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785574016:0@lo:400:kworker.0 00000100:00100000:1.0:1789304294.675576:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304294.675600:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785573632 00000100:00100000:1.0:1789304294.675603:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785573632 00000100:00100000:1.0:1789304294.675630:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785574016 00000100:00100000:1.0:1789304294.675634:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785574016 00000100:00100000:3.0:1789304294.675859:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785573760:0@lo:400:kworker.0 00000100:00100000:3.0:1789304294.675888:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304294.675908:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304294.675913:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785573888:0@lo:400:kworker.0 00000100:00100000:3.0:1789304294.675931:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304294.675957:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785573504 00000100:00100000:3.0:1789304294.675960:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785573504 00000100:00100000:3.0:1789304294.675985:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785573760 00000100:00100000:3.0:1789304294.675988:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785573760 00000100:00100000:3.0:1789304294.676004:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785573888 00000100:00100000:3.0:1789304294.676007:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785573888 00000100:00100000:3.0:1789304294.676019:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1789304294.676026:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785573504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304294.676066:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785573504:12345-0@lo:400:kworker.0 Request processed in 40us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304294.676072:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:3.0:1789304294.676083:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1789304294.676111:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785573760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304294.676142:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785573760:12345-0@lo:400:kworker.0 Request processed in 54us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304294.676148:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1789304294.676159:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1789304294.676164:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785573888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304294.676190:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785573888:12345-0@lo:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304294.676199:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1789304294.676231:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785573888:0@lo:400:kworker.0 00000100:00100000:3.0:1789304294.676241:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785573760:0@lo:400:kworker.0 00000100:00100000:1.0:1789304294.676344:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1789304294.676355:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785573632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304294.676387:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785573632:12345-0@lo:400:kworker.0 Request processed in 35us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304294.676393:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1789304294.676409:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1789304294.676415:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785574016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304294.676442:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785574016:12345-0@lo:400:kworker.0 Request processed in 27us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304294.676448:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00080000:1.0:1789304294.676472:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304294.676476:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304294.676512:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785573504:0@lo:400:kworker.0 00000100:00100000:1.0:1789304294.676523:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785574016:0@lo:400:kworker.0 00000100:00100000:1.0:1789304294.676533:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785573632:0@lo:400:kworker.0 00000020:00000080:2.0:1789304294.711537:0:74533:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff45044d60 20000000:00000080:2.0:1789304294.711556:0:74533:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412a9800 uarg=0000000000000000 00010000:00010000:2.0:1789304294.712870:0:74533:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304294.712889:0:74533:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304294.712903:0:74533:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304294.712924:0:74533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304294.712941:0:74533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129580b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295804 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304294.712949:0:74533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304294.712990:0:74533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129580b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295804 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304294.713005:0:74533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129580b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295804 expref: 18 pid: 5846 timeout: 1894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304294.713024:0:74533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74533:1876219785574144:0@lo:104: 00000100:00100000:2.0:1789304294.713124:0:74533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304294.713168:0:74533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c411e9180 going to sleep for 11 seconds 00000100:00100000:3.0:1789304294.713408:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785574144 00000100:00100000:3.0:1789304294.713415:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785574144 00000100:00100000:3.0:1789304294.713456:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789304294.713465:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:74533:x1876219785574144:12345-0@lo:104: 00010000:00010000:3.0:1789304294.713477:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304294.713565:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304294.713572:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:74533:x1876219785574144:12345-0@lo:104: Request processed in 107us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304294.713578:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00010000:1.0:1789304294.713628:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304294.713636:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713649:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304294.713653:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713671:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304294.713678:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304294.713684:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304294.713721:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713728:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304294.713750:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713757:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb7231295804 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129580b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713784:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304294.713786:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304294.713788:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304294.713799:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785574272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304294.713830:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304294.713870:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785574272 00000100:00100000:1.0:1789304294.713874:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785574272 00010000:00010000:1.0:1789304294.713891:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129580b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295804 expref: 19 pid: 5846 timeout: 1894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304294.713910:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789304294.713916:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785574272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304294.713926:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304294.713931:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129580b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295804 expref: 19 pid: 5846 timeout: 1894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713940:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129580b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295804 expref: 19 pid: 5846 timeout: 1894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713955:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713963:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713975:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713982:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713988:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.713995:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.714000:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304294.714004:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.714011:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.714020:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.714029:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304294.714055:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785574272:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304294.714062:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789304294.714121:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785574272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304294.714560:0:74533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb723129580b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295804 expref: 18 pid: 5846 timeout: 1894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304294.714572:0:74533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74533:1876219785574144:0@lo:104: 00010000:00010000:2.0:1789304294.714585:0:74533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304294.714594:0:74533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304294.714600:0:74533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304294.714607:0:74533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295827 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304294.746291:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304295.762281:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304296.659513:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304296.659531:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304296.659537:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304296.659584:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304296.659595:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304296.659603:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304296.659623:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785574400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304296.659688:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304296.659733:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05a08300 going to sleep for 11 seconds 00000100:00100000:1.0:1789304296.659832:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785574400 00000100:00100000:1.0:1789304296.659839:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785574400 00000100:00100000:1.0:1789304296.659887:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1789304296.659895:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785574400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304296.659907:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304296.659918:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231295835 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129582e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304296.659938:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231295835 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129582e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304296.659949:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231295835 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129582e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304296.659957:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8f400, rc 0) 00000100:00100000:1.0:1789304296.660011:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785574400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304296.660019:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1789304296.660055:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785574400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304296.660073:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304296.660082:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304296.660122:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304296.660128:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304296.660140:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304296.787188:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304297.234747:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304297.234770:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785574528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304297.234833:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304297.234900:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785574528 00000100:00100000:3.0:1789304297.234908:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785574528 00000100:00100000:3.0:1789304297.234961:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1789304297.234969:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785574528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304297.235005:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304297.235049:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785574528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304297.235056:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00080000:3.0:1789304297.235075:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304297.235133:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785574528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304297.313665:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304297.313710:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304297.313755:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304297.313786:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304297.313826:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765478528 00000100:00100000:3.0:1789304297.313836:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765478528 00000100:00100000:3.0:1789304297.313891:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1037 00000100:00100000:3.0:1789304297.313900:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765478528:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304297.313968:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765478528:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304297.313976:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1037 00000100:00100000:1.0:1789304297.314062:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765478912 00000100:00100000:1.0:1789304297.314066:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765478912 00000100:00100000:1.0:1789304297.314134:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765478784 00000100:00100000:1.0:1789304297.314137:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765478784 00000100:00100000:1.0:1789304297.314158:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 889 00000100:00100000:1.0:1789304297.314165:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765478912:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304297.314197:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765478912:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304297.314203:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 889 00000100:00100000:1.0:1789304297.314217:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 890 00000100:00100000:1.0:1789304297.314223:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765478784:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304297.314247:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765478784:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304297.314252:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 890 00000100:00100000:0.0:1789304297.314422:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765478656 00000100:00100000:0.0:1789304297.314427:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765478656 00000100:00100000:0.0:1789304297.314479:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1221 00000100:00100000:0.0:1789304297.314487:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765478656:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304297.314526:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765478656:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304297.314532:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1221 00000100:00080000:3.0:1789304297.314610:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789304297.314615:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304297.314617:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304297.719405:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304297.728108:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765479040 00000100:00100000:1.0:1789304297.728125:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765479040 00000100:00100000:1.0:1789304297.728189:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 641 00000100:00100000:1.0:1789304297.728198:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:43265:x1876219765479040:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:1.0:1789304297.728219:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304297.728253:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129583c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610020d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728318:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295843 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728333:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295843 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728346:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295843 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728359:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129584a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728366:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129584a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728372:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129584a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728696:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728706:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728714:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304297.728736:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789304297.728741:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304297.728759:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728771:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295843 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728782:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295843 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728789:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295843 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728795:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304297.728799:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295843 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728807:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295843 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728818:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:1.0:1789304297.728820:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304297.728825:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295843 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728831:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295843 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728841:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129584a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728847:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129584a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728854:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129584a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728859:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304297.728862:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129584a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728868:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129584a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728874:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c14adda00) 00010000:00010000:1.0:1789304297.728876:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304297.728879:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129584a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728884:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129584a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728909:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129583c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610020d expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728923:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610020d expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.728929:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:1.0:1789304297.728931:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304297.728933:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8fe00, rc 0) 00000100:00100000:1.0:1789304297.728994:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:43265:x1876219765479040:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 797us (9842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304297.729001:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 641 00000100:00100000:2.0:1789304297.731506:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304297.731683:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765479296 00000100:00100000:3.0:1789304297.731694:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765479296 00000100:00100000:3.0:1789304297.731748:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 642 00000100:00100000:3.0:1789304297.731759:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c1c95a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:43265:x1876219765479296:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304297.731777:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304297.731796:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295858 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100214 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.732035:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129585f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.732050:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129585f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.732061:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129585f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.732128:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.732136:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.732143:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304297.733205:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14:0x0], index 0: 0 00010000:00010000:3.0:1789304297.736013:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129586d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736038:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129586d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736052:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129586d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736113:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129585f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736120:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129585f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736127:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129585f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736133:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304297.736138:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129585f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736146:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129585f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736158:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:3.0:1789304297.736161:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304297.736166:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129585f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736172:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129585f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304297.736189:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000475b7e54 reply state 0000000028a51fe1 transno 4294967541 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304297.736197:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304297.736236:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295858 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100214 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736251:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129586d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100214 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.736258:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304297.736261:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304297.736263:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e000, rc 0) 00000100:00100000:3.0:1789304297.736348:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c1c95a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:43265:x1876219765479296:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 4589us (4849us total) trans 4294967541 rc 0/0 00000100:00100000:3.0:1789304297.736357:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 642 00010000:00010000:0.0:1789304297.740672:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.740695:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.740703:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.740710:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304297.740716:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.740725:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.740743:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c2ea19200) 00010000:00010000:0.0:1789304297.740746:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304297.740751:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.740757:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295866 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304297.742415:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304297.742582:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765479552 00000100:00100000:1.0:1789304297.742593:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765479552 00000100:00100000:1.0:1789304297.742658:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 643 00000100:00100000:1.0:1789304297.742669:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:43265:x1876219765479552:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:1.0:1789304297.742735:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304297.742761:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129586d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100214 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.742781:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:1.0:1789304297.742792:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304297.742834:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.742847:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.742857:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304297.743011:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e84e73ae reply state 0000000037b38488 transno 4294967542 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304297.743020:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304297.743137:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:43265:x1876219765479552:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 470us (730us total) trans 4294967542 rc 0/0 00000100:00100000:1.0:1789304297.743144:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 643 00010000:00010000:3.0:1789304297.749417:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.749436:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.750059:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.750065:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304297.750070:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.750082:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.751333:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9e2c14addf00) 00010000:00010000:3.0:1789304297.751342:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304297.751350:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.751358:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb723129587b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304297.754850:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304297.754890:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765479680 00000100:00100000:0.0:1789304297.754900:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765479680 00000100:00100000:0.0:1789304297.754959:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 644 00000100:00100000:0.0:1789304297.754969:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:43265:x1876219765479680:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:0.0:1789304297.754992:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304297.755014:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295882 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610021b expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.755073:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295882 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610021b expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.755117:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295882 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610021b expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.755138:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:0.0:1789304297.755142:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789304297.755145:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afba00, rc 0) 00000100:00100000:0.0:1789304297.755198:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:43265:x1876219765479680:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 231us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304297.755205:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 644 00000100:00100000:3.0:1789304297.766980:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304297.768452:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765479808 00000100:00100000:1.0:1789304297.768476:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765479808 00000100:00100000:1.0:1789304297.768554:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 341 00000100:00100000:1.0:1789304297.768567:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765479808:12345-192.168.202.29@tcp:2:touch.60003 00000100:00100000:1.0:1789304297.768950:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765479808:12345-192.168.202.29@tcp:2:touch.60003 Request processed in 385us (1981us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789304297.769324:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 341 00000100:00100000:3.0:1789304297.771465:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304297.771636:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765480064 00000100:00100000:1.0:1789304297.771647:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765480064 00000100:00100000:1.0:1789304297.771818:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 68 00000100:00100000:1.0:1789304297.771829:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:43265:x1876219765480064:12345-192.168.202.29@tcp:35:touch.60003 00000100:00100000:1.0:1789304297.772202:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:43265:x1876219765480064:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 373us (755us total) trans 4294967543 rc 0/0 00000100:00100000:1.0:1789304297.772210:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 68 00010000:00010000:1.0:1789304297.810396:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304297.847938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304297.849658:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765480192 00000100:00100000:3.0:1789304297.849674:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765480192 00000100:00100000:3.0:1789304297.849752:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 645 00000100:00100000:3.0:1789304297.849763:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:43269:x1876219765480192:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:3.0:1789304297.849793:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304297.849819:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295889 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100222 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.849898:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295890 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.849912:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295890 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.849926:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295890 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.849947:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295897 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.849955:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.849961:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850064:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129589e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850072:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129589e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850079:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129589e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304297.850135:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 0 00000004:00200000:3.0:1789304297.850139:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304297.850166:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129589e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850177:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129589e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850185:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295890 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850191:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295890 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850201:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295890 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850208:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304297.850212:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295890 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850219:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295890 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850230:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:3.0:1789304297.850232:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304297.850237:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295890 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850243:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295890 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850256:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850262:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295897 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850268:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295897 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850273:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304297.850276:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295897 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850286:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295897 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850293:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789304297.850295:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304297.850298:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295897 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850304:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295897 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850332:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295889 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100222 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850354:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129589e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100222 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.850361:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:3.0:1789304297.850363:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304297.850365:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f600, rc 0) 00000100:00100000:3.0:1789304297.850433:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:43269:x1876219765480192:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 673us (2508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304297.850440:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 645 00000100:00100000:0.0:1789304297.856639:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304297.857062:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765480320 00000100:00100000:1.0:1789304297.857073:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765480320 00000100:00100000:0.0:1789304297.857487:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 342 00000100:00100000:0.0:1789304297.857500:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765480320:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:0.0:1789304297.857520:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304297.857544:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb72312958a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100229 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304297.857572:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x6aa69de9, atime: 0x6aa69de9, ctime: 0x6aa69de9, blocks: 0x1 00010000:00010000:0.0:1789304297.857593:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1747s v=(0 0) 00010000:00010000:0.0:1789304297.857598:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304297.857607:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb72312958a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100229 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.857626:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb72312958a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100229 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.857640:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789304297.857705:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765480320:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 209us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304297.857713:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 342 00000100:00100000:1.0:1789304297.862305:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304297.863059:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765480576 00000100:00100000:3.0:1789304297.863075:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765480576 00000100:00100000:3.0:1789304297.863175:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 646 00000100:00100000:3.0:1789304297.863186:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:43269:x1876219765480576:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:3.0:1789304297.863250:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304297.863279:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129589e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100222 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.863305:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295882 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610021b expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.863316:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:3.0:1789304297.863328:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304297.863365:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.863381:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.863391:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.863407:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.863415:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.863422:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.863547:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312958ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.863556:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312958ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.863564:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312958ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304297.864182:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 64 off9472 00000004:00080000:3.0:1789304297.864194:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1747542103335ns, next at 1748542100947ns, rc = 0 00010000:00010000:3.0:1789304297.864260:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864272:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864281:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864289:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864296:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864303:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864325:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304297.864350:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312958ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864356:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312958ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864362:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312958ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864368:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304297.864372:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312958ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864380:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312958ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864390:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304297.864393:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304297.864397:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312958ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864403:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312958ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864421:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864426:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864431:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864436:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304297.864439:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864445:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864468:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:3.0:1789304297.864471:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304297.864474:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304297.864479:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304297.864488:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059173a28 reply state 00000000fdee68a8 transno 4294967544 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304297.864498:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304297.864579:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:43269:x1876219765480576:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 1392us (2280us total) trans 4294967544 rc 0/0 00000100:00100000:3.0:1789304297.864588:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 646 00010000:00010000:1.0:1789304297.864604:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304297.864613:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.864622:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304297.864627:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.864634:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.864644:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:1.0:1789304297.864647:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304297.864650:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.864660:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312958c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304297.864677:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304297.864679:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304297.864681:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304297.866648:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.866665:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.866673:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.866682:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304297.866687:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.866695:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.866712:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c2ea19200) 00010000:00010000:0.0:1789304297.866716:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304297.866720:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304297.866726:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312958b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304298.258707:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785574656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304298.258779:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304298.258929:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785574656 00000100:00100000:0.0:1789304298.258937:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785574656 00000100:00100000:0.0:1789304298.258999:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1789304298.259009:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785574656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304298.259057:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789304298.259334:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304298.259396:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785574656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 388us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304298.259404:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1789304298.259502:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785574656:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304298.838425:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304299.362710:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967543 is committed 00000001:00080000:1.0:1789304299.362733:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967544 is committed 00000004:00080000:1.0:1789304299.362737:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 51 committed 00000100:00100000:1.0:1789304299.362873:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785574784:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789304299.362945:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304299.363025:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785574784 00000100:00100000:1.0:1789304299.363035:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785574784 00000100:00100000:1.0:1789304299.365084:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789304299.365128:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785574784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789304299.365165:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:20 count 1 00010000:00010000:1.0:1789304299.365192:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.365217:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb72312958a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100229 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.365227:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789304299.365231:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304299.365236:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.365281:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb72312958a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100229 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.365297:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb72312958a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100229 expref: 6 pid: 6691 timeout: 1849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304299.365311:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785574912:192.168.202.29@tcp:104: 00000100:00100000:1.0:1789304299.365414:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789304299.368265:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785574912:192.168.202.29@tcp:104: 00010000:00010000:1.0:1789304299.368299:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304299.378259:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304299.381319:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765480704 00000100:00100000:3.0:1789304299.381337:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765480704 00010000:00010000:1.0:1789304299.383738:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb72312958a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100229 expref: 7 pid: 6691 timeout: 1849 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304299.383802:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 341 00000100:00100000:1.0:1789304299.383816:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765480704:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304299.383833:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304299.383840:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb72312958a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100229 expref: 7 pid: 6691 timeout: 1849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.383855:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb72312958a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100229 expref: 7 pid: 6691 timeout: 1849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.383883:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb72312958a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100229 expref: 7 pid: 6691 timeout: 1849 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.383899:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304299.383904:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304299.383909:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.383919:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.383950:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304299.384013:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765480704:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 200us (5762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304299.384021:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 341 00000100:00080000:3.0:1789304299.384265:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304299.384347:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.384358:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.384369:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.384377:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.384396:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789304299.385131:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785574784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20009us (22183us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1789304299.385141:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:1.0:1789304299.385171:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304299.385179:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.385188:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304299.385193:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.385203:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.385220:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.385228:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000728d2f51/0xefc0bb72312958c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.385249:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304299.385251:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304299.385253:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304299.385294:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c36e86a00/2, rc 0, transno 4294967337 00000100:00100000:1.0:1789304299.385300:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785574784:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1789304299.578261:0:74778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6d9f31d0 20000000:00000080:2.0:1789304299.578278:0:74778:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412aac00 uarg=0000000000000000 00010000:00010000:2.0:1789304299.578910:0:74778:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789304299.578946:0:74778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:2.0:1789304299.578951:0:74778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304299.578961:0:74778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610020d expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.578993:0:74778:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789304299.579012:0:74778:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304299.579026:0:74778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.579041:0:74778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231295835 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129582e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.579049:0:74778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.579085:0:74778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231295835 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129582e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.579323:0:74778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231295835 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129582e expref: 18 pid: 5846 timeout: 1899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304299.579338:0:74778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74778:1876219785575040:0@lo:104: 00000100:00100000:2.0:1789304299.579400:0:74778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304299.579788:0:74778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03853540 going to sleep for 11 seconds 00000100:00100000:1.0:1789304299.579943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785575040 00000100:00100000:1.0:1789304299.579952:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785575040 00000100:00100000:1.0:1789304299.580041:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789304299.580051:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:74778:x1876219785575040:12345-0@lo:104: 00010000:00010000:1.0:1789304299.580065:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304299.580162:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304299.580168:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:74778:x1876219785575040:12345-0@lo:104: Request processed in 120us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304299.580175:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00010000:0.0:1789304299.580227:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304299.580235:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304299.580242:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304299.580247:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304299.580256:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304299.580263:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304299.580270:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304299.580301:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304299.580308:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304299.580328:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304299.580335:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129582e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295835 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304299.580351:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304299.580353:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304299.580355:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304299.580460:0:74778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74778:1876219785575040:0@lo:104: 00010000:00010000:2.0:1789304299.580478:0:74778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304299.580831:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785575168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304299.580868:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304299.580986:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785575168 00000100:00100000:2.0:1789304299.580991:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785575168 00010000:00010000:2.0:1789304299.581013:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231295835 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129582e expref: 19 pid: 5846 timeout: 1899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304299.581078:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789304299.581086:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785575168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304299.581128:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304299.581134:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231295835 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129582e expref: 19 pid: 5846 timeout: 1899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581144:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231295835 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129582e expref: 19 pid: 5846 timeout: 1899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581158:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8f400/0xefc0bb7231295835 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129582e expref: 19 pid: 5846 timeout: 1899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581172:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581180:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581194:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581202:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581208:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581215:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581225:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304299.581231:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581239:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581257:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304299.581266:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304299.581309:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785575168:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304299.581316:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00010000:0.0:1789304299.581372:0:74778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304299.581380:0:74778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304299.581386:0:74778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312958cf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304299.582900:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785575168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304299.807851:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785575552:0@lo:400:kworker.0 00000100:00100000:0.0:1789304299.807924:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304299.807980:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304299.807986:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785575680:0@lo:400:kworker.0 00000100:00100000:0.0:1789304299.808011:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304299.808992:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785575296:0@lo:400:kworker.0 00000100:00100000:2.0:1789304299.809038:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304299.809081:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304299.809109:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785575424:0@lo:400:kworker.0 00000100:00100000:2.0:1789304299.809135:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304299.809169:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785575680 00000100:00100000:2.0:1789304299.809177:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785575680 00000100:00100000:2.0:1789304299.809233:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1789304299.809244:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785575680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304299.809298:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785575680:12345-0@lo:400:kworker.0 Request processed in 56us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304299.809305:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1789304299.809329:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785575552 00000100:00100000:2.0:1789304299.809333:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785575552 00000100:00100000:2.0:1789304299.809360:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785575296 00000100:00100000:2.0:1789304299.809363:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785575296 00000100:00100000:2.0:1789304299.809380:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785575424 00000100:00100000:2.0:1789304299.809383:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785575424 00000100:00100000:2.0:1789304299.809399:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1789304299.809406:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785575552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304299.809460:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785575552:12345-0@lo:400:kworker.0 Request processed in 54us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304299.809466:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1789304299.809479:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1789304299.809486:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785575296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304299.809520:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785575296:12345-0@lo:400:kworker.0 Request processed in 35us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304299.809526:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1789304299.809537:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:2.0:1789304299.809544:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785575424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304299.809571:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785575424:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304299.809577:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00080000:2.0:1789304299.809595:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304299.809600:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304299.809638:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785575680:0@lo:400:kworker.0 00000100:00100000:2.0:1789304299.809650:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785575552:0@lo:400:kworker.0 00000100:00100000:2.0:1789304299.809688:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785575424:0@lo:400:kworker.0 00000100:00100000:2.0:1789304299.809698:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785575296:0@lo:400:kworker.0 00010000:00010000:2.0:1789304299.858260:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304300.885586:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304301.588524:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304301.588531:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304301.588536:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304301.588587:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304301.588600:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304301.588612:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304301.588638:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785575808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304301.588704:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304301.588759:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05a08cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304301.588867:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785575808 00000100:00100000:3.0:1789304301.588875:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785575808 00000100:00100000:3.0:1789304301.588925:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1789304301.588934:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785575808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304301.588946:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304301.588960:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312958dd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312958d6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304301.588983:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312958dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312958d6 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304301.588994:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312958dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312958d6 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304301.589015:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304301.589057:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785575808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304301.589063:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1789304301.589505:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785575808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304301.589521:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304301.589531:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304301.589550:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304301.589556:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304301.589564:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304301.907552:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304302.356721:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304302.356749:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785575936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304302.356831:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304302.356913:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785575936 00000100:00100000:3.0:1789304302.356922:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785575936 00000100:00100000:3.0:1789304302.356981:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:3.0:1789304302.356991:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785575936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304302.357037:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304302.357108:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785575936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304302.357116:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00080000:3.0:1789304302.357140:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304302.357235:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785575936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304302.435354:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304302.435393:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304302.435438:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304302.435466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304302.435494:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765480960 00000100:00100000:3.0:1789304302.435504:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765480960 00000100:00100000:3.0:1789304302.435565:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1225 00000100:00100000:3.0:1789304302.435574:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765480960:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304302.435653:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765480960:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304302.435661:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1225 00000100:00100000:3.0:1789304302.435685:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765481088 00000100:00100000:3.0:1789304302.435688:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765481088 00000100:00100000:3.0:1789304302.435714:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765481216 00000100:00100000:3.0:1789304302.435717:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765481216 00000100:00100000:3.0:1789304302.435739:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 892 00000100:00100000:3.0:1789304302.435745:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765481088:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304302.435773:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765481088:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304302.435780:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 892 00000100:00100000:3.0:1789304302.435791:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 344 00000100:00100000:3.0:1789304302.435797:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765481216:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:3.0:1789304302.435816:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231295732 00000100:00080000:3.0:1789304302.435825:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9e2c389e9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789304302.435869:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967335 00000100:00100000:3.0:1789304302.436151:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765481216:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 352us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304302.436158:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 344 00000100:00080000:3.0:1789304302.436175:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304302.436179:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304302.436182:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304302.436315:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304302.436459:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765480832 00000100:00100000:1.0:1789304302.436465:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765480832 00000100:00100000:1.0:1789304302.436503:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1039 00000100:00100000:1.0:1789304302.436511:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765480832:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304302.436547:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765480832:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304302.436554:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1039 00000001:00100000:2.0:1789304302.931077:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:2.0:1789304302.931109:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2c389ec000/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:2.0:1789304302.931136:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c389ec000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:2.0:1789304302.931174:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c389e9000 for lustre-OST0001 00010000:00010000:0.0:1789304302.931916:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304302.957798:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304302.959282:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765481344 00000100:00100000:2.0:1789304302.959305:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765481344 00000100:00100000:2.0:1789304302.959368:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 647 00000100:00100000:2.0:1789304302.959377:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:43360:x1876219765481344:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304302.959398:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304302.959432:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312958e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100230 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304302.959495:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312958eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304302.959509:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312958eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304302.959523:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312958eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304302.959562:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:2.0:1789304302.959565:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304302.959587:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312958eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304302.959613:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312958e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100230 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304302.959635:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312958eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100230 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304302.959643:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789304302.959646:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304302.959650:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd000, rc 0) 00000100:00100000:2.0:1789304302.959718:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:43360:x1876219765481344:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 342us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304302.959724:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 647 00000100:00100000:1.0:1789304302.973542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304302.975486:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765481600 00000100:00100000:3.0:1789304302.975505:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765481600 00000100:00100000:3.0:1789304302.975580:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 648 00000100:00100000:3.0:1789304302.975591:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:43360:x1876219765481600:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304302.975669:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304302.975720:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312958eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100230 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304302.975743:0:30980:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231295851) 00010000:00010000:3.0:1789304302.975748:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:3.0:1789304302.975762:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304302.975801:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304302.975815:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304302.975826:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789304302.976804:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 00000001:00080000:0.0:1789304302.976819:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967336 is committed 00000004:00010000:3.0:1789304302.977966:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000caad1b5b reply state 0000000028a51fe1 transno 4294967545 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304302.977986:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304302.978001:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000100:00100000:3.0:1789304302.980714:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:43360:x1876219765481600:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 5112us (7171us total) trans 4294967545 rc 0/0 00000100:00100000:3.0:1789304302.980728:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 648 00010000:00010000:3.0:1789304302.985155:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304302.985173:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304302.985181:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304302.985187:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304302.985193:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304302.985200:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304302.985225:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304302.985229:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304302.985233:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304302.985245:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312958f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304303.412530:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304303.412555:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785576064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304303.412642:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304303.412717:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785576064 00000100:00100000:0.0:1789304303.412725:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785576064 00000100:00100000:0.0:1789304303.412789:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1789304303.412798:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785576064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304303.412838:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304303.412890:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41129c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785576064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304303.412897:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00080000:0.0:1789304303.413195:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304303.413227:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:0.0:1789304303.413234:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c36e86a00, transno 4294967337 00000100:00100000:0.0:1789304303.413253:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785576064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304303.956280:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304303.963748:0:74975:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb6777fb0 20000000:00000080:2.0:1789304303.963768:0:74975:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c40f3a000 uarg=0000000000000000 00010000:00010000:2.0:1789304303.965000:0:74975:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304303.965021:0:74975:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304303.965036:0:74975:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304303.965058:0:74975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304303.965078:0:74975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312958dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312958d6 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304303.965087:0:74975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304303.965424:0:74975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312958dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312958d6 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304303.965441:0:74975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312958dd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312958d6 expref: 18 pid: 5847 timeout: 1903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304303.965460:0:74975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74975:1876219785576192:0@lo:104: 00000100:00100000:2.0:1789304303.965533:0:74975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304303.965581:0:74975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752780 going to sleep for 11 seconds 00000100:00100000:0.0:1789304303.965667:0:52683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789304303.965682:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785576192 00000100:00100000:0.0:1789304303.965689:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785576192 00000100:00100000:0.0:1789304303.965747:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789304303.965757:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:74975:x1876219785576192:12345-0@lo:104: 00010000:00010000:0.0:1789304303.965771:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304303.965845:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304303.965852:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f6f6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:74975:x1876219785576192:12345-0@lo:104: Request processed in 97us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304303.965859:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00010000:1.0:1789304303.965883:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304303.965890:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.965903:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304303.965906:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.965914:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304303.965920:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304303.965924:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304303.965953:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.965958:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304303.965976:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.965981:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb72312958d6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312958dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304303.965993:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785576320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304303.965995:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304303.965998:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304303.966001:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304303.966029:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304303.966069:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785576320 00000100:00100000:1.0:1789304303.966073:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785576320 00010000:00010000:1.0:1789304303.966117:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312958dd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312958d6 expref: 19 pid: 5847 timeout: 1903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304303.966134:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789304303.966140:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785576320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304303.966148:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304303.966152:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312958dd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312958d6 expref: 19 pid: 5847 timeout: 1903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966159:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312958dd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312958d6 expref: 19 pid: 5847 timeout: 1903 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966172:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966177:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966186:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966191:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966195:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966199:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966202:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304303.966205:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966209:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966215:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304303.966221:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304303.966254:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785576320:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304303.966261:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789304303.966327:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785576320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304303.966516:0:74975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312958dd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312958d6 expref: 18 pid: 5847 timeout: 1903 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304303.966528:0:74975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74975:1876219785576192:0@lo:104: 00010000:00010000:2.0:1789304303.966540:0:74975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304303.966549:0:74975:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304303.966556:0:74975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304303.966562:0:74975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312958f9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789304304.470819:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967545 is committed 00000100:00100000:0.0:1789304304.914343:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785576576:0@lo:400:kworker.0 00000100:00100000:0.0:1789304304.914425:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304304.914487:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785577088:0@lo:400:kworker.0 00000100:00100000:0.0:1789304304.914514:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304304.914538:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304304.914544:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785576704:0@lo:400:kworker.0 00000100:00100000:0.0:1789304304.914567:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304304.915041:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785576448:0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915079:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304304.915142:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785576960:0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915168:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304304.915191:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304304.915198:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785576832:0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915217:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304304.915311:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785576576 00000100:00100000:3.0:1789304304.915319:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785576576 00000100:00100000:3.0:1789304304.915364:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785576960 00000100:00100000:3.0:1789304304.915368:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785576960 00000100:00100000:3.0:1789304304.915404:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785576832 00000100:00100000:3.0:1789304304.915407:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785576832 00000100:00100000:3.0:1789304304.915426:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1789304304.915433:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785576576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915497:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785576576:12345-0@lo:400:kworker.0 Request processed in 64us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304304.915506:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1789304304.915521:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1789304304.915528:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785576960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915559:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785576960:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304304.915564:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1789304304.915575:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1789304304.915580:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785576832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915604:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785576832:12345-0@lo:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304304.915610:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1789304304.915627:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785577088 00000100:00100000:3.0:1789304304.915631:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785577088 00000100:00100000:3.0:1789304304.915651:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785576704 00000100:00100000:3.0:1789304304.915653:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785576704 00000100:00100000:3.0:1789304304.915669:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1789304304.915675:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785577088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915701:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785577088:12345-0@lo:400:kworker.0 Request processed in 26us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304304.915706:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1789304304.915714:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1789304304.915719:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785576704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915739:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785576704:12345-0@lo:400:kworker.0 Request processed in 20us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304304.915744:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00080000:3.0:1789304304.915768:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304304.915772:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304304.915800:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785576704:0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915809:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785576576:0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915818:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785577088:0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915855:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785576832:0@lo:400:kworker.0 00000100:00100000:3.0:1789304304.915864:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785576960:0@lo:400:kworker.0 00000100:00100000:0.0:1789304304.918572:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785576448 00000100:00100000:0.0:1789304304.918589:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785576448 00000100:00100000:0.0:1789304304.918645:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1789304304.918656:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785576448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304304.918766:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785576448:12345-0@lo:400:kworker.0 Request processed in 112us (3686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304304.918773:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1789304304.920310:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785576448:0@lo:400:kworker.0 00010000:00010000:0.0:1789304304.978216:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304305.106239:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304305.106249:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304305.106255:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304305.106314:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304305.106327:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304305.106340:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304305.106369:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785577216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304305.106460:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304305.106524:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388c8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789304305.106647:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785577216 00000100:00100000:3.0:1789304305.106655:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785577216 00000100:00100000:3.0:1789304305.106708:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1789304305.106717:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785577216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304305.106731:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304305.106746:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231295907 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295900 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304305.106769:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231295907 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295900 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304305.106780:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231295907 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295900 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304305.106789:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ec00, rc 0) 00000100:00100000:3.0:1789304305.106842:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785577216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304305.106848:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1789304305.107026:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785577216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304305.107041:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304305.107050:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304305.107070:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304305.107075:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304305.107084:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.003242:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304306.836622:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304306.836783:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765481728 00000100:00100000:3.0:1789304306.836795:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765481728 00000100:00100000:3.0:1789304306.836916:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 649 00000100:00100000:3.0:1789304306.836928:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765481728:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304306.837039:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765481728:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 113us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304306.837047:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 649 00000100:00080000:0.0:1789304306.837520:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304306.838817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304306.838881:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765481856 00000100:00100000:0.0:1789304306.838889:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765481856 00000100:00100000:0.0:1789304306.838969:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 345 00000100:00100000:0.0:1789304306.838979:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765481856:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:3.0:1789304306.839508:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304306.839719:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765481856:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 739us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304306.840037:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 345 00000100:00100000:1.0:1789304306.848638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304306.851346:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765481984 00000100:00100000:3.0:1789304306.851367:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765481984 00000100:00100000:3.0:1789304306.851455:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 346 00000100:00100000:3.0:1789304306.851466:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876219765481984:12345-192.168.202.29@tcp:8:lfs.60003 00010000:00080000:3.0:1789304306.851501:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1756 last 0 00000020:00000080:3.0:1789304306.851548:0:6691:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb723129590e 00002000:00100000:3.0:1789304306.851564:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c07ea8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789304306.851588:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789304306.851839:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789304306.851876:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2c07eaf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789304306.852152:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765481984:12345-192.168.202.29@tcp:8:lfs.60003 Request processed in 685us (3523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304306.852160:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 346 00000100:00100000:2.0:1789304306.855191:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304306.855280:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765482112 00000100:00100000:1.0:1789304306.855291:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765482112 00000100:00100000:1.0:1789304306.855352:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 347 00000100:00100000:1.0:1789304306.855362:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:43445:x1876219765482112:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304306.855733:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:43445:x1876219765482112:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 372us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304306.855741:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 347 00000100:00080000:3.0:1789304306.857029:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304306.857909:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304306.858121:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765482240 00000100:00100000:3.0:1789304306.858131:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765482240 00000100:00100000:3.0:1789304306.858186:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 650 00000100:00100000:3.0:1789304306.858196:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765482240:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304306.860000:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765482240:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 1792us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304306.860013:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 650 00000100:00100000:2.0:1789304306.865809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304306.865864:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765482368 00000100:00100000:3.0:1789304306.865876:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765482368 00000100:00100000:3.0:1789304306.866344:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 651 00000100:00100000:3.0:1789304306.866355:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765482368:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304306.866716:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765482368:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 361us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304306.866725:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 651 00000100:00100000:2.0:1789304306.868735:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304306.869293:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765482496 00000100:00100000:3.0:1789304306.869303:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765482496 00000100:00100000:3.0:1789304306.869360:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 348 00000100:00100000:3.0:1789304306.869379:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765482496:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304306.870422:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765482496:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1049us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304306.870868:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 348 00000100:00100000:0.0:1789304306.872336:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304306.872418:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765482624 00000100:00100000:1.0:1789304306.872427:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765482624 00000100:00100000:1.0:1789304306.872525:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 349 00000100:00100000:1.0:1789304306.872536:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:43445:x1876219765482624:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304306.872867:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:43445:x1876219765482624:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 333us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304306.872874:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 349 00000100:00100000:2.0:1789304306.874056:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304306.874124:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765482752 00000100:00100000:3.0:1789304306.874140:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765482752 00000100:00100000:3.0:1789304306.874194:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 652 00000100:00100000:3.0:1789304306.874204:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765482752:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304306.874691:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:43445:x1876219765482752:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 488us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304306.874697:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 652 00000100:00100000:2.0:1789304306.921566:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304306.921622:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765482880 00000100:00100000:3.0:1789304306.921810:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765482880 00000100:00100000:3.0:1789304306.921909:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 653 00000100:00100000:3.0:1789304306.921918:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:43449:x1876219765482880:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:3.0:1789304306.921940:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304306.921970:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100237 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304306.922032:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129591c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304306.922044:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129591c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304306.922054:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129591c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304306.922066:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295923 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304306.922071:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304306.922075:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922753:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb723129592a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922766:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb723129592a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922773:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb723129592a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304306.922798:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:2.0:1789304306.922802:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304306.922823:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb723129592a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922837:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129591c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922843:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129591c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922850:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129591c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922857:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304306.922862:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129591c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922870:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129591c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922883:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:2.0:1789304306.922886:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304306.922891:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129591c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922896:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129591c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922909:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295923 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922914:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295923 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922920:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922925:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304306.922927:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295923 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922933:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295923 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922943:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c2ea19800) 00010000:00010000:2.0:1789304306.922945:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304306.922948:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295923 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922953:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295923 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.922984:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100237 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.923002:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb723129592a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100237 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.923009:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:2.0:1789304306.923011:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304306.923013:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd800, rc 0) 00000100:00100000:2.0:1789304306.923204:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:43449:x1876219765482880:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1173us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304306.923213:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 653 00000100:00100000:0.0:1789304306.927555:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304306.927676:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765483136 00000100:00100000:3.0:1789304306.927687:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765483136 00000100:00100000:3.0:1789304306.927786:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 654 00000100:00100000:3.0:1789304306.927797:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:43449:x1876219765483136:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:3.0:1789304306.927820:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304306.927841:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295931 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610023e expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.928514:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295938 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.928528:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.928538:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.928550:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.928554:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.928558:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789304306.929484:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14:0x0], index 1: 0 00010000:00010000:1.0:1789304306.929718:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295946 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929729:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929736:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929763:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929768:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295938 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929772:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929775:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304306.929779:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929783:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295938 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929790:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:1.0:1789304306.929792:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304306.929795:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295938 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929799:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295938 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304306.929809:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd8211c4 reply state 0000000068c6176e transno 4294967546 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304306.929816:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789304306.929840:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295931 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610023e expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929851:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610023e expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304306.929856:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:1.0:1789304306.929858:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304306.929860:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ee00, rc 0) 00000100:00100000:1.0:1789304306.929921:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:43449:x1876219765483136:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 2127us (2378us total) trans 4294967546 rc 0/0 00000100:00100000:1.0:1789304306.929927:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 654 00010000:00010000:0.0:1789304306.933246:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304306.933264:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304306.933273:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304306.933279:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304306.933284:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304306.933292:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304306.933309:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c14add300) 00010000:00010000:0.0:1789304306.933313:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304306.933318:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304306.933322:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129593f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304306.935082:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304306.935256:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765483264 00000100:00100000:2.0:1789304306.935270:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765483264 00000100:00100000:2.0:1789304306.935455:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 350 00000100:00100000:2.0:1789304306.935467:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:43449:x1876219765483264:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:2.0:1789304306.935494:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304306.935520:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231295954 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100245 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304306.935558:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789304306.935585:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=1756s v=(0 0) 00010000:00010000:2.0:1789304306.935591:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304306.935603:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231295954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100245 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.935621:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231295954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100245 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304306.935633:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc200, rc 0) 00000100:00100000:2.0:1789304306.935698:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:43449:x1876219765483264:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 233us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304306.935704:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 350 00000100:00100000:1.0:1789304306.970796:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304306.970911:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765483392 00000100:00100000:0.0:1789304306.970920:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765483392 00002000:00100000:0.0:1789304306.970972:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x14:0x0] (0->1048575) req@ffff9e2c36e84380 x1876219765483392/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:372/0 lens 488/0 e 0 to 0 dl 1789304317 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789304306.970981:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c36e84380 with x1876219765483392 ext(0->1048575) 00002000:00010000:0.0:1789304306.970985:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c36e84380 00000100:00100000:0.0:1789304306.971012:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:0.0:1789304306.971018:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765483392:12345-192.168.202.29@tcp:4:dd.60003 00010000:00010000:2.0:1789304307.027785:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789304307.072721:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:1.0:1789304307.078763:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765483392:12345-192.168.202.29@tcp:4:dd.60003 Request processed in 107732us (107967us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789304307.078779:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00002000:00100000:1.0:1789304307.078793:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x14:0x0] (0->1048575) req@ffff9e2c36e84380 x1876219765483392/t4294967336(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:372/0 lens 488/448 e 0 to 0 dl 1789304317 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304307.078804:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c36e84380 with x1876219765483392 ext(0->1048575) 00002000:00010000:1.0:1789304307.078811:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c36e84380 00000100:00100000:1.0:1789304307.081879:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304307.082307:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765483520 00000100:00100000:3.0:1789304307.082317:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765483520 00000100:00100000:3.0:1789304307.082403:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 655 00000100:00100000:3.0:1789304307.082412:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:43449:x1876219765483520:12345-192.168.202.29@tcp:44:dd.60003 00000100:00100000:3.0:1789304307.119291:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:43449:x1876219765483520:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 36867us (37408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304307.119306:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 655 00000001:00080000:0.0:1789304307.119403:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967546 is committed 00000100:00100000:1.0:1789304307.121291:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304307.121389:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765483648 00000100:00100000:0.0:1789304307.121399:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765483648 00000100:00100000:0.0:1789304307.121540:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 351 00000100:00100000:0.0:1789304307.121550:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765483648:12345-192.168.202.29@tcp:16:dd.60003 00000001:00080000:3.0:1789304307.141909:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967336 is committed 00000100:00100000:1.0:1789304307.142011:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765483648:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 20456us (20721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304307.142028:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 351 00000100:00100000:1.0:1789304307.144986:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304307.145293:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765483904 00000100:00100000:3.0:1789304307.145303:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765483904 00000100:00100000:3.0:1789304307.145407:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 69 00000100:00100000:3.0:1789304307.145434:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:43449:x1876219765483904:12345-192.168.202.29@tcp:35:dd.60003 00000100:00100000:3.0:1789304307.145975:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:43449:x1876219765483904:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 548us (998us total) trans 4294967547 rc 0/0 00000100:00100000:3.0:1789304307.145984:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 69 00000100:00100000:2.0:1789304307.474354:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304307.474820:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785577344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304307.474898:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304307.479680:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785577344 00000100:00100000:3.0:1789304307.479697:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785577344 00000100:00100000:3.0:1789304307.479790:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:3.0:1789304307.479801:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785577344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304307.479827:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789304307.479923:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785577344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (5024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304307.479930:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00080000:0.0:1789304307.480021:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304307.480471:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785577344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304307.553293:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304307.553400:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765484032 00000100:00100000:2.0:1789304307.553425:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765484032 00000100:00100000:2.0:1789304307.553488:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1042 00000100:00100000:2.0:1789304307.553499:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765484032:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304307.553583:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765484032:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304307.553592:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1042 00000100:00100000:2.0:1789304307.560766:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304307.560804:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304307.560828:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304307.560854:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765484416 00000100:00100000:2.0:1789304307.560863:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765484416 00000100:00100000:2.0:1789304307.560907:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765484288 00000100:00100000:2.0:1789304307.560909:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765484288 00000100:00100000:2.0:1789304307.560928:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 895 00000100:00100000:2.0:1789304307.560937:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765484416:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304307.560996:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765484416:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 61us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304307.561003:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 895 00000100:00100000:2.0:1789304307.561018:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 896 00000100:00100000:2.0:1789304307.561024:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765484288:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304307.561042:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765484288:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 19us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304307.561048:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 896 00000100:00100000:0.0:1789304307.561120:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765484160 00000100:00100000:0.0:1789304307.561124:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765484160 00000100:00100000:0.0:1789304307.561158:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1229 00000100:00100000:0.0:1789304307.561172:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765484160:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304307.561203:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765484160:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304307.561209:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1229 00010000:00010000:3.0:1789304308.055280:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304308.270776:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967547 is committed 00000100:00100000:3.0:1789304308.503865:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785577472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304308.503949:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304308.504033:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785577472 00000100:00100000:3.0:1789304308.504041:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785577472 00000100:00100000:3.0:1789304308.504122:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1789304308.504132:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785577472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304308.504168:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304308.504218:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785577472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304308.504225:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00080000:3.0:1789304308.504247:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304308.504285:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785577472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304309.074397:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304309.491331:0:75222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1759169236543ns, next at 1748542100947ns, rc = 0 00000004:00080000:0.0:1789304309.491603:0:75222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1759169511378ns, next at 1712788656582ns, rc = 0 00000004:00080000:3.0:1789304309.493592:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 57 committed 00000004:00080000:3.0:1789304309.493651:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 52 committed 00000100:00100000:3.0:1789304310.039611:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785577600:0@lo:400:kworker.0 00000100:00100000:3.0:1789304310.039680:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304310.039918:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304310.039926:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785577984:0@lo:400:kworker.0 00000100:00100000:3.0:1789304310.039955:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304310.039996:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785577600 00000100:00100000:3.0:1789304310.040005:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785577600 00000100:00100000:3.0:1789304310.040049:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1789304310.040058:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785577600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304310.040133:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785577600:12345-0@lo:400:kworker.0 Request processed in 75us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304310.040140:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1789304310.040192:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785577600:0@lo:400:kworker.0 00000100:00100000:0.0:1789304310.042334:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785577984 00000100:00100000:0.0:1789304310.042357:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785577984 00000100:00100000:0.0:1789304310.042443:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1789304310.042454:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785577984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304310.042532:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785577984:12345-0@lo:400:kworker.0 Request processed in 82us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304310.042539:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1789304310.042753:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785577984:0@lo:400:kworker.0 00000100:00080000:3.0:1789304310.042778:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304310.042826:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785577728:0@lo:400:kworker.0 00000100:00100000:3.0:1789304310.042861:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304310.042898:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304310.042906:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785577856:0@lo:400:kworker.0 00000100:00100000:3.0:1789304310.042932:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304310.042975:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785577856 00000100:00100000:3.0:1789304310.042980:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785577856 00000100:00100000:3.0:1789304310.043014:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1789304310.043021:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785577856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304310.043057:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785577856:12345-0@lo:400:kworker.0 Request processed in 37us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304310.043063:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00080000:3.0:1789304310.043078:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304310.043119:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785577856:0@lo:400:kworker.0 00000100:00100000:0.0:1789304310.043199:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785577728 00000100:00100000:0.0:1789304310.043204:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785577728 00000100:00100000:0.0:1789304310.043240:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1789304310.043247:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785577728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304310.043283:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785577728:12345-0@lo:400:kworker.0 Request processed in 36us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304310.043289:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1789304310.043319:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785577728:0@lo:400:kworker.0 00000100:00100000:3.0:1789304310.044929:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785578112:0@lo:400:kworker.0 00000100:00100000:3.0:1789304310.044990:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304310.045066:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785578112 00000100:00100000:0.0:1789304310.045074:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785578112 00000100:00100000:0.0:1789304310.045147:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1789304310.045156:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785578112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304310.045257:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785578240:0@lo:400:kworker.0 00000100:00100000:1.0:1789304310.045285:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304310.045317:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785578240 00000100:00100000:1.0:1789304310.045321:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785578240 00000100:00100000:1.0:1789304310.045363:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:1.0:1789304310.045370:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785578240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304310.045420:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785578240:12345-0@lo:400:kworker.0 Request processed in 51us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304310.045428:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:1.0:1789304310.045471:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785578240:0@lo:400:kworker.0 00000100:00100000:0.0:1789304310.048197:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785578112:12345-0@lo:400:kworker.0 Request processed in 3033us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304310.048221:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00080000:0.0:1789304310.049138:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304310.049147:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304310.052975:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785578112:0@lo:400:kworker.0 00010000:00010000:2.0:1789304310.099624:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304310.730765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304310.730911:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765484544 00000100:00100000:3.0:1789304310.730922:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765484544 00000100:00100000:3.0:1789304310.731003:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 656 00000100:00100000:3.0:1789304310.731015:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:43641:x1876219765484544:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304310.731137:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:43641:x1876219765484544:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 124us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304310.731144:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 656 00000100:00080000:1.0:1789304310.731218:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304310.745986:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304310.746640:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765484672 00000100:00100000:3.0:1789304310.746655:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765484672 00000100:00100000:3.0:1789304310.746739:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 352 00000100:00100000:3.0:1789304310.746750:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:43641:x1876219765484672:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:0.0:1789304310.747166:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304310.747470:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:43641:x1876219765484672:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 721us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304310.747478:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 352 00000100:00100000:2.0:1789304310.765722:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304310.769738:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765484800 00000100:00100000:1.0:1789304310.769764:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765484800 00000100:00100000:1.0:1789304310.769863:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 353 00000100:00100000:1.0:1789304310.769876:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:43641:x1876219765484800:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304310.770321:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:43641:x1876219765484800:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 448us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304310.770329:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 353 00000100:00080000:0.0:1789304310.770659:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304310.773174:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304310.773367:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765484928 00000100:00100000:1.0:1789304310.773378:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765484928 00000100:00100000:1.0:1789304310.773584:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 657 00000100:00100000:1.0:1789304310.773596:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:43641:x1876219765484928:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304310.774116:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:43641:x1876219765484928:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 493us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304310.774126:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 657 00000100:00100000:3.0:1789304310.779004:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304310.779050:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765485056 00000100:00100000:3.0:1789304310.779078:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765485056 00000100:00100000:3.0:1789304310.779158:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 658 00000100:00100000:3.0:1789304310.779171:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:43641:x1876219765485056:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304310.779577:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:43641:x1876219765485056:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 407us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304310.779584:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 658 00000100:00100000:2.0:1789304310.782717:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304310.783015:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765485184 00000100:00100000:3.0:1789304310.783024:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765485184 00000100:00100000:3.0:1789304310.783082:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 354 00000100:00100000:3.0:1789304310.783116:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:43641:x1876219765485184:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304310.783798:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:43641:x1876219765485184:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 706us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304310.783806:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 354 00000100:00100000:2.0:1789304310.787948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304310.788015:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765485312 00000100:00100000:1.0:1789304310.788025:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765485312 00000100:00100000:1.0:1789304310.788120:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 355 00000100:00100000:1.0:1789304310.788132:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:43641:x1876219765485312:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304310.788874:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:43641:x1876219765485312:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 741us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304310.788882:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 355 00000100:00100000:2.0:1789304310.795837:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304310.795919:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765485440 00000100:00100000:0.0:1789304310.795931:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765485440 00000100:00100000:0.0:1789304310.795996:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 659 00000100:00100000:0.0:1789304310.796007:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:43641:x1876219765485440:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304310.796553:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:43641:x1876219765485440:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 547us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304310.796561:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 659 00000100:00100000:2.0:1789304310.922879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304310.923035:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765485696 00000100:00100000:1.0:1789304310.923047:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765485696 00000100:00100000:1.0:1789304310.923322:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 660 00000100:00100000:1.0:1789304310.923345:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:43645:x1876219765485696:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:1.0:1789304310.923402:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304310.923431:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295946 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610023e expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.923452:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:1.0:1789304310.923463:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304310.923487:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129595b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.923501:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129595b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.923511:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129595b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.923526:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.923533:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.923540:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.923826:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295969 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.923835:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295969 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.923842:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295969 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789304310.925262:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 64 off9472 00000004:00080000:1.0:1789304310.925279:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1760603187525ns, next at 1761603182065ns, rc = 0 00010000:00010000:1.0:1789304310.925393:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925408:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925419:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925428:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925434:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925441:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925468:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304310.925496:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295969 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925503:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295969 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925510:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295969 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925516:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304310.925521:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295969 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925534:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295969 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925546:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:1.0:1789304310.925549:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789304310.925554:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295969 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925560:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295969 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925577:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129595b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925584:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129595b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925590:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129595b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925595:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304310.925598:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129595b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925604:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129595b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925612:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:1.0:1789304310.925614:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304310.925617:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129595b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.925627:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129595b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304310.925637:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba3ef31e reply state 00000000ff9a14c0 transno 4294967548 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304310.925645:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304310.925737:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:43645:x1876219765485696:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 2402us (2864us total) trans 4294967548 rc 0/0 00000100:00100000:1.0:1789304310.925746:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 660 00010000:00010000:1.0:1789304310.926563:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304310.926572:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.926581:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304310.926585:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.926592:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.926605:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:1.0:1789304310.926608:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304310.926612:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.926617:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295970 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.926635:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304310.926637:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304310.926639:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304310.931700:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.931721:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.931730:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.931736:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304310.931741:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.931750:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.931767:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff9e2c14add000) 00010000:00010000:1.0:1789304310.931771:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304310.931776:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304310.931783:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295962 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304311.122501:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304312.147232:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304312.594663:0:8095:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1762272570035ns, next at 1763272567996ns, rc = 0 00000100:00100000:2.0:1789304312.594723:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304312.594745:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785578368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304312.594875:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304312.594985:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785578368 00000100:00100000:0.0:1789304312.594993:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785578368 00000100:00100000:0.0:1789304312.595055:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1789304312.595066:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785578368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304312.595125:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789304312.595173:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785578368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304312.595180:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1789304312.595221:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785578368:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304312.595353:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304312.683144:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304312.683180:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304312.683208:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304312.683231:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304312.683255:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765485824 00000100:00100000:2.0:1789304312.683264:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765485824 00000100:00100000:2.0:1789304312.683306:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1044 00000100:00100000:2.0:1789304312.683326:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765485824:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304312.683396:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765485824:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304312.683404:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1044 00000100:00100000:2.0:1789304312.683438:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765486208 00000100:00100000:2.0:1789304312.683442:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765486208 00000100:00100000:2.0:1789304312.683474:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765486080 00000100:00100000:2.0:1789304312.683477:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765486080 00000100:00100000:0.0:1789304312.683535:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765485952 00000100:00100000:0.0:1789304312.683539:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765485952 00000100:00100000:0.0:1789304312.683566:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1233 00000100:00100000:0.0:1789304312.683572:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765485952:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304312.683607:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765485952:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 35us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304312.683614:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1233 00000100:00080000:0.0:1789304312.683740:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304312.683745:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304312.683747:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304312.691714:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 899 00000100:00100000:2.0:1789304312.691738:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765486208:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304312.691845:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765486208:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 119us (8664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304312.691852:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 899 00000100:00100000:2.0:1789304312.691871:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 900 00000100:00100000:2.0:1789304312.691878:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765486080:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304312.691901:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765486080:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (8670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304312.691907:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 900 00010000:00010000:1.0:1789304313.171950:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304313.373083:0:75367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1763050989823ns, next at 1748542100947ns, rc = 0 00000004:00080000:2.0:1789304313.373233:0:75367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1763051141522ns, next at 1763272567996ns, rc = 0 00000004:00080000:3.0:1789304313.532489:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 59 committed 00000001:00080000:3.0:1789304313.532514:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967548 is committed 00000004:00080000:3.0:1789304313.532520:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 58 committed 00000004:00080000:3.0:1789304313.532524:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 60 committed 00000004:00080000:3.0:1789304313.532529:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 53 committed 00000100:00100000:3.0:1789304313.533367:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785578496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789304313.533446:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304313.533730:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785578496 00000100:00100000:2.0:1789304313.533740:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785578496 00000100:00100000:2.0:1789304313.533805:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789304313.533815:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785578496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789304313.533846:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:20 count 1 00010000:00010000:2.0:1789304313.533878:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304313.533905:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231295954 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100245 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304313.533915:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x14:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1789304313.533919:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304313.533924:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304313.533956:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231295954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100245 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304313.533971:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231295954 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100245 expref: 5 pid: 17212 timeout: 1863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304313.533984:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876219785578624:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789304313.534051:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789304313.538577:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304313.538755:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876219785578624:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789304313.538787:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304313.538865:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765486336 00000100:00100000:1.0:1789304313.538874:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765486336 00010000:00010000:1.0:1789304313.538914:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231295954 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100245 expref: 6 pid: 17212 timeout: 1863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304313.538966:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 344 00000100:00100000:1.0:1789304313.538975:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765486336:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304313.538991:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304313.538997:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231295954 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100245 expref: 6 pid: 17212 timeout: 1863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304313.539009:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231295954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100245 expref: 6 pid: 17212 timeout: 1863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304313.539036:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231295954 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100245 expref: 6 pid: 17212 timeout: 1863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304313.539053:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304313.539058:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304313.539063:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304313.539073:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304313.539150:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304313.539194:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765486336:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 219us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304313.539201:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 344 00010000:00010000:0.0:1789304313.539901:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304313.539912:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304313.539922:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304313.539931:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304313.539954:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304313.540445:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304313.540452:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304313.540461:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304313.540466:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304313.540475:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304313.540491:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304313.540499:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bea9fce/0xefc0bb7231295977 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304313.540519:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304313.540521:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304313.540522:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304313.541326:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785578496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7508us (7875us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789304313.541337:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000004:00080000:3.0:1789304313.543988:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c36e85880/2, rc 0, transno 4294967337 00000100:00100000:3.0:1789304313.544010:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785578496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789304313.618540:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785578752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304313.618624:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304313.618693:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785578752 00000100:00100000:3.0:1789304313.618701:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785578752 00000100:00100000:3.0:1789304313.618753:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1789304313.618762:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785578752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304313.618797:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304313.618837:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785578752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304313.618843:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00080000:3.0:1789304313.618859:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304313.618895:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785578752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304314.197785:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304315.157456:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785579136:0@lo:400:kworker.0 00000100:00100000:3.0:1789304315.157574:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304315.157647:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304315.157653:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785579264:0@lo:400:kworker.0 00000100:00100000:3.0:1789304315.157690:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304315.157725:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785579264 00000100:00100000:3.0:1789304315.157733:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785579264 00000100:00100000:3.0:1789304315.157788:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:3.0:1789304315.157797:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785579264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304315.157845:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785579264:12345-0@lo:400:kworker.0 Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304315.157852:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00080000:3.0:1789304315.157871:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304315.157901:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785579264:0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160233:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785578880:0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160314:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304315.160358:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785579392:0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160381:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304315.160405:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789304315.160410:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785579008:0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160427:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304315.160441:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785579520:0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160458:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304315.160485:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785579136 00000100:00100000:2.0:1789304315.160492:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785579136 00000100:00100000:2.0:1789304315.160535:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785579520 00000100:00100000:2.0:1789304315.160537:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785579520 00000100:00100000:2.0:1789304315.160556:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1789304315.160564:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785579136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160610:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785579136:12345-0@lo:400:kworker.0 Request processed in 47us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304315.160617:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1789304315.160633:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1789304315.160638:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785579520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160661:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785579520:12345-0@lo:400:kworker.0 Request processed in 24us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304315.160666:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1789304315.160683:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785579392 00000100:00100000:2.0:1789304315.160687:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785579392 00000100:00100000:2.0:1789304315.160710:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785579008 00000100:00100000:2.0:1789304315.160712:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785579008 00000100:00100000:2.0:1789304315.160726:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:2.0:1789304315.160731:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785579392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160757:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785579392:12345-0@lo:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304315.160762:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:2.0:1789304315.160772:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:2.0:1789304315.160777:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785579008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160799:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785579008:12345-0@lo:400:kworker.0 Request processed in 22us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304315.160804:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:2.0:1789304315.160819:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785578880 00000100:00100000:2.0:1789304315.160822:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785578880 00000100:00100000:2.0:1789304315.160843:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1789304315.160848:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785578880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160872:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785578880:12345-0@lo:400:kworker.0 Request processed in 24us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304315.160877:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00080000:2.0:1789304315.160910:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304315.160914:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304315.160916:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304315.160946:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785579008:0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160958:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785579520:0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160964:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785578880:0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.160974:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785579392:0@lo:400:kworker.0 00000100:00100000:2.0:1789304315.161016:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785579136:0@lo:400:kworker.0 00010000:00010000:1.0:1789304315.218345:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304315.728202:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00010000:00010000:2.0:1789304316.242458:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304317.268531:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304317.715540:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304317.715589:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785579648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304317.715658:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304317.717059:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785579648 00000100:00100000:0.0:1789304317.717070:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785579648 00000100:00100000:0.0:1789304317.717163:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1789304317.717174:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785579648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304317.717224:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304317.717303:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785579648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304317.717311:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1789304317.717620:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:1.0:1789304317.717626:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c36e85880, transno 4294967337 00000100:00100000:1.0:1789304317.717651:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785579648:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304317.717845:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304317.809085:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304317.809177:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304317.809289:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765486592 00000100:00100000:2.0:1789304317.809300:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765486592 00000100:00100000:2.0:1789304317.809393:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1237 00000100:00100000:2.0:1789304317.809407:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765486592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304317.809497:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765486592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 94us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304317.809504:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1237 00000100:00080000:1.0:1789304317.809859:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304317.810035:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304317.810184:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765486720 00000100:00100000:2.0:1789304317.810189:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765486720 00000100:00100000:2.0:1789304317.810237:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 903 00000100:00100000:2.0:1789304317.810245:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765486720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304317.810288:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765486720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 44us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304317.810295:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 903 00000100:00080000:1.0:1789304317.810392:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304317.816038:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765486464 00000100:00100000:0.0:1789304317.816053:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765486464 00000100:00100000:0.0:1789304317.816142:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1046 00000100:00100000:0.0:1789304317.816154:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765486464:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304317.816795:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765486464:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 642us (7615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304317.816805:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1046 00000100:00100000:3.0:1789304317.820478:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304317.820818:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765486848 00000100:00100000:1.0:1789304317.820830:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765486848 00000100:00100000:1.0:1789304317.820911:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 904 00000100:00100000:1.0:1789304317.820922:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765486848:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304317.821020:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765486848:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304317.821029:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 904 00000100:00080000:2.0:1789304317.821571:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789304318.290361:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304318.738291:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304318.738317:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785579776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304318.738559:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304318.738663:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785579776 00000100:00100000:1.0:1789304318.738672:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785579776 00000100:00100000:1.0:1789304318.738737:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1789304318.738746:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785579776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304318.738795:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304318.738847:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785579776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304318.738854:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1789304318.738903:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785579776:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304318.741119:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304319.320642:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304320.274583:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785579904:0@lo:400:kworker.0 00000100:00100000:2.0:1789304320.274805:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304320.274932:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785579904 00000100:00100000:3.0:1789304320.274942:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785579904 00000100:00100000:3.0:1789304320.275011:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1789304320.275022:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785579904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304320.275219:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785580032:0@lo:400:kworker.0 00000100:00100000:0.0:1789304320.275281:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304320.275332:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785580032 00000100:00100000:0.0:1789304320.275337:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785580032 00000100:00100000:0.0:1789304320.275366:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1789304320.275372:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785580032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304320.275410:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785580032:12345-0@lo:400:kworker.0 Request processed in 37us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304320.275417:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:0.0:1789304320.275461:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785580032:0@lo:400:kworker.0 00000100:00100000:3.0:1789304320.276054:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785579904:12345-0@lo:400:kworker.0 Request processed in 1034us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304320.276054:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785579904:0@lo:400:kworker.0 00000100:00100000:3.0:1789304320.276066:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1789304320.276313:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785580544:0@lo:400:kworker.0 00000100:00100000:0.0:1789304320.276324:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785580288:0@lo:400:kworker.0 00000100:00100000:1.0:1789304320.276355:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304320.276362:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304320.276380:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304320.276389:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785580416:0@lo:400:kworker.0 00000100:00100000:0.0:1789304320.276390:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304320.276400:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785580160:0@lo:400:kworker.0 00000100:00100000:1.0:1789304320.276418:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304320.276437:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304320.276462:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785580288 00000100:00100000:1.0:1789304320.276468:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785580288 00000100:00100000:1.0:1789304320.276515:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785580416 00000100:00100000:1.0:1789304320.276518:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785580416 00000100:00100000:1.0:1789304320.276541:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1789304320.276547:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785580288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304320.276585:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785580288:12345-0@lo:400:kworker.0 Request processed in 37us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304320.276592:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1789304320.276610:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1789304320.276617:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785580416:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789304320.276622:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304320.276648:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785580288:0@lo:400:kworker.0 00000100:00100000:1.0:1789304320.276658:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785580416:12345-0@lo:400:kworker.0 Request processed in 40us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304320.276669:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1789304320.276701:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785580416:0@lo:400:kworker.0 00000100:00100000:3.0:1789304320.276804:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785580544 00000100:00100000:3.0:1789304320.276809:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785580544 00000100:00100000:2.0:1789304320.276844:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785580160 00000100:00100000:2.0:1789304320.276848:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785580160 00000100:00100000:3.0:1789304320.276908:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1789304320.276919:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1789304320.276922:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785580544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304320.276933:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785580160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304320.277109:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785580544:12345-0@lo:400:kworker.0 Request processed in 190us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304320.277122:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1789304320.277127:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785580160:12345-0@lo:400:kworker.0 Request processed in 197us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304320.277134:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1789304320.277161:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785580160:0@lo:400:kworker.0 00000100:00080000:0.0:1789304320.277256:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304320.277259:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304320.279210:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785580544:0@lo:400:kworker.0 00010000:00010000:0.0:1789304320.338330:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304321.371278:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304322.386427:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304322.834315:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304322.834335:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785580672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304322.834397:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304322.834458:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785580672 00000100:00100000:2.0:1789304322.834468:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785580672 00000100:00100000:2.0:1789304322.834542:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:2.0:1789304322.834554:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785580672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304322.834589:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304322.834635:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785580672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304322.834639:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1789304322.834697:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785580672:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304322.834811:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304322.914797:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304322.915079:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304322.916420:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304322.916467:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304322.916526:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765486976 00000100:00100000:3.0:1789304322.916539:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765486976 00000100:00100000:3.0:1789304322.916597:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1048 00000100:00100000:3.0:1789304322.916609:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765486976:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304322.916687:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765486976:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304322.916695:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1048 00000100:00100000:0.0:1789304322.918658:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765487104 00000100:00100000:0.0:1789304322.918676:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765487104 00000100:00100000:0.0:1789304322.918761:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1241 00000100:00100000:0.0:1789304322.918773:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765487104:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304322.918855:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765487104:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 85us (4073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304322.918867:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1241 00000100:00080000:3.0:1789304322.920271:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304322.920681:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765487360 00000100:00100000:1.0:1789304322.920692:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765487360 00000100:00100000:1.0:1789304322.920752:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765487232 00000100:00100000:1.0:1789304322.920756:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765487232 00000100:00100000:1.0:1789304322.920785:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 907 00000100:00100000:2.0:1789304322.920799:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 908 00000100:00080000:0.0:1789304322.920820:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304322.920825:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304322.920872:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765487232:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304322.920920:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765487360:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304322.921021:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765487360:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 227us (5942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304322.921028:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 907 00000100:00100000:2.0:1789304322.921056:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765487232:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 245us (4586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304322.921066:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 908 00010000:00010000:0.0:1789304323.410949:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304323.858752:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785580800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304323.858847:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304323.858913:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785580800 00000100:00100000:2.0:1789304323.858923:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785580800 00000100:00080000:1.0:1789304323.858961:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304323.858984:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1789304323.858993:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785580800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304323.859029:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304323.859119:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785580800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304323.859126:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:1.0:1789304323.859240:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785580800:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304324.434443:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304325.394466:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785580928:0@lo:400:kworker.0 00000100:00100000:1.0:1789304325.394520:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785581312:0@lo:400:kworker.0 00000100:00100000:3.0:1789304325.394551:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304325.394553:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304325.394635:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785581184:0@lo:400:kworker.0 00000100:00100000:2.0:1789304325.394691:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785581056:0@lo:400:kworker.0 00000100:00100000:3.0:1789304325.398158:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785581440:0@lo:400:kworker.0 00000100:00100000:3.0:1789304325.398432:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304325.398630:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785580928 00000100:00100000:3.0:1789304325.398638:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785580928 00000100:00100000:3.0:1789304325.398689:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1789304325.398698:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785580928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304325.398757:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785580928:12345-0@lo:400:kworker.0 Request processed in 61us (4206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304325.398765:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1789304325.398801:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785581312 00000100:00100000:3.0:1789304325.398805:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785581312 00000100:00100000:3.0:1789304325.398864:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785581440 00000100:00100000:3.0:1789304325.398868:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785581440 00000100:00100000:3.0:1789304325.398901:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1789304325.398907:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785581312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304325.398942:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785581312:12345-0@lo:400:kworker.0 Request processed in 36us (4388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304325.398947:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1789304325.398973:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1789304325.398980:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785581440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304325.399010:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785581440:12345-0@lo:400:kworker.0 Request processed in 31us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304325.399016:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1789304325.399074:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785581440:0@lo:400:kworker.0 00000100:00100000:3.0:1789304325.399086:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785580928:0@lo:400:kworker.0 00000100:00080000:3.0:1789304325.399159:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304325.400371:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785581312:0@lo:400:kworker.0 00000100:00100000:0.0:1789304325.402182:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304325.403182:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785581184 00000100:00100000:1.0:1789304325.403204:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785581184 00000100:00100000:1.0:1789304325.403299:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:1.0:1789304325.403310:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785581184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304325.403391:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785581184:12345-0@lo:400:kworker.0 Request processed in 84us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304325.403399:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1789304325.403651:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785581184:0@lo:400:kworker.0 00000100:00080000:3.0:1789304325.404360:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304325.407546:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304325.407630:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785581568:0@lo:400:kworker.0 00000100:00100000:2.0:1789304325.407681:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304325.407884:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785581568 00000100:00100000:3.0:1789304325.407893:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785581568 00000100:00100000:3.0:1789304325.407975:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1789304325.407985:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785581568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304325.408057:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785581568:12345-0@lo:400:kworker.0 Request processed in 64us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304325.408066:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00080000:1.0:1789304325.408372:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304325.408519:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785581568:0@lo:400:kworker.0 00000100:00100000:0.0:1789304325.408619:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785581056 00000100:00100000:0.0:1789304325.408624:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785581056 00000100:00100000:0.0:1789304325.408667:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1789304325.408674:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785581056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304325.408727:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785581056:12345-0@lo:400:kworker.0 Request processed in 54us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304325.408734:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1789304325.410422:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785581056:0@lo:400:kworker.0 00010000:00010000:1.0:1789304325.460875:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304326.482346:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304327.506877:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304327.954479:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785581696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304327.954572:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304327.954788:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785581696 00000100:00100000:2.0:1789304327.954798:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785581696 00000100:00100000:2.0:1789304327.954881:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1789304327.954891:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785581696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304327.954927:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789304327.954994:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304327.961612:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785581696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6712us (7029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304327.961628:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1789304327.962772:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785581696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304328.037444:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304328.037538:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304328.037572:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304328.037606:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304328.037640:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765487616 00000100:00100000:0.0:1789304328.037648:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765487616 00000100:00100000:0.0:1789304328.037712:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1245 00000100:00100000:0.0:1789304328.037721:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765487616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304328.037797:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765487616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304328.037808:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1245 00000100:00100000:0.0:1789304328.037832:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765487744 00000100:00100000:0.0:1789304328.037836:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765487744 00000100:00100000:3.0:1789304328.037988:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765487488 00000100:00100000:3.0:1789304328.037993:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765487488 00000100:00100000:3.0:1789304328.038030:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1050 00000100:00100000:3.0:1789304328.038037:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765487488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304328.038066:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765487488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304328.038073:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1050 00000100:00080000:3.0:1789304328.038160:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304328.038165:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304328.040165:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765487872 00000100:00100000:0.0:1789304328.040186:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765487872 00000100:00100000:2.0:1789304328.040327:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 911 00000100:00100000:2.0:1789304328.040339:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765487744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304328.040408:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765487744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (2869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304328.040415:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 911 00000100:00100000:0.0:1789304328.042164:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 912 00000100:00100000:0.0:1789304328.042191:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765487872:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304328.042257:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765487872:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (4649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304328.042264:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 912 00000100:00080000:0.0:1789304328.042290:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789304328.534120:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304328.979018:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304328.979043:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785581824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304328.979136:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304328.979347:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785581824 00000100:00100000:3.0:1789304328.979355:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785581824 00000100:00080000:0.0:1789304328.979497:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304328.980538:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1789304328.980553:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785581824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304328.980589:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304328.980664:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785581824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304328.980671:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:2.0:1789304328.980751:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785581824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304329.558011:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304329.792355:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304329.792448:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765488000 00000100:00100000:2.0:1789304329.792458:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765488000 00000100:00100000:2.0:1789304329.792512:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 661 00000100:00100000:2.0:1789304329.792522:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:43864:x1876219765488000:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304329.792609:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:43864:x1876219765488000:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 89us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304329.792616:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 661 00000100:00100000:1.0:1789304329.805536:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304329.805579:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765488128 00000100:00100000:1.0:1789304329.805589:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765488128 00000100:00100000:1.0:1789304329.805645:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 357 00000100:00100000:1.0:1789304329.805656:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:43864:x1876219765488128:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304329.823769:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:43864:x1876219765488128:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 18105us (18231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304329.823783:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 357 00000100:00100000:0.0:1789304329.842254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304329.842386:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765488256 00000100:00100000:1.0:1789304329.842398:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765488256 00000100:00100000:1.0:1789304329.842459:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 358 00000100:00100000:1.0:1789304329.842470:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:43864:x1876219765488256:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304329.842831:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:43864:x1876219765488256:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 362us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304329.842840:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 358 00000100:00100000:0.0:1789304329.849119:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304329.849209:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765488384 00000100:00100000:1.0:1789304329.849220:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765488384 00000100:00100000:1.0:1789304329.849274:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 662 00000100:00100000:1.0:1789304329.849285:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:43864:x1876219765488384:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304329.849688:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:43864:x1876219765488384:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 405us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304329.849695:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 662 00000100:00100000:0.0:1789304329.874656:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304329.874691:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765488512 00000100:00100000:0.0:1789304329.874701:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765488512 00000100:00100000:0.0:1789304329.874756:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 663 00000100:00100000:0.0:1789304329.874768:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:43864:x1876219765488512:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304329.874860:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:43864:x1876219765488512:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304329.874867:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 663 00000100:00100000:1.0:1789304329.880328:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304329.880454:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765488640 00000100:00100000:0.0:1789304329.880465:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765488640 00000100:00100000:0.0:1789304329.880521:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 359 00000100:00100000:0.0:1789304329.880531:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:43864:x1876219765488640:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304329.880881:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:43864:x1876219765488640:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 350us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304329.880890:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 359 00000100:00100000:0.0:1789304329.899941:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304329.900000:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765488768 00000100:00100000:0.0:1789304329.900010:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765488768 00000100:00100000:0.0:1789304329.900063:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 360 00000100:00100000:0.0:1789304329.900073:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:43864:x1876219765488768:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304329.900507:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:43864:x1876219765488768:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 434us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304329.900516:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 360 00000100:00100000:0.0:1789304329.923336:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304329.923546:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765488896 00000100:00100000:2.0:1789304329.923557:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765488896 00000100:00100000:2.0:1789304329.923629:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 664 00000100:00100000:2.0:1789304329.923641:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:43864:x1876219765488896:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304329.924123:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:43864:x1876219765488896:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 484us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304329.924132:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 664 00000100:00100000:2.0:1789304330.028207:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304330.028327:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765489024 00000100:00100000:1.0:1789304330.028338:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765489024 00000100:00080000:2.0:1789304330.028394:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304330.028418:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 665 00000100:00100000:1.0:1789304330.028429:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:43865:x1876219765489024:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304330.028448:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304330.028468:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129597e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610024c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304330.028591:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295985 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304330.028607:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304330.028619:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304330.028655:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789304330.028659:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304330.028678:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295985 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304330.028705:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb723129597e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610024c expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304330.028729:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295985 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610024c expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304330.028738:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:1.0:1789304330.028742:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304330.028745:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8fe00, rc 0) 00000100:00100000:1.0:1789304330.028808:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:43865:x1876219765489024:12345-192.168.202.29@tcp:101:rm.0 Request processed in 381us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304330.028815:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 665 00000100:00100000:0.0:1789304330.060576:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304330.063384:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765489280 00000100:00100000:3.0:1789304330.063400:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765489280 00000100:00100000:2.0:1789304330.064886:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 666 00000100:00100000:2.0:1789304330.064899:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:43865:x1876219765489280:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304330.064920:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304330.064942:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129598c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100253 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304330.065031:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00010000:2.0:1789304330.065291:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129598c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100253 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.065312:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304330.065316:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789304330.065321:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129598c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100253 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.065337:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd400, rc 0) 00000100:00100000:2.0:1789304330.065412:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:43865:x1876219765489280:12345-192.168.202.29@tcp:101:rm.0 Request processed in 515us (4847us total) trans 4294967549 rc 301/301 00000100:00100000:2.0:1789304330.065419:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 666 00000100:00100000:2.0:1789304330.078187:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304330.078323:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765489408 00000100:00100000:3.0:1789304330.078334:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765489408 00000100:00100000:3.0:1789304330.078395:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 70 00000100:00100000:3.0:1789304330.078407:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:43865:x1876219765489408:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:0.0:1789304330.091740:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:43865:x1876219765489408:12345-192.168.202.29@tcp:37:rm.0 Request processed in 13327us (13564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304330.091753:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 70 00000100:00100000:0.0:1789304330.097362:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304330.097402:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765489664 00000100:00100000:0.0:1789304330.097412:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765489664 00000100:00100000:0.0:1789304330.097462:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 71 00000100:00100000:0.0:1789304330.097473:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:43865:x1876219765489664:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:0.0:1789304330.097781:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:43865:x1876219765489664:12345-192.168.202.29@tcp:35:rm.0 Request processed in 309us (429us total) trans 4294967550 rc 0/0 00000100:00100000:0.0:1789304330.097789:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 71 00000100:00100000:2.0:1789304330.105436:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304330.105470:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765489920 00000100:00100000:2.0:1789304330.105480:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765489920 00000100:00100000:2.0:1789304330.105535:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 667 00000100:00100000:2.0:1789304330.105545:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:43865:x1876219765489920:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304330.105603:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789304330.105651:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295985 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610024c expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.105673:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb723129592a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100237 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.105684:0:5852:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231295580) 00010000:00010000:2.0:1789304330.105689:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:2.0:1789304330.105700:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304330.105726:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129599a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.105740:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129599a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.105753:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129599a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.105818:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312959a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.105827:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312959a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.105835:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312959a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106197:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312959a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106207:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312959a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106214:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312959a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106248:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312959a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106255:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312959a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106262:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312959a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106268:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304330.106272:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312959a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106279:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312959a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106288:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304330.106291:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304330.106294:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312959a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106300:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312959a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106316:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129599a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106323:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129599a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106328:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129599a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106333:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304330.106335:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129599a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106341:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129599a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106353:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304330.106355:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304330.106358:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129599a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106364:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb723129599a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106374:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312959a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106380:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312959a1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106386:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312959a1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106391:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304330.106394:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312959a1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106399:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312959a1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106405:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9e2c421d2000) 00010000:00010000:2.0:1789304330.106407:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304330.106409:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312959a1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304330.106414:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312959a1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304330.106497:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:43865:x1876219765489920:12345-192.168.202.29@tcp:36:rm.0 Request processed in 952us (1070us total) trans 0 rc -13/-13 00000100:00100000:2.0:1789304330.106504:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 667 00000100:00100000:1.0:1789304330.514312:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785582208:0@lo:400:kworker.0 00000100:00100000:1.0:1789304330.514381:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304330.514432:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304330.514439:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785582336:0@lo:400:kworker.0 00000100:00100000:1.0:1789304330.514464:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304330.514497:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785582336 00000100:00100000:1.0:1789304330.514505:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785582336 00000100:00100000:1.0:1789304330.514560:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1789304330.514569:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785582336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304330.514620:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785582336:12345-0@lo:400:kworker.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304330.514628:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00080000:1.0:1789304330.514662:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304330.514689:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785582336:0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.514884:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785582080:0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.514913:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304330.514940:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785582592:0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.514964:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304330.514983:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789304330.514989:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785581952:0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515016:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304330.515039:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785582464:0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515060:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304330.515118:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785582208 00000100:00100000:0.0:1789304330.515123:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785582208 00000100:00100000:0.0:1789304330.515165:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785582592 00000100:00100000:0.0:1789304330.515169:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785582592 00000100:00100000:0.0:1789304330.515204:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1789304330.515212:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785582208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515250:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785582208:12345-0@lo:400:kworker.0 Request processed in 39us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304330.515257:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1789304330.515271:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:0.0:1789304330.515277:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785582592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515306:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785582592:12345-0@lo:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304330.515311:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:0.0:1789304330.515495:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785582080 00000100:00100000:0.0:1789304330.515499:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785582080 00000100:00100000:0.0:1789304330.515520:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785582464 00000100:00100000:0.0:1789304330.515524:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785582464 00000100:00100000:0.0:1789304330.515545:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1789304330.515552:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785582080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515584:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785582080:12345-0@lo:400:kworker.0 Request processed in 32us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304330.515590:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1789304330.515602:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1789304330.515608:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785582464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515647:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785582464:12345-0@lo:400:kworker.0 Request processed in 27us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304330.515654:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1789304330.515676:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785581952 00000100:00100000:0.0:1789304330.515680:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785581952 00000100:00100000:0.0:1789304330.515704:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1789304330.515711:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785581952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515737:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785581952:12345-0@lo:400:kworker.0 Request processed in 27us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304330.515743:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00080000:0.0:1789304330.515780:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304330.515783:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304330.515785:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304330.515803:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785581952:0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515813:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785582464:0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515821:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785582080:0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515828:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785582592:0@lo:400:kworker.0 00000100:00100000:0.0:1789304330.515858:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785582208:0@lo:400:kworker.0 00010000:00010000:2.0:1789304330.591474:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304331.602379:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304332.022937:0:75585:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcab43fc80 20000000:00000080:3.0:1789304332.022951:0:75585:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c2e90bc00 uarg=0000000000000000 00010000:00010000:2.0:1789304332.027676:0:75585:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304332.027701:0:75585:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304332.027770:0:75585:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304332.027793:0:75585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304332.027813:0:75585:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231295907 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295900 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304332.027821:0:75585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304332.027869:0:75585:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231295907 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295900 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304332.027888:0:75585:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231295907 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295900 expref: 18 pid: 5847 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304332.027903:0:75585:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75585:1876219785582720:0@lo:104: 00000100:00100000:2.0:1789304332.027992:0:75585:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304332.028046:0:75585:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38671180 going to sleep for 11 seconds 00000100:00100000:0.0:1789304332.028633:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785582720 00000100:00100000:0.0:1789304332.028641:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785582720 00000100:00100000:0.0:1789304332.028696:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789304332.028708:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:75585:x1876219785582720:12345-0@lo:104: 00010000:00010000:0.0:1789304332.028722:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304332.028810:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304332.028817:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:75585:x1876219785582720:12345-0@lo:104: Request processed in 112us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304332.028823:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:1.0:1789304332.028955:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304332.028963:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.028971:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304332.028977:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.028985:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304332.028993:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304332.028999:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304332.029038:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.029044:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789304332.029314:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785582848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304332.029362:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789304332.029433:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.029442:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231295900 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295907 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.029457:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304332.029460:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304332.029461:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304332.029488:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785582848 00000100:00100000:1.0:1789304332.029493:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785582848 00010000:00010000:1.0:1789304332.029517:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231295907 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295900 expref: 19 pid: 5847 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304332.029856:0:75585:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75585:1876219785582720:0@lo:104: 00010000:00010000:2.0:1789304332.029879:0:75585:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304332.029990:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789304332.030001:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0386a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785582848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304332.030014:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304332.030019:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231295907 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295900 expref: 19 pid: 5847 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030030:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231295907 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295900 expref: 19 pid: 5847 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030045:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231295907 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295900 expref: 19 pid: 5847 timeout: 1931 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030058:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030068:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030082:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030122:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030129:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030163:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030174:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304332.030186:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030254:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030269:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304332.030280:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304332.030331:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0386a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785582848:12345-0@lo:103:ldlm_bl.0 Request processed in 334us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304332.030339:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789304332.030434:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785582848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304332.031071:0:75585:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304332.031081:0:75585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304332.031087:0:75585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb72312959af lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304332.627463:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304332.800905:0:75633:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff99fbf480 20000000:00000080:3.0:1789304332.800925:0:75633:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854ec00 uarg=0000000000000000 00010000:00010000:3.0:1789304332.801228:0:75633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789304332.801245:0:75633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789304332.801270:0:75633:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304332.801291:0:75633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304332.801307:0:75633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304332.801318:0:75633:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304332.801329:0:75633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304332.801335:0:75633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304332.801342:0:75633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304332.801349:0:75633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304332.801353:0:75633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304332.801360:0:75633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304332.801373:0:75633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304332.801381:0:75633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304332.801388:0:75633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f800/0xefc0bb72312959b6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304333.074716:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785582976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304333.074790:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304333.075633:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785582976 00000100:00100000:2.0:1789304333.075643:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785582976 00000100:00100000:3.0:1789304333.075848:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1789304333.075860:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785582976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304333.075899:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304333.076192:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785582976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 335us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304333.076201:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00080000:0.0:1789304333.076650:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304333.076964:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785582976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304333.159660:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304333.159701:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304333.159738:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304333.159767:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304333.159794:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765490176 00000100:00100000:0.0:1789304333.159805:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765490176 00000100:00100000:0.0:1789304333.159869:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1249 00000100:00100000:0.0:1789304333.159880:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765490176:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304333.159959:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765490176:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304333.159966:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1249 00000100:00100000:0.0:1789304333.159991:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765490304 00000100:00100000:0.0:1789304333.159995:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765490304 00000100:00100000:0.0:1789304333.160019:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765490432 00000100:00100000:0.0:1789304333.160022:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765490432 00000100:00100000:0.0:1789304333.160043:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 915 00000100:00100000:0.0:1789304333.160050:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765490304:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304333.160076:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765490304:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304333.160082:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 915 00000100:00100000:0.0:1789304333.160120:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 916 00000100:00100000:0.0:1789304333.160136:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765490432:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304333.160161:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765490432:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304333.160166:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 916 00000100:00080000:0.0:1789304333.160601:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304333.160607:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304333.160609:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304333.160791:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765490048 00000100:00100000:3.0:1789304333.160797:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765490048 00000100:00100000:3.0:1789304333.160836:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1052 00000100:00100000:3.0:1789304333.160843:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765490048:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304333.160886:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765490048:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 44us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304333.160893:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1052 00000020:00000080:1.0:1789304333.509200:0:75681:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffebfff7790 20000000:00000080:1.0:1789304333.509218:0:75681:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c388d5c00 uarg=0000000000000000 00010000:00010000:0.0:1789304333.513276:0:75681:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304333.513302:0:75681:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304333.513328:0:75681:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304333.513355:0:75681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.513373:0:75681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.513384:0:75681:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.513391:0:75681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.513404:0:75681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.513412:0:75681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.513418:0:75681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304333.513422:0:75681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.513431:0:75681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.513448:0:75681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.513456:0:75681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.513462:0:75681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb200/0xefc0bb72312959bd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304333.650352:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304333.650364:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304333.650371:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304333.650498:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304333.650512:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304333.650523:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304333.650552:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785583104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304333.650648:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304333.650708:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752480 going to sleep for 11 seconds 00000100:00100000:0.0:1789304333.650880:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785583104 00000100:00100000:0.0:1789304333.650891:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785583104 00000100:00100000:0.0:1789304333.650956:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1789304333.650965:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785583104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304333.650979:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304333.650993:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312959cb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312959c4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.651024:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312959cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312959c4 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.651036:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312959cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312959c4 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304333.651056:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa800, rc 0) 00000100:00100000:0.0:1789304333.651142:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785583104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304333.651149:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00010000:00010000:2.0:1789304333.651587:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304333.651871:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785583104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304333.651892:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304333.651908:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304333.651929:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304333.651934:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304333.651941:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304334.103055:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304334.103087:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785583232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304334.103239:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304334.103307:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785583232 00000100:00100000:0.0:1789304334.103315:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785583232 00000100:00100000:0.0:1789304334.103372:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1789304334.103381:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785583232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304334.103421:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304334.103472:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785583232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304334.103479:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00080000:0.0:1789304334.103501:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304334.103834:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785583232:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789304334.238882:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967550 is committed 00010000:00010000:1.0:1789304334.678688:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304335.640264:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785583744:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.640346:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304335.640408:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789304335.640414:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785583360:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.640444:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304335.640467:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785583872:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.640489:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304335.640514:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785583616:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.640540:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304335.640558:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789304335.640563:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785583488:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.640583:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304335.640600:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785584000:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.640619:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304335.640657:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785583744 00000100:00100000:2.0:1789304335.640665:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785583744 00000100:00100000:2.0:1789304335.640721:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785583872 00000100:00100000:2.0:1789304335.640724:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785583872 00000100:00100000:2.0:1789304335.640742:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785583488 00000100:00100000:2.0:1789304335.640745:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785583488 00000100:00100000:2.0:1789304335.640760:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1789304335.640768:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785583744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.640823:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785583744:12345-0@lo:400:kworker.0 Request processed in 55us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304335.640830:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1789304335.640847:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1789304335.640853:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785583872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.640879:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785583872:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304335.640885:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1789304335.640895:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1789304335.640901:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785583488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.640925:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785583488:12345-0@lo:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304335.640930:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1789304335.640949:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785583360 00000100:00100000:2.0:1789304335.640952:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785583360 00000100:00100000:2.0:1789304335.640975:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1789304335.640981:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785583360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.641011:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785583360:12345-0@lo:400:kworker.0 Request processed in 31us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304335.641017:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1789304335.641045:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785583616 00000100:00100000:2.0:1789304335.641049:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785583616 00000100:00100000:2.0:1789304335.641071:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785584000 00000100:00100000:2.0:1789304335.641074:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785584000 00000100:00100000:2.0:1789304335.641130:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1789304335.641137:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785583616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.641167:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785583616:12345-0@lo:400:kworker.0 Request processed in 31us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304335.641172:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1789304335.641184:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1789304335.641190:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785584000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.641215:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785584000:12345-0@lo:400:kworker.0 Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304335.641221:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00080000:2.0:1789304335.641241:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304335.641246:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304335.641288:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785583488:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.641298:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785584000:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.641306:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785583616:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.641339:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785583360:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.641348:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785583872:0@lo:400:kworker.0 00000100:00100000:2.0:1789304335.641358:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785583744:0@lo:400:kworker.0 00010000:00010000:1.0:1789304335.700740:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304336.722671:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304337.419458:0:75878:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea37445e0 20000000:00000080:0.0:1789304337.419474:0:75878:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b0208e000 uarg=0000000000000000 00010000:00010000:0.0:1789304337.419914:0:75878:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304337.419924:0:75878:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304337.419937:0:75878:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304337.419953:0:75878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304337.419966:0:75878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312959cb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312959c4 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304337.419971:0:75878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304337.420002:0:75878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312959cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312959c4 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304337.420013:0:75878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312959cb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312959c4 expref: 18 pid: 5846 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304337.420024:0:75878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75878:1876219785584128:0@lo:104: 00000100:00100000:0.0:1789304337.420164:0:75878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304337.420247:0:75878:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b04091a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789304337.420290:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785584128 00000100:00100000:3.0:1789304337.420299:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785584128 00000100:00100000:3.0:1789304337.420342:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789304337.420352:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:75878:x1876219785584128:12345-0@lo:104: 00010000:00010000:3.0:1789304337.420365:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304337.420427:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304337.420434:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:75878:x1876219785584128:12345-0@lo:104: Request processed in 83us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304337.420441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789304337.420447:0:75878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75878:1876219785584128:0@lo:104: 00010000:00010000:0.0:1789304337.420463:0:75878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420505:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304337.420512:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420518:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304337.420520:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420530:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304337.420535:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304337.420538:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304337.420599:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420603:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304337.420626:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420631:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb72312959c4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312959cb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420643:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304337.420644:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304337.420645:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304337.420650:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304337.420659:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785584256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304337.420693:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304337.420716:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785584256 00000100:00100000:1.0:1789304337.420719:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785584256 00010000:00010000:1.0:1789304337.420733:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312959cb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312959c4 expref: 19 pid: 5846 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304337.420755:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789304337.420763:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785584256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304337.420774:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304337.420779:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312959cb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312959c4 expref: 19 pid: 5846 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420790:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312959cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312959c4 expref: 19 pid: 5846 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420802:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312959cb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312959c4 expref: 19 pid: 5846 timeout: 1937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420813:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420821:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420835:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420843:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420850:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420854:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420858:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304337.420861:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420867:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420876:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.420881:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304337.420902:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785584256:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304337.420907:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789304337.420927:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785584256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304337.421176:0:75878:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304337.421182:0:75878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304337.421186:0:75878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afba00/0xefc0bb72312959d2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304337.746798:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304338.200424:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304338.200458:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785584384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304338.200544:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304338.201941:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785584384 00000100:00100000:2.0:1789304338.201953:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785584384 00000100:00100000:2.0:1789304338.202039:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1789304338.202050:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785584384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304338.202110:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304338.202190:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785584384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304338.202198:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1789304338.203268:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785584384:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304338.203543:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304338.292227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304338.292261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304338.292287:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304338.292318:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304338.292348:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765490560 00000100:00100000:0.0:1789304338.292360:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765490560 00000100:00100000:0.0:1789304338.292419:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1055 00000100:00100000:0.0:1789304338.292431:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765490560:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304338.292513:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765490560:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304338.292522:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1055 00000100:00100000:1.0:1789304338.293513:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765490688 00000100:00100000:1.0:1789304338.293524:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765490688 00000100:00100000:1.0:1789304338.293589:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1253 00000100:00100000:1.0:1789304338.293598:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765490688:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304338.293641:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765490688:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304338.293647:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1253 00000100:00100000:2.0:1789304338.293944:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765490944 00000100:00100000:2.0:1789304338.293949:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765490944 00000100:00100000:2.0:1789304338.293985:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765490816 00000100:00100000:2.0:1789304338.293988:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765490816 00000100:00100000:2.0:1789304338.294012:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 919 00000100:00100000:2.0:1789304338.294021:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765490944:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304338.294050:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765490944:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304338.294056:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 919 00000100:00100000:2.0:1789304338.294070:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 920 00000100:00100000:2.0:1789304338.294087:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765490816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304338.294229:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765490816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 152us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304338.294237:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 920 00000100:00080000:0.0:1789304338.296413:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304338.296421:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304338.296425:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304338.772027:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304338.837194:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304338.837201:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304338.837206:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304338.837466:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304338.837480:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304338.837493:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304338.837523:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785584512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304338.837605:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304338.837701:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388c8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789304338.842466:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785584512 00000100:00100000:2.0:1789304338.842485:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785584512 00000100:00100000:2.0:1789304338.842621:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1789304338.842635:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785584512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304338.842659:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304338.842687:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312959e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312959d9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304338.842726:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312959e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312959d9 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304338.842740:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312959e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312959d9 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304338.842763:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc600, rc 0) 00000100:00100000:2.0:1789304338.842861:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785584512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (5255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304338.842868:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1789304338.843087:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785584512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304338.843147:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304338.843158:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304338.843183:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304338.843190:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304338.843198:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304339.219415:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304339.219442:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785584640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304339.219515:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304339.219590:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785584640 00000100:00100000:1.0:1789304339.219599:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785584640 00000100:00100000:1.0:1789304339.219657:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1789304339.219666:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785584640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304339.219705:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304339.219749:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785584640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304339.219756:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00080000:1.0:1789304339.219777:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304339.220073:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785584640:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304339.799538:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304340.755782:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785584768:0@lo:400:kworker.0 00000100:00100000:1.0:1789304340.755861:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304340.755973:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785584768 00000100:00100000:2.0:1789304340.755983:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785584768 00000100:00100000:2.0:1789304340.756037:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1789304340.756049:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785584768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304340.756962:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785584896:0@lo:400:kworker.0 00000100:00100000:3.0:1789304340.757015:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304340.757084:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785584896 00000100:00100000:3.0:1789304340.757122:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785584896 00000100:00100000:3.0:1789304340.757167:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1789304340.757175:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785584896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304340.757226:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785584896:12345-0@lo:400:kworker.0 Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304340.757233:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1789304340.757289:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785584896:0@lo:400:kworker.0 00000100:00100000:2.0:1789304340.757600:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785584768:12345-0@lo:400:kworker.0 Request processed in 1551us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304340.757608:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1789304340.758029:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785585408:0@lo:400:kworker.0 00000100:00100000:0.0:1789304340.758087:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304340.758197:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304340.758203:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785585280:0@lo:400:kworker.0 00000100:00100000:0.0:1789304340.758230:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304340.758258:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785585408 00000100:00100000:0.0:1789304340.758263:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785585408 00000100:00100000:0.0:1789304340.758503:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1789304340.758515:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785585408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304340.758560:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785585408:12345-0@lo:400:kworker.0 Request processed in 48us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304340.758570:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1789304340.758590:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785585280 00000100:00100000:0.0:1789304340.758594:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785585280 00000100:00100000:3.0:1789304340.758812:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785585152:0@lo:400:kworker.0 00000100:00100000:3.0:1789304340.758857:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304340.758879:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304340.758885:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785585024:0@lo:400:kworker.0 00000100:00100000:3.0:1789304340.758906:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304340.758948:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785585152 00000100:00100000:3.0:1789304340.758952:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785585152 00000100:00100000:0.0:1789304340.759204:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1789304340.759213:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785585280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304340.759248:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785585280:12345-0@lo:400:kworker.0 Request processed in 38us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304340.759254:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1789304340.759527:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785585024 00000100:00100000:2.0:1789304340.759533:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785585024 00000100:00100000:2.0:1789304340.759563:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1789304340.759569:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785585024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304340.759624:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785585024:12345-0@lo:400:kworker.0 Request processed in 54us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304340.759629:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1789304340.759681:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785585024:0@lo:400:kworker.0 00000100:00080000:2.0:1789304340.759721:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304340.759736:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304340.761822:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1789304340.762029:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785585280:0@lo:400:kworker.0 00000100:00100000:2.0:1789304340.762046:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785585408:0@lo:400:kworker.0 00000100:00100000:3.0:1789304340.762310:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785585152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304340.762418:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785585152:12345-0@lo:400:kworker.0 Request processed in 585us (3560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304340.762426:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1789304340.762466:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785585152:0@lo:400:kworker.0 00000100:00100000:1.0:1789304340.763793:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785584768:0@lo:400:kworker.0 00010000:00010000:1.0:1789304340.818362:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304341.843121:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304342.866542:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304343.314307:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785585536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304343.314392:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304343.314577:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785585536 00000100:00100000:2.0:1789304343.314587:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785585536 00000100:00100000:2.0:1789304343.314654:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:2.0:1789304343.314665:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785585536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304343.314700:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304343.314774:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785585536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304343.314782:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00080000:1.0:1789304343.314899:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304343.315199:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785585536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304343.410379:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304343.410416:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304343.410450:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304343.410484:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304343.410515:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765491200 00000100:00100000:2.0:1789304343.410524:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765491200 00000100:00100000:2.0:1789304343.410587:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1257 00000100:00100000:2.0:1789304343.410599:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765491200:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304343.410676:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765491200:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304343.410684:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1257 00000100:00100000:2.0:1789304343.410708:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765491328 00000100:00100000:2.0:1789304343.410712:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765491328 00000100:00100000:2.0:1789304343.410737:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765491456 00000100:00100000:2.0:1789304343.410740:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765491456 00000100:00100000:2.0:1789304343.410760:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 923 00000100:00100000:2.0:1789304343.410767:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765491328:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304343.410807:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765491328:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304343.410813:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 923 00000100:00100000:2.0:1789304343.410825:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 924 00000100:00100000:2.0:1789304343.410831:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765491456:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304343.410854:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765491456:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304343.410860:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 924 00000100:00080000:1.0:1789304343.411125:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304343.411130:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304343.411132:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304343.411350:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765491072 00000100:00100000:3.0:1789304343.411356:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765491072 00000100:00100000:3.0:1789304343.411399:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1058 00000100:00100000:3.0:1789304343.411407:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765491072:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304343.411446:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765491072:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304343.411456:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1058 00010000:00010000:1.0:1789304343.890399:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304344.338504:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785585664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304344.338579:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304344.339257:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785585664 00000100:00100000:0.0:1789304344.339267:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785585664 00000100:00100000:0.0:1789304344.339335:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1789304344.339345:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785585664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304344.339389:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304344.339458:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785585664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304344.340121:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1789304344.340185:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785585664:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304344.340353:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304344.919978:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304345.874409:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785586048:0@lo:400:kworker.0 00000100:00100000:3.0:1789304345.874428:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785586176:0@lo:400:kworker.0 00000100:00100000:2.0:1789304345.874546:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785585920:0@lo:400:kworker.0 00000100:00100000:1.0:1789304345.874744:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785585792:0@lo:400:kworker.0 00000100:00100000:0.0:1789304345.879732:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304345.882727:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785586048 00000100:00100000:2.0:1789304345.882745:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785586048 00000100:00100000:2.0:1789304345.882844:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1789304345.882855:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785586048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304345.883685:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785586048:12345-0@lo:400:kworker.0 Request processed in 828us (3957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304345.883694:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1789304345.883759:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304345.883776:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785586048:0@lo:400:kworker.0 00000100:00100000:2.0:1789304345.883793:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785585920 00000100:00100000:2.0:1789304345.883799:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785585920 00000100:00100000:2.0:1789304345.883843:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1789304345.883851:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785585920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304345.883887:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785585920:12345-0@lo:400:kworker.0 Request processed in 37us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304345.883893:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1789304345.883929:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785585920:0@lo:400:kworker.0 00000100:00100000:2.0:1789304345.883940:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785586432:0@lo:400:kworker.0 00000100:00100000:2.0:1789304345.883968:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304345.884023:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785586432 00000100:00100000:0.0:1789304345.884029:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785586432 00000100:00100000:0.0:1789304345.884073:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1789304345.884080:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785586432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304345.884135:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785586432:12345-0@lo:400:kworker.0 Request processed in 56us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304345.884142:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00080000:2.0:1789304345.885700:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304345.885758:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785586432:0@lo:400:kworker.0 00000100:00100000:3.0:1789304345.886618:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304345.886780:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785586176 00000100:00100000:0.0:1789304345.886791:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785586176 00000100:00100000:0.0:1789304345.886878:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1789304345.886897:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785586176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304345.886967:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785586176:12345-0@lo:400:kworker.0 Request processed in 81us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304345.886974:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1789304345.887027:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785586176:0@lo:400:kworker.0 00000100:00100000:1.0:1789304345.887538:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304345.887590:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785586304:0@lo:400:kworker.0 00000100:00100000:1.0:1789304345.887631:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304345.887648:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785585792 00000100:00100000:3.0:1789304345.887654:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785585792 00000100:00100000:3.0:1789304345.887684:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1789304345.887692:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785585792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304345.887751:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785585792:12345-0@lo:400:kworker.0 Request processed in 60us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304345.887757:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00080000:2.0:1789304345.888037:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304345.888116:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785586304 00000100:00100000:0.0:1789304345.888122:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785586304 00000100:00100000:0.0:1789304345.888163:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1789304345.888170:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785586304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304345.888206:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785586304:12345-0@lo:400:kworker.0 Request processed in 36us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304345.888212:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00080000:2.0:1789304345.888268:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304345.888344:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785585792:0@lo:400:kworker.0 00000100:00100000:1.0:1789304345.888356:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785586304:0@lo:400:kworker.0 00010000:00010000:3.0:1789304345.939115:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789304346.941066:0:76220:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 19: test nodemap trusted_admin fileops ========================================================== 08:59:05 (1789304345) 00010000:00010000:1.0:1789304346.966393:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304347.986394:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:3.0:1789304348.080740:0:76269:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:3.0:1789304348.092505:0:76269:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000100:00100000:0.0:1789304348.435357:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304348.435384:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785586560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304348.435464:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304348.435521:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785586560 00000100:00100000:0.0:1789304348.435528:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785586560 00000100:00100000:0.0:1789304348.435572:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1789304348.435579:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785586560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304348.435613:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304348.435647:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785586560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304348.435652:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00080000:0.0:1789304348.435671:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304348.435701:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785586560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304348.516957:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304348.517009:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304348.517083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304348.517138:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765491968 00000100:00100000:2.0:1789304348.517149:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765491968 00000100:00100000:2.0:1789304348.517210:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 927 00000100:00100000:2.0:1789304348.517221:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765491968:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304348.517291:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765491968:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 72us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304348.517298:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 927 00000100:00100000:2.0:1789304348.517322:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765491584 00000100:00100000:2.0:1789304348.517325:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765491584 00000100:00100000:2.0:1789304348.517350:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1060 00000100:00100000:2.0:1789304348.517356:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765491584:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304348.517380:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765491584:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304348.517386:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1060 00000100:00080000:2.0:1789304348.517409:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304348.517612:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765491712 00000100:00100000:1.0:1789304348.517617:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765491712 00000100:00100000:1.0:1789304348.517665:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1261 00000100:00100000:1.0:1789304348.517673:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765491712:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304348.517709:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765491712:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304348.517715:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1261 00000100:00080000:2.0:1789304348.518311:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304348.551209:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304348.551485:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765491840 00000100:00100000:1.0:1789304348.551496:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765491840 00000100:00100000:1.0:1789304348.551600:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 928 00000100:00100000:1.0:1789304348.551612:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765491840:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304348.551697:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765491840:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304348.551704:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 928 00000100:00080000:2.0:1789304348.552352:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304349.010363:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304349.216673:0:76317:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc26090d50 20000000:00000080:2.0:1789304349.216693:0:76317:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02f31800 uarg=0000000000000000 10000000:01000000:2.0:1789304349.218918:0:76317:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304349.218943:0:76317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304349.218961:0:76317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312959e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312959d9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304349.218970:0:76317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304349.219028:0:76317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312959e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312959d9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304349.219042:0:76317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312959e0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312959d9 expref: 18 pid: 5846 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304349.219056:0:76317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76317:1876219785586688:0@lo:104: 00000100:00100000:2.0:1789304349.219154:0:76317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304349.219201:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785586688 00000100:00100000:0.0:1789304349.219211:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785586688 00000100:00100000:0.0:1789304349.219269:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789304349.219276:0:76317:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b024b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789304349.219278:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:76317:x1876219785586688:12345-0@lo:104: 00010000:00010000:0.0:1789304349.219291:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304349.219355:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304349.219361:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:76317:x1876219785586688:12345-0@lo:104: Request processed in 85us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304349.219367:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789304349.219374:0:76317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76317:1876219785586688:0@lo:104: 00010000:00010000:2.0:1789304349.219391:0:76317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219574:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304349.219582:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219590:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304349.219594:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219606:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304349.219613:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304349.219619:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304349.219696:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219703:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304349.219737:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219754:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312959d9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312959e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219770:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304349.219772:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304349.219773:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304349.219782:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304349.219793:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785586816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304349.219826:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304349.219857:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785586816 00000100:00100000:1.0:1789304349.219861:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785586816 00010000:00010000:1.0:1789304349.219878:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312959e0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312959d9 expref: 19 pid: 5846 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304349.219900:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789304349.219907:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785586816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304349.219918:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304349.219923:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312959e0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312959d9 expref: 19 pid: 5846 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219932:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312959e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312959d9 expref: 19 pid: 5846 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219944:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312959e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312959d9 expref: 19 pid: 5846 timeout: 1948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219957:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219965:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219987:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.219995:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.220003:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.220009:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.220015:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304349.220019:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.220027:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.220035:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304349.220044:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304349.220073:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785586816:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304349.220080:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789304349.220135:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785586816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304349.221295:0:76317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304349.221303:0:76317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304349.221310:0:76317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecca00/0xefc0bb72312959e7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304349.460746:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785586944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304349.460887:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304349.460964:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785586944 00000100:00100000:2.0:1789304349.460987:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785586944 00000100:00100000:2.0:1789304349.461066:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1789304349.461085:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785586944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304349.461143:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304349.461188:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785586944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304349.461194:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00080000:2.0:1789304349.461215:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304349.461264:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785586944:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304350.037360:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304350.282291:0:76367:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc066330c0 20000000:00000080:3.0:1789304350.282308:0:76367:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854c000 uarg=0000000000000000 10000000:01000000:3.0:1789304350.282808:0:76367:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304350.282831:0:76367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304350.282848:0:76367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304350.282859:0:76367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304350.282871:0:76367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304350.282879:0:76367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304350.282886:0:76367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304350.282893:0:76367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304350.282897:0:76367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304350.282905:0:76367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304350.282918:0:76367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304350.282926:0:76367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304350.282932:0:76367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f400/0xefc0bb72312959ee lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304350.807055:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304350.807066:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304350.807073:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304350.807145:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304350.807163:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304350.807177:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304350.807213:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785587072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304350.807283:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304350.807356:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789304350.807823:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785587072 00000100:00100000:2.0:1789304350.807833:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785587072 00000100:00100000:2.0:1789304350.807896:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1789304350.807906:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785587072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304350.807921:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304350.807937:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312959fc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312959f5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304350.807973:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312959fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312959f5 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304350.807983:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312959fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312959f5 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304350.807992:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc200, rc 0) 00000100:00100000:2.0:1789304350.808065:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785587072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304350.808072:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1789304350.808323:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785587072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304350.808342:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304350.808352:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304350.808373:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304350.808379:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304350.808387:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304350.994402:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785587584:0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.994480:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304350.994550:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789304350.994557:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785587200:0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.994582:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304350.994602:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785587712:0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.994625:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304350.994654:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785587456:0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.994676:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304350.994694:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304350.994699:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785587328:0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.994719:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304350.994753:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785587584 00000100:00100000:3.0:1789304350.994764:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785587584 00000100:00100000:3.0:1789304350.994823:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785587200 00000100:00100000:3.0:1789304350.994826:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785587200 00000100:00100000:3.0:1789304350.994841:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785587456 00000100:00100000:3.0:1789304350.994843:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785587456 00000100:00100000:3.0:1789304350.994858:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1789304350.994866:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785587584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.994916:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785587584:12345-0@lo:400:kworker.0 Request processed in 50us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304350.994924:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1789304350.994940:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1789304350.994947:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785587200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.994986:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785587200:12345-0@lo:400:kworker.0 Request processed in 40us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304350.994991:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1789304350.995019:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:3.0:1789304350.995026:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785587456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.995060:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785587456:12345-0@lo:400:kworker.0 Request processed in 35us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304350.995066:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:3.0:1789304350.995085:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785587712 00000100:00100000:3.0:1789304350.995119:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785587712 00000100:00100000:3.0:1789304350.995144:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785587328 00000100:00100000:3.0:1789304350.995146:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785587328 00000100:00100000:3.0:1789304350.995164:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:3.0:1789304350.995170:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785587712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.995203:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785587712:12345-0@lo:400:kworker.0 Request processed in 33us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304350.995209:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:3.0:1789304350.995220:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:3.0:1789304350.995226:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785587328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.995254:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785587328:12345-0@lo:400:kworker.0 Request processed in 28us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304350.995259:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00080000:3.0:1789304350.995282:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304350.995286:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304350.995319:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785587328:0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.995333:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785587456:0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.995363:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785587200:0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.995372:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785587712:0@lo:400:kworker.0 00000100:00100000:3.0:1789304350.995380:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785587584:0@lo:400:kworker.0 00010000:00010000:3.0:1789304351.060281:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304351.125018:0:76415:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee6e75820 20000000:00000080:3.0:1789304351.125036:0:76415:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02ec7800 uarg=0000000000000000 10000000:01000000:3.0:1789304351.125641:0:76415:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304351.125664:0:76415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304351.125684:0:76415:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312959fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312959f5 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304351.125693:0:76415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304351.125733:0:76415:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312959fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312959f5 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304351.125747:0:76415:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312959fc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312959f5 expref: 18 pid: 5845 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304351.125760:0:76415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76415:1876219785587840:0@lo:104: 00000100:00100000:3.0:1789304351.126020:0:76415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304351.126249:0:76415:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b040913c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304351.126476:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785587840 00000100:00100000:2.0:1789304351.126484:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785587840 00000100:00100000:2.0:1789304351.126569:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789304351.126579:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:76415:x1876219785587840:12345-0@lo:104: 00010000:00010000:2.0:1789304351.126593:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.126668:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304351.126675:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:76415:x1876219785587840:12345-0@lo:104: Request processed in 99us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304351.126681:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00010000:1.0:1789304351.126726:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304351.126733:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.126740:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304351.126745:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.126753:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304351.126761:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304351.126766:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304351.126807:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.126819:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304351.126841:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.126848:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312959f5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312959fc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.126862:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304351.126864:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304351.126865:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304351.126893:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785587968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304351.126925:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304351.126982:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785587968 00000100:00100000:1.0:1789304351.126986:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785587968 00010000:00010000:1.0:1789304351.127007:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312959fc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312959f5 expref: 19 pid: 5845 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304351.127032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789304351.127039:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785587968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304351.127050:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304351.127055:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312959fc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312959f5 expref: 19 pid: 5845 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127066:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312959fc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312959f5 expref: 19 pid: 5845 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127083:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127123:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127137:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127144:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127151:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127159:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127165:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304351.127169:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127176:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127185:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304351.127195:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304351.127226:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785587968:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304351.127233:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789304351.127272:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785587968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304351.127895:0:76415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb72312959fc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312959f5 expref: 18 pid: 5845 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304351.127908:0:76415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76415:1876219785587840:0@lo:104: 00010000:00010000:3.0:1789304351.127923:0:76415:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304351.127932:0:76415:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304351.127940:0:76415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304351.127946:0:76415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a03 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789304351.756594:0:76463:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc08c830a0 20000000:00000080:2.0:1789304351.756613:0:76463:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3b4ea400 uarg=0000000000000000 10000000:01000000:2.0:1789304351.756821:0:76463:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304351.756846:0:76463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.756864:0:76463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.756876:0:76463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.756884:0:76463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.756892:0:76463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.756900:0:76463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.756908:0:76463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304351.756912:0:76463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.756921:0:76463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.756937:0:76463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.756945:0:76463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304351.756967:0:76463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a0a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304352.083301:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304352.569510:0:76511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd662fe630 20000000:00000080:2.0:1789304352.569590:0:76511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3b4ea800 uarg=0000000000000000 10000000:01000000:2.0:1789304352.569794:0:76511:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304352.569819:0:76511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304352.569837:0:76511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304352.569848:0:76511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304352.570020:0:76511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304352.570030:0:76511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304352.570038:0:76511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304352.570044:0:76511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304352.570048:0:76511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304352.570057:0:76511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304352.570077:0:76511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304352.570085:0:76511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304352.570230:0:76511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231295a11 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304352.789179:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304352.789187:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304352.789193:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304352.789243:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304352.789256:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304352.789269:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304352.789299:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785588096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304352.789375:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304352.789431:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110eaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789304352.790161:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785588096 00000100:00100000:3.0:1789304352.790172:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785588096 00000100:00100000:3.0:1789304352.790225:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1789304352.790235:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785588096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304352.790249:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304352.790264:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a1f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295a18 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304352.790290:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295a18 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304352.790301:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a18 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304352.790309:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789304352.790362:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785588096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304352.790369:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1789304352.791574:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785588096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304352.791599:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304352.791614:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304352.791639:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304352.791645:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304352.791654:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.107289:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304353.413896:0:76559:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf1ef6050 20000000:00000080:1.0:1789304353.413914:0:76559:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36f54400 uarg=0000000000000000 10000000:01000000:1.0:1789304353.414178:0:76559:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304353.414200:0:76559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304353.414220:0:76559:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a18 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304353.414229:0:76559:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304353.414270:0:76559:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295a18 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304353.414286:0:76559:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a1f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295a18 expref: 18 pid: 5846 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304353.414301:0:76559:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76559:1876219785588224:0@lo:104: 00000100:00100000:1.0:1789304353.414370:0:76559:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304353.414429:0:76559:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c373eae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789304353.417124:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785588224 00000100:00100000:0.0:1789304353.417140:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785588224 00000100:00100000:0.0:1789304353.417202:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789304353.417210:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:76559:x1876219785588224:12345-0@lo:104: 00010000:00010000:0.0:1789304353.417225:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417306:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304353.417310:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:76559:x1876219785588224:12345-0@lo:104: Request processed in 102us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304353.417316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00010000:0.0:1789304353.417335:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304353.417340:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417346:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304353.417349:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417355:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304353.417360:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304353.417364:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304353.417393:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417397:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304353.417412:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417417:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295a18 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a1f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417431:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304353.417432:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304353.417433:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304353.417464:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785588352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304353.417498:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304353.417538:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785588352 00000100:00100000:0.0:1789304353.417541:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785588352 00010000:00010000:0.0:1789304353.417561:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a1f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a18 expref: 19 pid: 5846 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304353.417581:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789304353.417587:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785588352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304353.417596:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304353.417601:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a1f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a18 expref: 19 pid: 5846 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417612:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a1f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295a18 expref: 19 pid: 5846 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417630:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417638:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417649:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417654:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417659:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417663:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417667:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304353.417670:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417675:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417680:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304353.417687:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304353.417706:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785588352:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304353.417711:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789304353.417736:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785588352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304353.419342:0:76559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295a1f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295a18 expref: 18 pid: 5846 timeout: 1953 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304353.419364:0:76559:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76559:1876219785588224:0@lo:104: 00010000:00010000:1.0:1789304353.419387:0:76559:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304353.419395:0:76559:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304353.419402:0:76559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304353.419408:0:76559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295a26 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304353.555201:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785588480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304353.555282:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304353.555340:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785588480 00000100:00100000:0.0:1789304353.555350:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785588480 00000100:00100000:0.0:1789304353.555417:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1789304353.555429:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785588480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304353.555469:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304353.555519:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785588480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304353.555527:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1789304353.555572:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785588480:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304353.555839:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304353.633634:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304353.633683:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304353.633707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304353.633732:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765492224 00000100:00100000:3.0:1789304353.633742:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765492224 00000100:00100000:3.0:1789304353.633801:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1265 00000100:00100000:3.0:1789304353.633813:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765492224:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304353.633882:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765492224:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304353.633890:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1265 00000100:00080000:3.0:1789304353.633911:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304353.634646:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765492352 00000100:00100000:0.0:1789304353.634654:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765492352 00000100:00100000:0.0:1789304353.634707:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 361 00000100:00100000:0.0:1789304353.634717:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765492352:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:0.0:1789304353.634739:0:17212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb723129560c 00000100:00080000:0.0:1789304353.634748:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2b02ec8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789304353.634782:0:17212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967337 00000100:00100000:0.0:1789304353.635066:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765492352:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 350us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304353.635074:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 361 00000100:00100000:0.0:1789304353.635125:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765492096 00000100:00100000:0.0:1789304353.635130:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765492096 00000100:00100000:0.0:1789304353.635157:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1063 00000100:00100000:0.0:1789304353.635163:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765492096:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304353.635189:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765492096:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304353.635195:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1063 00010000:00010000:0.0:1789304353.635228:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789304353.636084:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304353.639688:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304353.640084:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765492480 00000100:00100000:0.0:1789304353.640128:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765492480 00000100:00100000:0.0:1789304353.640191:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 362 00000100:00100000:0.0:1789304353.640201:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765492480:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:0.0:1789304353.640230:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb723129590e 00000100:00080000:0.0:1789304353.640240:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9e2c07eaf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789304353.640276:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967337 00000100:00100000:0.0:1789304353.640531:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765492480:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 330us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304353.640538:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 362 00010000:00010000:0.0:1789304353.640564:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789304353.640748:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304354.130788:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304354.588819:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785588608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304354.588962:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304354.589146:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785588608 00000100:00100000:3.0:1789304354.589157:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785588608 00000100:00100000:3.0:1789304354.589232:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1789304354.589243:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785588608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304354.589287:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304354.593167:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304354.597555:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785588608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8303us (8581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304354.597571:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1789304354.605741:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785588608:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304355.154236:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304355.474168:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304355.474177:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304355.474183:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304355.474243:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304355.474257:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304355.474269:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304355.474304:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785588736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304355.474401:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304355.474456:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c36a820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304355.474543:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785588736 00000100:00100000:3.0:1789304355.474553:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785588736 00000100:00100000:3.0:1789304355.474617:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1789304355.474628:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785588736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304355.474643:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304355.474660:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231295a34 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295a2d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304355.474688:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231295a34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295a2d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304355.474699:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231295a34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a2d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304355.474709:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f400, rc 0) 00000100:00100000:3.0:1789304355.474759:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785588736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304355.474765:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1789304355.474810:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785588736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304355.474826:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304355.474835:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304355.474859:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304355.474864:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304355.474872:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304356.114283:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785589120:0@lo:400:kworker.0 00000100:00100000:3.0:1789304356.114355:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304356.114425:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304356.114431:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785589248:0@lo:400:kworker.0 00000100:00100000:3.0:1789304356.114452:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304356.114531:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785588992:0@lo:400:kworker.0 00000100:00100000:2.0:1789304356.114560:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304356.114589:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789304356.114594:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785588864:0@lo:400:kworker.0 00000100:00100000:2.0:1789304356.114613:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304356.114629:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785589376:0@lo:400:kworker.0 00000100:00100000:2.0:1789304356.114645:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304356.114674:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785589120 00000100:00100000:2.0:1789304356.114689:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785589120 00000100:00100000:2.0:1789304356.114739:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785589248 00000100:00100000:2.0:1789304356.114742:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785589248 00000100:00100000:2.0:1789304356.114762:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785588864 00000100:00100000:2.0:1789304356.114765:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785588864 00000100:00100000:2.0:1789304356.114781:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1789304356.114914:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785589120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304356.115037:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785588992 00000100:00100000:3.0:1789304356.115041:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785588992 00000100:00100000:3.0:1789304356.115070:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785589376 00000100:00100000:3.0:1789304356.115072:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785589376 00000100:00100000:3.0:1789304356.115109:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:3.0:1789304356.115116:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785588992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304356.115155:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785588992:12345-0@lo:400:kworker.0 Request processed in 40us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304356.115163:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:3.0:1789304356.115179:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1789304356.115185:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785589376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304356.115210:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785589376:12345-0@lo:400:kworker.0 Request processed in 25us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304356.115215:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:2.0:1789304356.115941:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785589120:12345-0@lo:400:kworker.0 Request processed in 1034us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304356.116113:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785589120:0@lo:400:kworker.0 00000100:00080000:0.0:1789304356.117232:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304356.117239:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304356.117243:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304356.121292:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1789304356.122167:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785589248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304356.122287:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785589248:12345-0@lo:400:kworker.0 Request processed in 980us (7833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304356.122295:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:2.0:1789304356.122665:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1789304356.122700:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1789304356.122710:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785588864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304356.122753:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785588864:12345-0@lo:400:kworker.0 Request processed in 46us (8138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304356.122759:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1789304356.122845:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785588864:0@lo:400:kworker.0 00000100:00100000:2.0:1789304356.122860:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785589376:0@lo:400:kworker.0 00000100:00100000:2.0:1789304356.122872:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785588992:0@lo:400:kworker.0 00000100:00100000:0.0:1789304356.133891:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785589248:0@lo:400:kworker.0 00010000:00010000:0.0:1789304356.181241:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304356.280819:0:76708:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa1463a70 20000000:00000080:2.0:1789304356.280837:0:76708:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c19b42800 uarg=0000000000000000 10000000:01000000:2.0:1789304356.284924:0:76708:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304356.284961:0:76708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.284981:0:76708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231295a34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a2d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.284990:0:76708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.285039:0:76708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231295a34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295a2d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.285057:0:76708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231295a34 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295a2d expref: 18 pid: 5845 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304356.285074:0:76708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76708:1876219785589504:0@lo:104: 00000100:00100000:2.0:1789304356.285161:0:76708:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304356.285227:0:76708:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b04091e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789304356.286934:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785589504 00000100:00100000:3.0:1789304356.286947:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785589504 00000100:00100000:3.0:1789304356.287070:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789304356.287081:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:76708:x1876219785589504:12345-0@lo:104: 00010000:00010000:3.0:1789304356.287128:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304356.287242:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304356.287248:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:76708:x1876219785589504:12345-0@lo:104: Request processed in 170us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304356.287255:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00010000:1.0:1789304356.287393:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304356.287401:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304356.287409:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304356.287413:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304356.287422:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304356.287437:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304356.287443:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304356.287488:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304356.287495:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304356.287516:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304356.287522:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa400/0xefc0bb7231295a2d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304356.287525:0:76708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76708:1876219785589504:0@lo:104: 00010000:00010000:1.0:1789304356.287536:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304356.287538:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304356.287539:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304356.287546:0:76708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304356.287551:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785589632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304356.287589:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304356.287609:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785589632 00000100:00100000:2.0:1789304356.287613:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785589632 00010000:00010000:2.0:1789304356.287632:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231295a34 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a2d expref: 19 pid: 5845 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304356.287657:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789304356.287665:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785589632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304356.287679:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304356.287685:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231295a34 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a2d expref: 19 pid: 5845 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287696:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231295a34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295a2d expref: 19 pid: 5845 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287710:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231295a34 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295a2d expref: 19 pid: 5845 timeout: 1955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287724:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287733:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287759:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287767:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287773:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287779:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287784:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304356.287788:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287794:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287814:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304356.287822:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304356.287851:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785589632:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304356.287857:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789304356.288852:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785589632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304356.288888:0:76708:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304356.288898:0:76708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304356.288914:0:76708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231295a3b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1789304356.665498:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304356.665507:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2c07ea8000/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304356.665530:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c07ea8000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:3.0:1789304356.665577:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c07eaf000 for lustre-OST0001 00000001:00100000:1.0:1789304356.681581:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304356.681591:0:6723:0:(genops.c:885:class_export_put()) final put ffff9e2b02ecd800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304356.681913:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b02ecd800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0000 00000020:00000080:3.0:1789304356.682202:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b02ec8800 for lustre-OST0000 00000020:00000080:3.0:1789304357.140715:0:76759:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa6f0f100 20000000:00000080:3.0:1789304357.140738:0:76759:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c1045b400 uarg=0000000000000000 10000000:01000000:3.0:1789304357.141546:0:76759:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304357.141570:0:76759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304357.141587:0:76759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304357.141597:0:76759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304357.141604:0:76759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304357.141610:0:76759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304357.141617:0:76759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304357.141623:0:76759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304357.141627:0:76759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304357.142407:0:76759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304357.142427:0:76759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304357.142436:0:76759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304357.142442:0:76759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295a42 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304357.205155:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304358.098151:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304358.098161:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304358.098166:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304358.098288:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304358.098414:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304358.098427:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304358.098455:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785589760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304358.098540:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304358.098787:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c08b2d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789304358.098899:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785589760 00000100:00100000:1.0:1789304358.098910:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785589760 00000100:00100000:1.0:1789304358.098973:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1789304358.098982:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785589760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304358.098996:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304358.099011:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295a50 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295a49 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304358.099034:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295a50 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295a49 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304358.099044:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295a50 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a49 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304358.099052:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ee00, rc 0) 00000100:00100000:1.0:1789304358.099125:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785589760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304358.099132:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1789304358.099190:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785589760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304358.099205:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304358.099213:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304358.099231:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304358.099236:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304358.099243:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304358.227285:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304358.675678:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785589888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304358.675790:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304358.675960:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785589888 00000100:00100000:3.0:1789304358.675971:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785589888 00000100:00100000:3.0:1789304358.676045:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1789304358.676056:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785589888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304358.676124:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304358.676177:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785589888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304358.676184:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1789304358.676264:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785589888:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304358.678901:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304358.759152:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304358.759275:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765492608 00000100:00100000:2.0:1789304358.759292:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765492608 00000100:00100000:2.0:1789304358.759379:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1066 00000100:00100000:2.0:1789304358.759392:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765492608:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304358.759497:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765492608:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 107us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304358.759505:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1066 00000100:00100000:0.0:1789304358.763151:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304358.763288:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765492736 00000100:00100000:2.0:1789304358.763305:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765492736 00000100:00100000:2.0:1789304358.763400:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1269 00000100:00100000:2.0:1789304358.763416:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765492736:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304358.763553:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765492736:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 142us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304358.763563:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1269 00000100:00080000:0.0:1789304358.764430:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304359.252934:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304359.699488:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785590016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304359.699580:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304359.704074:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785590016 00000100:00100000:2.0:1789304359.704120:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785590016 00000100:00100000:2.0:1789304359.704300:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1789304359.704314:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785590016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304359.704354:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304359.704446:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785590016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (4867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304359.704455:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1789304359.704526:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785590016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304359.707932:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304360.280616:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304361.235755:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785590400:0@lo:400:kworker.0 00000100:00100000:0.0:1789304361.235830:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304361.235894:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304361.235900:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785590528:0@lo:400:kworker.0 00000100:00100000:3.0:1789304361.235995:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785590272:0@lo:400:kworker.0 00000100:00100000:1.0:1789304361.236042:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785590144:0@lo:400:kworker.0 00000100:00100000:3.0:1789304361.240682:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304361.240756:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785590272 00000100:00100000:3.0:1789304361.240765:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785590272 00000100:00100000:3.0:1789304361.240820:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1789304361.240830:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785590272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304361.241055:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785590272:12345-0@lo:400:kworker.0 Request processed in 227us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304361.241063:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1789304361.241137:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785590272:0@lo:400:kworker.0 00000100:00100000:3.0:1789304361.241161:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785590784:0@lo:400:kworker.0 00000100:00100000:3.0:1789304361.241193:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304361.241215:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785590400 00000100:00100000:3.0:1789304361.241219:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785590400 00000100:00100000:3.0:1789304361.241248:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785590784 00000100:00100000:3.0:1789304361.241251:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785590784 00000100:00100000:3.0:1789304361.241393:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1789304361.241403:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785590400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304361.241438:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785590400:12345-0@lo:400:kworker.0 Request processed in 38us (5609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304361.241444:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1789304361.241456:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:3.0:1789304361.241463:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785590784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304361.241489:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785590784:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304361.241495:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00080000:3.0:1789304361.241511:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304361.241515:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304361.241538:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785590784:0@lo:400:kworker.0 00000100:00100000:1.0:1789304361.241816:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304361.241872:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785590656:0@lo:400:kworker.0 00000100:00100000:1.0:1789304361.241901:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304361.242069:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785590144 00000100:00100000:3.0:1789304361.242074:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785590144 00000100:00100000:3.0:1789304361.242121:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1789304361.242128:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785590144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304361.242610:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785590656 00000100:00100000:1.0:1789304361.242616:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785590656 00000100:00100000:1.0:1789304361.242654:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1789304361.242662:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785590656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304361.242704:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785590656:12345-0@lo:400:kworker.0 Request processed in 44us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304361.242711:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1789304361.242946:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785590656:0@lo:400:kworker.0 00000100:00100000:0.0:1789304361.243124:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304361.243176:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785590400:0@lo:400:kworker.0 00000100:00100000:1.0:1789304361.245848:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785590528 00000100:00100000:1.0:1789304361.245875:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785590528 00000100:00100000:1.0:1789304361.246017:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1789304361.246028:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785590528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304361.246086:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785590144:12345-0@lo:400:kworker.0 Request processed in 3957us (4267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304361.246109:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1789304361.246110:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785590528:12345-0@lo:400:kworker.0 Request processed in 85us (2987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304361.246115:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00080000:3.0:1789304361.246151:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304361.246238:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785590528:0@lo:400:kworker.0 00000100:00100000:1.0:1789304361.246341:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785590144:0@lo:400:kworker.0 00010000:00010000:0.0:1789304361.299769:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304361.505007:0:76957:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff212787a0 20000000:00000080:0.0:1789304361.505045:0:76957:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02013400 uarg=0000000000000000 00010000:00010000:0.0:1789304361.507912:0:76957:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304361.507932:0:76957:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304361.507945:0:76957:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304361.507966:0:76957:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304361.507984:0:76957:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295a50 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a49 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304361.507994:0:76957:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304361.508036:0:76957:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295a50 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295a49 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304361.508052:0:76957:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295a50 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295a49 expref: 18 pid: 5846 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304361.508066:0:76957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76957:1876219785590912:0@lo:104: 00000100:00100000:0.0:1789304361.509549:0:76957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304361.509667:0:76957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c373ea240 going to sleep for 11 seconds 00000100:00100000:0.0:1789304361.511563:0:52683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789304361.511594:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785590912 00000100:00100000:0.0:1789304361.511605:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785590912 00000100:00100000:0.0:1789304361.511761:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789304361.511772:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:76957:x1876219785590912:12345-0@lo:104: 00010000:00010000:0.0:1789304361.511790:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304361.511901:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304361.511907:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36f25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:76957:x1876219785590912:12345-0@lo:104: Request processed in 139us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304361.511914:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00010000:2.0:1789304361.513474:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304361.513487:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513498:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304361.513503:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513513:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304361.513521:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304361.513540:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304361.513591:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513597:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304361.513621:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513630:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb7231295a49 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513650:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304361.513668:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304361.513670:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304361.513704:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785591040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304361.513763:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304361.513827:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785591040 00000100:00100000:2.0:1789304361.513834:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785591040 00010000:00010000:2.0:1789304361.513871:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295a50 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a49 expref: 19 pid: 5846 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304361.513899:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789304361.513907:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785591040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304361.513918:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304361.513923:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295a50 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a49 expref: 19 pid: 5846 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513934:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295a50 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295a49 expref: 19 pid: 5846 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513951:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513959:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513978:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513985:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513991:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.513999:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.514004:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304361.514008:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.514016:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.514024:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304361.514032:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304361.514067:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785591040:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304361.514075:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789304361.514160:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785591040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304361.517026:0:76957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ee00/0xefc0bb7231295a50 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295a49 expref: 18 pid: 5846 timeout: 1961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304361.517054:0:76957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76957:1876219785590912:0@lo:104: 00010000:00010000:1.0:1789304361.517111:0:76957:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304361.517124:0:76957:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304361.517131:0:76957:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304361.517137:0:76957:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231295a57 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76957 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304362.322866:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304363.346369:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304363.347021:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304363.347027:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304363.347035:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304363.347193:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304363.347212:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304363.347229:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304363.347272:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785591168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304363.347378:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304363.347452:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c2023d840 going to sleep for 11 seconds 00000100:00100000:0.0:1789304363.347682:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785591168 00000100:00100000:0.0:1789304363.347695:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785591168 00000100:00100000:0.0:1789304363.347765:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:0.0:1789304363.347777:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785591168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304363.347797:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304363.347816:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295a65 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295a5e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304363.347858:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295a65 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295a5e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304363.347871:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295a65 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a5e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304363.347881:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa600, rc 0) 00000100:00100000:0.0:1789304363.348281:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785591168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 505us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304363.348290:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1789304363.348406:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785591168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304363.348430:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304363.348442:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304363.349000:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304363.349013:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304363.349024:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304363.795553:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304363.795586:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785591296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304363.795675:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304363.796301:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785591296 00000100:00100000:0.0:1789304363.796314:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785591296 00000100:00100000:0.0:1789304363.796404:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1789304363.796418:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785591296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304363.796470:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304363.796544:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785591296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304363.796551:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1789304363.796619:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785591296:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304363.796922:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304363.879081:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304363.879170:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304363.879314:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765492992 00000100:00100000:1.0:1789304363.879327:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765492992 00000100:00100000:1.0:1789304363.879420:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1273 00000100:00100000:1.0:1789304363.879433:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765492992:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304363.880676:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765492864 00000100:00100000:3.0:1789304363.880693:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765492864 00000100:00100000:3.0:1789304363.880755:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1069 00000100:00100000:3.0:1789304363.880765:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765492864:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1789304363.880904:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304363.881275:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765492992:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1840us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304363.881287:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1273 00000100:00100000:3.0:1789304363.883927:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765492864:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 3145us (4844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304363.883948:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1069 00010000:00010000:2.0:1789304364.370376:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304364.819188:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304364.819215:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785591424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304364.819295:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304364.819371:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785591424 00000100:00100000:3.0:1789304364.819379:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785591424 00000100:00100000:3.0:1789304364.819434:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1789304364.819443:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785591424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304364.819481:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304364.819529:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785591424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304364.819537:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00080000:3.0:1789304364.819559:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304364.819600:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785591424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304365.394252:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304365.934682:0:77156:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf9a19240 20000000:00000080:2.0:1789304365.934699:0:77156:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3700d800 uarg=0000000000000000 00010000:00010000:2.0:1789304365.935629:0:77156:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304365.935647:0:77156:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304365.935663:0:77156:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304365.935685:0:77156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304365.935704:0:77156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295a65 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a5e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304365.935713:0:77156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304365.935838:0:77156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295a65 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295a5e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304365.935857:0:77156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295a65 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295a5e expref: 18 pid: 5846 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304365.935946:0:77156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77156:1876219785591552:0@lo:104: 00000100:00100000:2.0:1789304365.936015:0:77156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304365.936221:0:77156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c11b5d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789304365.936418:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785591552 00000100:00100000:3.0:1789304365.936427:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785591552 00000100:00100000:3.0:1789304365.936589:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789304365.936600:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:77156:x1876219785591552:12345-0@lo:104: 00010000:00010000:3.0:1789304365.936616:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304365.936697:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304365.936704:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:77156:x1876219785591552:12345-0@lo:104: Request processed in 106us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304365.936711:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789304365.936785:0:77156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77156:1876219785591552:0@lo:104: 00010000:00010000:2.0:1789304365.936804:0:77156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.936857:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304365.936874:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.936882:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304365.936887:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.936896:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304365.936907:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304365.936914:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304365.936951:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.936957:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304365.936979:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.936986:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231295a5e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a65 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937003:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304365.937005:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304365.937007:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304365.937293:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304365.937311:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785591680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304365.937354:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304365.937426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785591680 00000100:00100000:1.0:1789304365.937432:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785591680 00010000:00010000:1.0:1789304365.937456:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295a65 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a5e expref: 19 pid: 5846 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304365.937486:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789304365.937504:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0386ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785591680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304365.937516:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304365.937521:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295a65 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a5e expref: 19 pid: 5846 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937531:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295a65 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295a5e expref: 19 pid: 5846 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937544:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231295a65 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295a5e expref: 19 pid: 5846 timeout: 1965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937557:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937565:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937580:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937587:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937594:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937600:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937605:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304365.937610:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937617:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937628:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304365.937641:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304365.937671:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0386ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785591680:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304365.937677:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789304365.937896:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785591680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304365.937925:0:77156:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304365.937933:0:77156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304365.937938:0:77156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295a6c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304366.355303:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785591808:0@lo:400:kworker.0 00000100:00100000:1.0:1789304366.355348:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785592064:0@lo:400:kworker.0 00000100:00100000:2.0:1789304366.355410:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785591936:0@lo:400:kworker.0 00000100:00100000:1.0:1789304366.355495:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304366.355546:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304366.355566:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304366.355575:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785592192:0@lo:400:kworker.0 00000100:00100000:3.0:1789304366.355589:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785591808 00000100:00100000:2.0:1789304366.355594:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304366.355599:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785591808 00000100:00100000:1.0:1789304366.355617:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785592064 00000100:00100000:1.0:1789304366.355621:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785592064 00000100:00100000:2.0:1789304366.355642:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785592448:0@lo:400:kworker.0 00000100:00100000:3.0:1789304366.355648:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1789304366.355657:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1789304366.355658:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785591808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304366.355665:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785592064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304366.355672:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304366.355696:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304366.355703:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785592320:0@lo:400:kworker.0 00000100:00100000:1.0:1789304366.355712:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785592064:12345-0@lo:400:kworker.0 Request processed in 48us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304366.355719:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785591808:12345-0@lo:400:kworker.0 Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304366.355719:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1789304366.355724:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1789304366.355734:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785592448 00000100:00100000:1.0:1789304366.355737:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785592448 00000100:00100000:1.0:1789304366.355768:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:1.0:1789304366.355773:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785592448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304366.356024:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304366.356116:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785591808:0@lo:400:kworker.0 00000100:00100000:2.0:1789304366.356184:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785591936 00000100:00100000:2.0:1789304366.356189:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785591936 00000100:00100000:2.0:1789304366.356223:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785592320 00000100:00100000:3.0:1789304366.356227:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304366.356228:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785592320 00000100:00100000:2.0:1789304366.356256:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785592192 00000100:00100000:2.0:1789304366.356260:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785592192 00000100:00100000:3.0:1789304366.356269:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785592064:0@lo:400:kworker.0 00000100:00100000:2.0:1789304366.356282:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1789304366.356291:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785591936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304366.356335:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785591936:12345-0@lo:400:kworker.0 Request processed in 47us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304366.356342:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1789304366.356361:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1789304366.356367:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785591936:0@lo:400:kworker.0 00000100:00100000:2.0:1789304366.356372:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785592320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304366.356520:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785592320:12345-0@lo:400:kworker.0 Request processed in 151us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304366.356528:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1789304366.356545:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785592320:0@lo:400:kworker.0 00000100:00100000:2.0:1789304366.356549:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1789304366.356560:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785592192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304366.356691:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785592192:12345-0@lo:400:kworker.0 Request processed in 133us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304366.356699:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1789304366.356709:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785592192:0@lo:400:kworker.0 00000100:00080000:0.0:1789304366.357182:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304366.357187:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304366.357189:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304366.358826:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785592448:12345-0@lo:400:kworker.0 Request processed in 3034us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304366.358841:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:2.0:1789304366.358864:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785592448:0@lo:400:kworker.0 00010000:00010000:3.0:1789304366.418464:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304366.707834:0:77204:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec8f17480 20000000:00000080:2.0:1789304366.707855:0:77204:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02073800 uarg=0000000000000000 00010000:00010000:2.0:1789304366.708369:0:77204:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304366.708386:0:77204:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304366.708399:0:77204:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304366.708424:0:77204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.708441:0:77204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.708453:0:77204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.708460:0:77204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.708468:0:77204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.708477:0:77204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.708484:0:77204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304366.708488:0:77204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.708496:0:77204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.708509:0:77204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.708517:0:77204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.708524:0:77204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231295a73 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304366.994216:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304366.994223:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304366.994227:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304366.994277:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.994286:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.994295:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304366.994320:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785592576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304366.994389:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304366.994469:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0246d480 going to sleep for 11 seconds 00000100:00100000:3.0:1789304366.994632:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785592576 00000100:00100000:3.0:1789304366.994640:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785592576 00000100:00100000:3.0:1789304366.994693:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1789304366.994703:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785592576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304366.994717:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304366.994731:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295a81 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295a7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304366.994754:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295a81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295a7a expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304366.994763:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295a81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a7a expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304366.994770:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304366.994825:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785592576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304366.994831:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1789304366.995019:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785592576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304366.995031:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.995038:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304366.995052:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304366.995055:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304366.995060:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304367.445660:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304368.470075:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304368.914576:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304368.914609:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785592704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304368.914707:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304368.914832:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785592704 00000100:00100000:0.0:1789304368.914857:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785592704 00000100:00100000:0.0:1789304368.914947:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:0.0:1789304368.914958:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785592704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304368.915012:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304368.915075:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785592704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304368.915082:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00080000:1.0:1789304368.915249:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304368.915293:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785592704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304369.005751:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304369.005826:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304369.005990:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765493120 00000100:00100000:2.0:1789304369.006004:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765493120 00000100:00100000:2.0:1789304369.006730:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1072 00000100:00100000:2.0:1789304369.006744:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765493120:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304369.007018:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765493120:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 277us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304369.007028:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1072 00000100:00100000:2.0:1789304369.007107:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765493248 00000100:00100000:2.0:1789304369.007114:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765493248 00000100:00100000:2.0:1789304369.007166:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1277 00000100:00100000:2.0:1789304369.007174:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765493248:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304369.018749:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765493248:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 11554us (12900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304369.018772:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1277 00000100:00080000:2.0:1789304369.022815:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304369.492208:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304369.939988:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785592832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304369.940084:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304369.940252:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785592832 00000100:00100000:2.0:1789304369.940265:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785592832 00000100:00100000:2.0:1789304369.940354:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1789304369.940367:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785592832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304369.940417:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304369.940477:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785592832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304369.940486:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00080000:3.0:1789304369.940563:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304369.940612:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785592832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304370.515943:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304371.475757:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785592960:0@lo:400:kworker.0 00000100:00100000:1.0:1789304371.475879:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304371.476015:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785592960 00000100:00100000:2.0:1789304371.476029:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785592960 00000100:00100000:2.0:1789304371.476122:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1789304371.476134:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785592960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.480073:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785592960:12345-0@lo:400:kworker.0 Request processed in 3919us (4171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304371.480114:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1789304371.480242:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785593088:0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.480327:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304371.480405:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785593088 00000100:00100000:2.0:1789304371.480417:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785593088 00000100:00100000:2.0:1789304371.480480:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1789304371.480493:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785593088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.480560:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785593088:12345-0@lo:400:kworker.0 Request processed in 70us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304371.480567:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1789304371.480611:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785593088:0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.480939:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785593216:0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.480980:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304371.481018:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785593216 00000100:00100000:2.0:1789304371.481023:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785593216 00000100:00100000:2.0:1789304371.481071:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1789304371.481113:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785593216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.481157:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785593216:12345-0@lo:400:kworker.0 Request processed in 46us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304371.481164:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00080000:2.0:1789304371.481182:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304371.481207:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785593216:0@lo:400:kworker.0 00000100:00100000:3.0:1789304371.481451:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785593344:0@lo:400:kworker.0 00000100:00100000:3.0:1789304371.481488:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304371.481939:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785593600:0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.481976:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304371.482013:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304371.482019:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785593472:0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.482043:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304371.482076:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785593344 00000100:00100000:2.0:1789304371.482082:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785593344 00000100:00100000:2.0:1789304371.482150:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785593472 00000100:00100000:2.0:1789304371.482154:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785593472 00000100:00100000:2.0:1789304371.482179:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1789304371.482188:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785593344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.482235:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785593344:12345-0@lo:400:kworker.0 Request processed in 48us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304371.482242:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1789304371.482256:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:2.0:1789304371.482261:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785593472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.482292:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785593472:12345-0@lo:400:kworker.0 Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304371.482297:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00080000:2.0:1789304371.482317:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304371.482349:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785593344:0@lo:400:kworker.0 00000100:00100000:2.0:1789304371.482384:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785593472:0@lo:400:kworker.0 00000100:00100000:3.0:1789304371.482457:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785593600 00000100:00100000:3.0:1789304371.482463:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785593600 00000100:00100000:3.0:1789304371.482515:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:3.0:1789304371.482525:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785593600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304371.482565:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785593600:12345-0@lo:400:kworker.0 Request processed in 43us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304371.482571:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00080000:2.0:1789304371.483964:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304371.484035:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785593600:0@lo:400:kworker.0 00000100:00100000:1.0:1789304371.484795:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785592960:0@lo:400:kworker.0 00010000:00010000:0.0:1789304371.539814:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304372.566012:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304373.538568:0:77498:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda5b31c70 20000000:00000080:1.0:1789304373.538598:0:77498:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36f56000 uarg=0000000000000000 10000000:01000000:1.0:1789304373.538661:0:77498:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304373.538691:0:77498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304373.538715:0:77498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295a81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a7a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304373.538722:0:77498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304373.538782:0:77498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295a81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295a7a expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304373.538795:0:77498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295a81 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295a7a expref: 18 pid: 5845 timeout: 1973 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304373.538883:0:77498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77498:1876219785593728:0@lo:104: 00000100:00100000:1.0:1789304373.538974:0:77498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304373.539120:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785593728 00000100:00100000:1.0:1789304373.539124:0:77498:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c42163b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789304373.539203:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785593728 00000100:00100000:0.0:1789304373.539273:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789304373.539284:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:77498:x1876219785593728:12345-0@lo:104: 00010000:00010000:0.0:1789304373.539301:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.539378:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304373.539386:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:77498:x1876219785593728:12345-0@lo:104: Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304373.539394:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789304373.539407:0:77498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77498:1876219785593728:0@lo:104: 00010000:00010000:1.0:1789304373.539434:0:77498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304373.540051:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304373.540064:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304373.540074:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304373.540080:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304373.540247:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304373.540258:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304373.540266:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304373.540311:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304373.540324:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304373.540360:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304373.540368:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231295a7a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a81 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304373.540391:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304373.540393:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304373.540395:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304373.540451:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785593856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304373.540507:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304373.540615:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785593856 00000100:00100000:0.0:1789304373.540621:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785593856 00010000:00010000:0.0:1789304373.540648:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295a81 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a7a expref: 19 pid: 5845 timeout: 1973 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304373.540711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789304373.540721:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785593856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304373.540736:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304373.540742:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295a81 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a7a expref: 19 pid: 5845 timeout: 1973 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540764:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295a81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295a7a expref: 19 pid: 5845 timeout: 1973 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540779:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231295a81 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295a7a expref: 19 pid: 5845 timeout: 1973 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540796:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540814:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540830:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540837:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540843:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540850:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540856:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304373.540861:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540868:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540888:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304373.540902:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304373.540951:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785593856:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304373.540959:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:2.0:1789304373.541029:0:77498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304373.541038:0:77498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304373.541044:0:77498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8e000/0xefc0bb7231295a88 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304373.541082:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785593856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304373.588878:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304374.035436:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785593984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304374.035562:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304374.035976:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785593984 00000100:00100000:0.0:1789304374.036000:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785593984 00000100:00080000:1.0:1789304374.036071:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304374.036141:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1789304374.036155:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785593984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304374.036204:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304374.036300:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785593984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304374.036308:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1789304374.036585:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785593984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304374.116180:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304374.116223:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304374.116298:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765493504 00000100:00100000:2.0:1789304374.116310:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765493504 00000100:00100000:2.0:1789304374.116391:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1281 00000100:00100000:2.0:1789304374.116401:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765493504:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304374.116473:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765493504:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304374.116480:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1281 00000100:00100000:3.0:1789304374.116773:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765493376 00000100:00100000:3.0:1789304374.116778:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765493376 00000100:00100000:3.0:1789304374.116807:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1074 00000100:00100000:3.0:1789304374.116814:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765493376:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304374.116846:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765493376:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304374.116853:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1074 00000100:00080000:1.0:1789304374.116917:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1789304374.513683:0:77546:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe89a5f490 20000000:00000080:2.0:1789304374.513703:0:77546:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02070000 uarg=0000000000000000 10000000:01000000:2.0:1789304374.513761:0:77546:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304374.513782:0:77546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.513798:0:77546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.513808:0:77546:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.513814:0:77546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.513821:0:77546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.513827:0:77546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.513833:0:77546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304374.513837:0:77546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.513849:0:77546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.513862:0:77546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.513869:0:77546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.513875:0:77546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231295a8f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304374.615917:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304374.866652:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304374.866659:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304374.866664:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304374.866705:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304374.866717:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304374.866729:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304374.866765:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785594112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304374.866837:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304374.866895:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789304374.867980:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785594112 00000100:00100000:2.0:1789304374.867992:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785594112 00000100:00100000:2.0:1789304374.868050:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1789304374.868060:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785594112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304374.868074:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304374.868123:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295a9d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295a96 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.868557:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295a9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295a96 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.868635:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295a9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a96 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304374.868645:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd000, rc 0) 00000100:00100000:2.0:1789304374.868721:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785594112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 662us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304374.868741:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1789304374.869288:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785594112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304374.869309:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304374.869319:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304374.869343:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304374.869351:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304374.869360:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304375.058550:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785594240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304375.058634:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304375.058774:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785594240 00000100:00100000:0.0:1789304375.058795:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785594240 00000100:00100000:0.0:1789304375.058862:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1789304375.058872:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785594240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304375.058907:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304375.058959:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785594240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304375.058967:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1789304375.059032:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785594240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304375.059156:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304375.634595:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304376.594553:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304376.594581:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785594368:0@lo:400:kworker.0 00000100:00100000:1.0:1789304376.594663:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304376.595185:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785594624:0@lo:400:kworker.0 00000100:00100000:3.0:1789304376.595223:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304376.595250:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789304376.595256:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785594496:0@lo:400:kworker.0 00000100:00100000:3.0:1789304376.595281:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304376.595298:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785595008:0@lo:400:kworker.0 00000100:00100000:3.0:1789304376.595318:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304376.596431:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785594880:0@lo:400:kworker.0 00000100:00100000:2.0:1789304376.596491:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304376.596531:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304376.596538:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785594752:0@lo:400:kworker.0 00000100:00100000:2.0:1789304376.596560:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304376.596597:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785594368 00000100:00100000:2.0:1789304376.596605:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785594368 00000100:00100000:2.0:1789304376.596659:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1789304376.596669:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785594368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304376.596882:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785594496 00000100:00100000:1.0:1789304376.596887:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785594496 00000100:00100000:1.0:1789304376.596914:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785594880 00000100:00100000:1.0:1789304376.596917:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785594880 00000100:00100000:1.0:1789304376.596943:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785594752 00000100:00100000:1.0:1789304376.596946:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785594752 00000100:00100000:1.0:1789304376.596961:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1789304376.596968:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785594496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304376.597040:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785594496:12345-0@lo:400:kworker.0 Request processed in 73us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304376.597051:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1789304376.597070:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1789304376.597077:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785594880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304376.597137:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785594880:12345-0@lo:400:kworker.0 Request processed in 61us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304376.597143:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1789304376.597154:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1789304376.597161:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785594752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304376.597181:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785594752:12345-0@lo:400:kworker.0 Request processed in 23us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304376.597185:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00080000:1.0:1789304376.597197:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304376.597561:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785594368:12345-0@lo:400:kworker.0 Request processed in 894us (2899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304376.597567:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1789304376.597593:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785594624 00000100:00100000:2.0:1789304376.597596:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785594624 00000100:00100000:2.0:1789304376.597614:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785595008 00000100:00100000:2.0:1789304376.597616:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785595008 00000100:00100000:2.0:1789304376.597652:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1789304376.597658:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785594624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304376.597984:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785594496:0@lo:400:kworker.0 00000100:00100000:2.0:1789304376.598072:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785594624:12345-0@lo:400:kworker.0 Request processed in 414us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304376.598079:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1789304376.598172:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:2.0:1789304376.598180:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785595008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304376.598204:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785595008:12345-0@lo:400:kworker.0 Request processed in 27us (2887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304376.598211:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00080000:2.0:1789304376.598239:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304376.598252:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785594752:0@lo:400:kworker.0 00000100:00100000:2.0:1789304376.598260:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785594880:0@lo:400:kworker.0 00000100:00100000:3.0:1789304376.598373:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785595008:0@lo:400:kworker.0 00000100:00100000:3.0:1789304376.598380:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785594624:0@lo:400:kworker.0 00000100:00100000:3.0:1789304376.598402:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785594368:0@lo:400:kworker.0 00010000:00010000:1.0:1789304376.663522:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304377.682806:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304378.022627:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304378.022840:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765493632 00000100:00100000:2.0:1789304378.022853:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765493632 00000100:00100000:2.0:1789304378.022943:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 668 00000100:00100000:2.0:1789304378.022954:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45096:x1876219765493632:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304378.022975:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304378.022997:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610025a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304378.023063:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295aab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304378.023077:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295aab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304378.023131:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295aab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304378.023170:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789304378.023174:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304378.023198:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295aab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304378.023221:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610025a expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304378.023247:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295aab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610025a expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304378.023254:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304378.023257:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304378.023261:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc200, rc 0) 00000100:00100000:2.0:1789304378.023317:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:45096:x1876219765493632:12345-192.168.202.29@tcp:101:rm.0 Request processed in 365us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304378.023324:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 668 00000100:00080000:1.0:1789304378.023476:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304378.026611:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304378.026748:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765493760 00000100:00100000:1.0:1789304378.026760:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765493760 00000100:00100000:1.0:1789304378.026826:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 669 00000100:00100000:1.0:1789304378.026836:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:45096:x1876219765493760:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304378.026861:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304378.026902:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295ab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100261 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.026975:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ab9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.026995:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027009:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027023:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ac0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027030:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027036:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027272:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ab9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027281:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ab9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027289:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ab9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027295:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304378.027299:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ab9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027307:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ab9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027319:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:1.0:1789304378.027323:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304378.027329:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ab9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027336:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ab9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027351:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027356:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ac0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027362:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ac0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027366:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304378.027369:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ac0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027374:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ac0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027673:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c14add900) 00010000:00010000:1.0:1789304378.027678:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304378.027681:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ac0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027688:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ac0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027762:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295ab2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100261 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027778:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:1.0:1789304378.027780:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304378.027784:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295ab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100261 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.027795:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8f400, rc 0) 00000100:00100000:1.0:1789304378.027866:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:45096:x1876219765493760:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1031us (1264us total) trans 0 rc 301/301 00000100:00100000:1.0:1789304378.027875:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 669 00000100:00100000:0.0:1789304378.104732:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304378.104850:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765493888 00000100:00100000:2.0:1789304378.104862:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765493888 00000100:00100000:2.0:1789304378.104942:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 670 00000100:00100000:2.0:1789304378.104954:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765493888:12345-192.168.202.29@tcp:41:mkdir.0 00000004:00000024:2.0:1789304378.104999:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789304378.105148:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765493888:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 140us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304378.105156:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 670 00000100:00100000:0.0:1789304378.107861:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304378.107954:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765494144 00000100:00100000:3.0:1789304378.107965:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765494144 00000100:00100000:3.0:1789304378.108027:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 671 00000100:00100000:3.0:1789304378.108037:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:45100:x1876219765494144:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:3.0:1789304378.108133:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304378.108182:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295aab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610025a expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.108214:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:3.0:1789304378.108226:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304378.108516:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295ac7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.108534:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295ac7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.108546:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295ac7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.108560:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.108567:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.108573:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304378.109511:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00010000:3.0:1789304378.109525:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295ac7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.109534:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295ac7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.109542:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295ac7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.109548:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304378.109553:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295ac7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.109560:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295ac7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.109573:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304378.109575:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304378.109580:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295ac7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.109586:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295ac7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304378.109604:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000114ab22f reply state 0000000002fd2187 transno 4294967551 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304378.109612:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304378.109697:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:45100:x1876219765494144:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 1658us (1846us total) trans 4294967551 rc 0/0 00000100:00100000:3.0:1789304378.109716:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 671 00010000:00010000:0.0:1789304378.122846:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304378.122867:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304378.122876:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304378.122882:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304378.122888:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304378.122896:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304378.122914:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c2ea19a00) 00010000:00010000:0.0:1789304378.122918:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304378.122924:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304378.122929:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295ace lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304378.164694:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304378.165195:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765494272 00000100:00100000:1.0:1789304378.165208:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765494272 00000100:00100000:1.0:1789304378.165278:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 672 00000100:00100000:1.0:1789304378.165291:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:45104:x1876219765494272:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:1.0:1789304378.165323:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304378.165350:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295ad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100268 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.165421:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295adc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.165433:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295adc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.165442:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295adc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304378.165473:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789304378.165476:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304378.165496:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295adc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.165515:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295ad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100268 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.165531:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295adc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100268 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.165537:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:1.0:1789304378.165539:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304378.165541:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ee00, rc 0) 00000100:00100000:1.0:1789304378.165607:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:45104:x1876219765494272:12345-192.168.202.29@tcp:101:chown.0 Request processed in 319us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304378.165614:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 672 00000100:00100000:3.0:1789304378.169366:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304378.169910:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765494400 00000100:00100000:1.0:1789304378.169923:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765494400 00000100:00100000:1.0:1789304378.170000:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 673 00000100:00100000:1.0:1789304378.170012:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:45104:x1876219765494400:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:1.0:1789304378.170037:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304378.170061:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ae3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610026f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.170169:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295aea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.170185:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295aea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.170203:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295aea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.170218:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295af1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.170225:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295af1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.170232:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295af1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172276:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295af8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172297:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172306:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304378.172352:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:1.0:1789304378.172356:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304378.172375:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295af8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172387:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295aea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172391:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295aea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172399:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295aea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172403:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304378.172406:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295aea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172412:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295aea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172420:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:1.0:1789304378.172422:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304378.172425:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295aea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172429:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295aea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172442:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295af1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172445:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295af1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172449:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295af1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172452:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304378.172453:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295af1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172459:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295af1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172464:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c14add300) 00010000:00010000:1.0:1789304378.172465:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304378.172467:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295af1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172470:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295af1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172507:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295ae3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610026f expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172521:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295af8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610026f expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304378.172527:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add100) 00010000:00010000:1.0:1789304378.172529:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304378.172531:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8f400, rc 0) 00000100:00100000:1.0:1789304378.172652:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:45104:x1876219765494400:12345-192.168.202.29@tcp:101:chown.0 Request processed in 2641us (3295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304378.172661:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 673 00000100:00100000:0.0:1789304378.176395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304378.176456:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765494656 00000100:00100000:2.0:1789304378.176469:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765494656 00000100:00100000:2.0:1789304378.176786:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 674 00000100:00100000:2.0:1789304378.176799:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:45104:x1876219765494656:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:2.0:1789304378.176858:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304378.176886:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295af8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610026f expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304378.176916:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add100) 00010000:00010000:2.0:1789304378.176926:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304378.177968:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304378.177992:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304378.178006:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304378.178261:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074431bec reply state 0000000044c28d3f transno 4294967552 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304378.178271:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789304378.178281:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000100:00100000:2.0:1789304378.178369:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:45104:x1876219765494656:12345-192.168.202.29@tcp:36:chown.0 Request processed in 1572us (1981us total) trans 4294967552 rc 0/0 00000100:00100000:2.0:1789304378.178378:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 674 00010000:00010000:3.0:1789304378.182622:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.182643:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.182652:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.182659:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304378.182665:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.182673:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.182688:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2800) 00010000:00010000:3.0:1789304378.182691:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304378.182696:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.182713:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295aff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304378.707193:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304379.084732:0:77743:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc9189cb30 20000000:00000080:1.0:1789304379.084755:0:77743:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3700c000 uarg=0000000000000000 10000000:01000000:1.0:1789304379.084815:0:77743:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304379.084838:0:77743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304379.084864:0:77743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295a9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295a96 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304379.084874:0:77743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304379.084913:0:77743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295a9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295a96 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304379.084924:0:77743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295a9d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295a96 expref: 18 pid: 5847 timeout: 1978 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304379.084936:0:77743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77743:1876219785595136:0@lo:104: 00000100:00100000:1.0:1789304379.085005:0:77743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304379.085231:0:77743:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03f48cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304379.085402:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785595136 00000100:00100000:0.0:1789304379.085410:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785595136 00000100:00100000:0.0:1789304379.085493:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789304379.085504:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:77743:x1876219785595136:12345-0@lo:104: 00010000:00010000:0.0:1789304379.085519:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304379.085626:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304379.085633:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:77743:x1876219785595136:12345-0@lo:104: Request processed in 131us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304379.085638:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789304379.086141:0:77743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77743:1876219785595136:0@lo:104: 00010000:00010000:1.0:1789304379.086161:0:77743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086273:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304379.086279:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086285:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304379.086288:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086295:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304379.086307:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304379.086313:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304379.086454:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304379.086460:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789304379.086511:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785595264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304379.086552:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304379.086615:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785595264 00000100:00100000:2.0:1789304379.086620:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785595264 00010000:00010000:2.0:1789304379.086641:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295a9d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a96 expref: 19 pid: 5847 timeout: 1978 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304379.086661:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789304379.086668:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785595264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304379.086680:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304379.086685:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295a9d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295a96 expref: 19 pid: 5847 timeout: 1978 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086705:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295a9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295a96 expref: 19 pid: 5847 timeout: 1978 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086718:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295a9d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295a96 expref: 19 pid: 5847 timeout: 1978 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086733:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086741:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086757:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086768:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086775:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086782:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086788:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304379.086792:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086800:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086816:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304379.086825:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304379.086875:0:77743:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304379.086884:0:77743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304379.086890:0:77743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8ea00/0xefc0bb7231295b06 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304379.087209:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304379.087215:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231295a96 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295a9d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304379.087228:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304379.087230:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304379.087231:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304379.096226:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785595264:12345-0@lo:103:ldlm_bl.0 Request processed in 9549us (9664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304379.096240:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789304379.098046:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785595264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304379.154502:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304379.154527:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785595392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304379.154594:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304379.154650:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785595392 00000100:00100000:1.0:1789304379.154659:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785595392 00000100:00080000:2.0:1789304379.154725:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304379.154751:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1789304379.154762:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785595392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304379.154798:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304379.154856:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785595392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304379.154863:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1789304379.154915:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785595392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304379.245121:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304379.245163:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304379.245330:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765494784 00000100:00100000:1.0:1789304379.245341:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765494784 00000100:00100000:1.0:1789304379.245388:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1077 00000100:00100000:1.0:1789304379.245396:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765494784:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304379.245462:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765494784:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 66us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304379.245469:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1077 00000100:00100000:1.0:1789304379.245497:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765494912 00000100:00100000:1.0:1789304379.245500:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765494912 00000100:00100000:1.0:1789304379.245524:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1285 00000100:00100000:1.0:1789304379.245529:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765494912:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304379.245557:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765494912:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304379.245562:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1285 00010000:00010000:3.0:1789304379.741537:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304380.141533:0:77791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc998d47e0 20000000:00000080:3.0:1789304380.141555:0:77791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c411ef400 uarg=0000000000000000 10000000:01000000:3.0:1789304380.141604:0:77791:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304380.141807:0:77791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.141828:0:77791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.141841:0:77791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.141848:0:77791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.141855:0:77791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.141862:0:77791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.141869:0:77791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304380.141873:0:77791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.141882:0:77791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.141896:0:77791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.141904:0:77791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.141916:0:77791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231295b0d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304380.178407:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785595520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304380.178490:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304380.179672:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785595520 00000100:00100000:0.0:1789304380.179697:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785595520 00000100:00100000:0.0:1789304380.179775:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:0.0:1789304380.179788:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785595520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304380.179828:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304380.179909:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785595520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304380.179917:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1789304380.179996:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785595520:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304380.181260:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789304380.289823:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967552 is committed 10000000:01000000:1.0:1789304380.440050:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304380.440061:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304380.440066:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304380.440131:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304380.440144:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304380.440156:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304380.440183:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785595648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304380.440254:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304380.440307:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0246d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789304380.440458:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785595648 00000100:00100000:2.0:1789304380.440467:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785595648 00000100:00100000:2.0:1789304380.440520:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1789304380.440531:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785595648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304380.440550:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304380.440567:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295b1b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295b14 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304380.440597:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295b1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295b14 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304380.440611:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295b1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295b14 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304380.440621:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd000, rc 0) 00000100:00100000:2.0:1789304380.440691:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785595648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304380.440698:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1789304380.440734:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785595648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304380.440756:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.440768:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304380.440793:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304380.440799:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.440807:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304380.755690:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304381.714473:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785595776:0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.714549:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304381.714632:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785596288:0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.714661:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304381.714702:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789304381.714709:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785595904:0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.714746:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304381.714765:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785596416:0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.714790:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304381.714818:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785596032:0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.714839:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304381.714858:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304381.714865:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785596160:0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.714883:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304381.714913:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785596288 00000100:00100000:3.0:1789304381.714921:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785596288 00000100:00100000:3.0:1789304381.714974:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785595904 00000100:00100000:3.0:1789304381.714977:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785595904 00000100:00100000:3.0:1789304381.714994:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785596160 00000100:00100000:3.0:1789304381.714997:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785596160 00000100:00100000:3.0:1789304381.715014:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:3.0:1789304381.715022:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785596288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.715078:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785596288:12345-0@lo:400:kworker.0 Request processed in 57us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304381.715085:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:3.0:1789304381.715127:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:3.0:1789304381.715133:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785595904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.715161:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785595904:12345-0@lo:400:kworker.0 Request processed in 29us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304381.715167:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:3.0:1789304381.715179:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:3.0:1789304381.715186:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785596160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.715218:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785596160:12345-0@lo:400:kworker.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304381.715224:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:3.0:1789304381.715247:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785596416 00000100:00100000:3.0:1789304381.715251:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785596416 00000100:00100000:3.0:1789304381.715278:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785596032 00000100:00100000:3.0:1789304381.715281:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785596032 00000100:00100000:3.0:1789304381.715299:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:3.0:1789304381.715305:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785596416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.715334:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785596416:12345-0@lo:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304381.715339:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:3.0:1789304381.715351:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:3.0:1789304381.715357:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785596032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.715385:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785596032:12345-0@lo:400:kworker.0 Request processed in 28us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304381.715391:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00080000:3.0:1789304381.715413:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304381.715418:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304381.715464:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785596160:0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.715475:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785596032:0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.715503:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785595904:0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.715511:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785596416:0@lo:400:kworker.0 00000100:00100000:3.0:1789304381.715519:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785596288:0@lo:400:kworker.0 00000100:00100000:1.0:1789304381.716238:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785595776 00000100:00100000:1.0:1789304381.716247:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785595776 00000100:00100000:1.0:1789304381.716297:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1789304381.716305:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785595776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304381.716358:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785595776:12345-0@lo:400:kworker.0 Request processed in 54us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304381.716365:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1789304381.716470:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785595776:0@lo:400:kworker.0 00010000:00010000:3.0:1789304381.780059:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304382.802381:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304383.649324:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304383.649434:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765495040 00000100:00100000:3.0:1789304383.649446:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765495040 00000100:00100000:3.0:1789304383.649524:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:3.0:1789304383.649534:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:5594:x1876219765495040:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789304383.649550:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304383.649577:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295adc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100268 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304383.649598:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:3.0:1789304383.649609:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304383.649666:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:5594:x1876219765495040:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 133us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304383.649673:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00080000:1.0:1789304383.651907:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304383.828964:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304384.274664:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785596544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304384.274751:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304384.274933:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785596544 00000100:00100000:1.0:1789304384.274943:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785596544 00000100:00100000:1.0:1789304384.275014:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1789304384.275025:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785596544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304384.275065:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304384.275144:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785596544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304384.275151:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1789304384.275204:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785596544:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304384.275318:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304384.357512:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304384.357680:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765495296 00000100:00100000:0.0:1789304384.357705:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765495296 00000100:00100000:0.0:1789304384.357777:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1289 00000100:00100000:0.0:1789304384.357787:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765495296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304384.357887:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765495296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 101us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304384.357895:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1289 00000100:00100000:2.0:1789304384.365041:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304384.371188:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765495168 00000100:00100000:1.0:1789304384.371201:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765495168 00000100:00100000:1.0:1789304384.371458:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1080 00000100:00100000:1.0:1789304384.371471:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765495168:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304384.371743:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765495168:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 273us (6715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304384.371751:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1080 00000100:00100000:0.0:1789304384.829012:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304384.829188:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765495424 00000100:00100000:3.0:1789304384.829199:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765495424 00000100:00100000:3.0:1789304384.829255:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 675 00000100:00100000:3.0:1789304384.829265:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:45209:x1876219765495424:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304384.829285:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304384.829316:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295b22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100276 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.829404:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295b29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.829419:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.829432:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304384.829468:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789304384.829472:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304384.829493:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.829515:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295b22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100276 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.829530:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295b29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100276 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.829539:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304384.829542:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304384.829546:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304384.829615:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:45209:x1876219765495424:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 350us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304384.829622:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 675 00000100:00100000:2.0:1789304384.839526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304384.839840:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765495552 00000100:00100000:1.0:1789304384.839851:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765495552 00000100:00100000:1.0:1789304384.840918:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 676 00000100:00100000:1.0:1789304384.840934:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:45209:x1876219765495552:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304384.840955:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304384.840979:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295b30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610027d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841062:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295b37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841081:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295b37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841111:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295b37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841131:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295b3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841139:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841145:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841491:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295b45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841502:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841509:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304384.841544:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:1.0:1789304384.841548:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304384.841568:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841592:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295b37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841601:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295b37 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841607:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295b37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841616:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304384.841622:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295b37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841629:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295b37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841648:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:1.0:1789304384.841651:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304384.841656:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295b37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841662:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295b37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841675:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295b3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841681:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295b3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841686:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295b3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841690:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304384.841862:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295b3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841871:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295b3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841883:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c14addf00) 00010000:00010000:1.0:1789304384.841885:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304384.841888:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295b3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841895:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295b3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841930:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295b30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610027d expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841945:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295b45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610027d expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.841952:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:1.0:1789304384.841954:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304384.841957:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8f400, rc 0) 00000100:00100000:1.0:1789304384.842054:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:45209:x1876219765495552:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 1125us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304384.842062:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 676 00000100:00100000:0.0:1789304384.847243:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304384.849773:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765495808 00000100:00100000:3.0:1789304384.849791:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765495808 00000100:00100000:3.0:1789304384.849891:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 677 00000100:00100000:3.0:1789304384.849904:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:45209:x1876219765495808:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304384.849974:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304384.850007:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295b45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610027d expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.850030:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:3.0:1789304384.850045:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304384.850083:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.850118:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.850130:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304384.859801:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304384.923134:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967553 is committed 00000004:00010000:3.0:1789304384.923240:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093833c66 reply state 0000000047564b67 transno 4294967553 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304384.923255:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304384.923270:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00080000:3.0:1789304384.923375:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304384.923481:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:45209:x1876219765495808:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 73491us (76160us total) trans 4294967553 rc 0/0 00000100:00100000:3.0:1789304384.923491:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 677 00010000:00010000:0.0:1789304384.923833:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304384.923844:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304384.923852:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304384.923859:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304384.923864:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304384.923872:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304384.923903:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:0.0:1789304384.923906:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304384.923912:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304384.923918:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295b4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304384.968412:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304384.968810:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765495936 00000100:00100000:3.0:1789304384.968821:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765495936 00000100:00100000:3.0:1789304384.968907:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 678 00000100:00100000:3.0:1789304384.968915:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:45213:x1876219765495936:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304384.968940:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304384.968960:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295b53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100284 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.969018:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295b5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.969032:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295b5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.969042:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295b5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.969053:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295b61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.969057:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.969061:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969517:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295b68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969524:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969537:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304384.969561:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:2.0:1789304384.969564:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304384.969676:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969709:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295b5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969718:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295b5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969726:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295b5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969733:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304384.969739:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295b5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969749:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295b5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969763:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:2.0:1789304384.969766:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304384.969772:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295b5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969777:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295b5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969791:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295b61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969797:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295b61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969804:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295b61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969810:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304384.969813:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295b61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969818:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295b61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969823:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c2ea19300) 00010000:00010000:2.0:1789304384.969825:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304384.969826:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295b61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969830:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295b61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969867:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295b53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100284 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969877:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100284 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.969883:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304384.969885:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304384.969887:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd200, rc 0) 00000100:00100000:2.0:1789304384.969962:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:45213:x1876219765495936:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1048us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304384.969968:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 678 00000100:00100000:3.0:1789304384.972458:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304384.975980:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765496192 00000100:00100000:0.0:1789304384.976001:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765496192 00000100:00100000:2.0:1789304384.976191:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 679 00000100:00100000:2.0:1789304384.976203:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:45213:x1876219765496192:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789304384.976402:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304384.976430:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295b6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610028b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.976828:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295b76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.976844:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295b76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.976857:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295b76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.976922:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.976930:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.976938:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789304384.977967:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15:0x0], index 0: 0 00010000:00010000:2.0:1789304384.978436:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295b84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978452:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978461:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978501:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295b76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978508:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295b76 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978514:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295b76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978520:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304384.978525:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295b76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978532:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295b76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978545:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304384.978548:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304384.978552:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295b76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978558:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295b76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304384.978572:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f254a92 reply state 00000000397df4c2 transno 4294967554 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304384.978581:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304384.978621:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295b6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610028b expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978656:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610028b expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.978663:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304384.978666:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304384.978668:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd600, rc 0) 00000100:00100000:2.0:1789304384.981613:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:45213:x1876219765496192:12345-192.168.202.29@tcp:101:touch.0 Request processed in 5397us (9149us total) trans 4294967554 rc 0/0 00000100:00100000:2.0:1789304384.981631:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 679 00000100:00100000:1.0:1789304384.986332:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:3.0:1789304384.986841:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.986855:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.986865:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.986877:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304384.986882:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.986960:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.986978:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c421d2800) 00010000:00010000:3.0:1789304384.986982:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304384.986987:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.986995:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295b7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304384.987136:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765496448 00000100:00100000:2.0:1789304384.987147:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765496448 00000100:00100000:2.0:1789304384.987216:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 680 00000100:00100000:2.0:1789304384.987233:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:45213:x1876219765496448:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:2.0:1789304384.987287:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304384.987303:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295b84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610028b expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.987311:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304384.987316:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304384.987352:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.987365:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304384.987374:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304384.987502:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047a2b003 reply state 00000000032bef88 transno 4294967555 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304384.987509:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304384.987602:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:45213:x1876219765496448:12345-192.168.202.29@tcp:36:touch.0 Request processed in 369us (1280us total) trans 4294967555 rc 0/0 00000100:00100000:2.0:1789304384.987609:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 680 00010000:00010000:3.0:1789304384.989428:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.989445:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.989453:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.989459:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304384.989464:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.989472:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.989491:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:3.0:1789304384.989494:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304384.989499:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.989504:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295b92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304384.990511:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304384.990773:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765496576 00000100:00100000:3.0:1789304384.990783:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765496576 00000100:00100000:3.0:1789304384.990848:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 681 00000100:00100000:3.0:1789304384.990859:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:45213:x1876219765496576:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304384.990882:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304384.991209:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295b99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100292 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.991276:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295b99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100292 expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.991290:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295b99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100292 expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304384.991312:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304384.991315:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789304384.991319:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789304384.991406:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:45213:x1876219765496576:12345-192.168.202.29@tcp:101:touch.0 Request processed in 548us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304384.991417:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 681 00000100:00100000:0.0:1789304384.994933:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304384.995002:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765496704 00000100:00100000:3.0:1789304384.995013:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765496704 00000100:00100000:3.0:1789304384.995061:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 363 00000100:00100000:3.0:1789304384.995068:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876219765496704:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:3.0:1789304384.995139:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1834 last 0 00000020:00000080:3.0:1789304384.995168:0:6691:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231295ba0 00002000:00100000:3.0:1789304384.995180:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c3f698800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789304384.995208:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789304384.995831:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789304384.995864:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2c3f69c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789304384.995996:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765496704:12345-192.168.202.29@tcp:8:touch.0 Request processed in 926us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304384.996004:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 363 00000100:00100000:0.0:1789304384.999562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304384.999682:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765496832 00000100:00100000:3.0:1789304384.999800:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765496832 00000100:00100000:3.0:1789304384.999925:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 364 00000100:00100000:3.0:1789304384.999936:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765496832:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:1.0:1789304385.000067:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304385.027952:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:0:x1876219765496832:12345-192.168.202.29@tcp:2:touch.0 Request processed in 28008us (28391us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789304385.027965:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 364 00000001:00080000:0.0:1789304385.028839:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967338 is committed 00000001:00100000:0.0:1789304385.028852:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:1.0:1789304385.030618:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304385.030810:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765497088 00000100:00100000:0.0:1789304385.030821:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765497088 00000100:00100000:0.0:1789304385.030895:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 72 00000100:00100000:0.0:1789304385.030907:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:45213:x1876219765497088:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:0.0:1789304385.031532:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:45213:x1876219765497088:12345-192.168.202.29@tcp:35:touch.0 Request processed in 625us (923us total) trans 4294967556 rc 0/0 00000100:00100000:0.0:1789304385.031541:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 72 00000100:00080000:1.0:1789304385.031603:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304385.082702:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304385.082816:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765497216 00000100:00100000:2.0:1789304385.082829:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765497216 00000100:00100000:2.0:1789304385.082893:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 682 00000100:00100000:2.0:1789304385.082905:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:45217:x1876219765497216:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304385.082937:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304385.082964:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295ba7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100299 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083036:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295bae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083052:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295bae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083064:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295bae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083079:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295bb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083086:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083139:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083255:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295bbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083263:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083270:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304385.083303:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 0 00000004:00200000:2.0:1789304385.083307:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304385.083325:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083337:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083345:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295bae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083351:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295bae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083358:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295bae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083364:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304385.083368:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295bae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083376:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295bae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083388:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304385.083391:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304385.083397:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295bae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083403:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295bae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083417:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083423:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083430:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083435:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304385.083438:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083444:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083450:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304385.083453:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304385.083455:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295bb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083465:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295bb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083493:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295ba7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100299 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083507:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100299 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.083514:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:2.0:1789304385.083517:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304385.083519:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd400, rc 0) 00000100:00100000:2.0:1789304385.083585:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:45217:x1876219765497216:12345-192.168.202.29@tcp:101:rm.0 Request processed in 683us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304385.083593:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 682 00000100:00100000:3.0:1789304385.087258:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304385.087416:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765497344 00000100:00100000:2.0:1789304385.087428:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765497344 00000100:00100000:2.0:1789304385.087485:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 365 00000100:00100000:2.0:1789304385.087495:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765497344:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304385.087515:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304385.087540:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f54809d8/0xefc0bb7231295bc3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002a0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304385.087571:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x6aa69e41, atime: 0x6aa69e41, ctime: 0x6aa69e41, blocks: 0x1 00010000:00010000:2.0:1789304385.087592:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=1834s v=(0 0) 00010000:00010000:2.0:1789304385.087596:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304385.087606:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f54809d8/0xefc0bb7231295bc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a0 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.087625:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f54809d8/0xefc0bb7231295bc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a0 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.087650:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc400, rc 0) 00000100:00100000:2.0:1789304385.087911:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765497344:12345-192.168.202.29@tcp:101:rm.0 Request processed in 416us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304385.087919:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 365 00000100:00100000:1.0:1789304385.091738:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304385.091827:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765497600 00000100:00100000:2.0:1789304385.091839:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765497600 00000100:00100000:2.0:1789304385.091902:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 683 00000100:00100000:2.0:1789304385.091912:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:45217:x1876219765497600:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304385.091968:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304385.091999:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295bbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100299 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092023:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231295b99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100292 expref: 11 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092035:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:2.0:1789304385.092048:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304385.092068:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295bca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092080:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295bca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092140:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295bca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092167:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092175:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092181:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092312:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295bd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092320:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295bd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092328:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295bd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304385.092914:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 64 off9536 00000004:00080000:2.0:1789304385.092926:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1834770834775ns, next at 1835770832215ns, rc = 0 00010000:00010000:2.0:1789304385.092985:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.092996:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093004:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093016:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093022:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093029:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093044:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304385.093063:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295bd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093069:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295bd8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093076:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295bd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093082:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304385.093088:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295bd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093126:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295bd8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093137:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:2.0:1789304385.093140:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304385.093144:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295bd8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093154:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295bd8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093173:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295bca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093179:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295bca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093185:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295bca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093190:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304385.093193:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295bca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093198:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295bca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093205:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304385.093208:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304385.093210:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295bca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304385.093215:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295bca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304385.093225:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8c8a441 reply state 00000000562e9b35 transno 4294967557 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304385.093234:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304385.093316:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:45217:x1876219765497600:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1404us (1588us total) trans 4294967557 rc 0/0 00000100:00100000:2.0:1789304385.093325:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 683 00010000:00010000:0.0:1789304385.093765:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304385.093773:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.093780:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304385.093784:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.093790:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.093806:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:0.0:1789304385.093808:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789304385.093811:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.093817:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295bdf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.093832:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304385.093834:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304385.093836:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304385.108535:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.108557:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.108565:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.108571:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304385.108576:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.108583:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.108598:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c421d2d00) 00010000:00010000:3.0:1789304385.108601:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304385.108606:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.108612:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295bd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304385.310972:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785596672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304385.311079:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304385.311834:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785596672 00000100:00100000:0.0:1789304385.311846:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785596672 00000100:00100000:0.0:1789304385.311925:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1789304385.311936:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785596672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304385.311962:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304385.312017:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785596672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304385.312025:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00080000:3.0:1789304385.312112:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304385.312241:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785596672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304385.875839:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304385.908555:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304385.908813:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765497728 00000100:00100000:3.0:1789304385.908824:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765497728 00000100:00100000:3.0:1789304385.908894:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 684 00000100:00100000:3.0:1789304385.908905:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:45232:x1876219765497728:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304385.908933:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304385.908955:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295be6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002a7 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.909030:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295bed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.909046:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.909058:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304385.909121:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:3.0:1789304385.909125:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304385.909147:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295bed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.909273:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295be6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a7 expref: 13 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.909295:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295bed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a7 expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.909302:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:3.0:1789304385.909305:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304385.909310:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ec00, rc 0) 00000100:00100000:3.0:1789304385.909372:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:45232:x1876219765497728:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 469us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304385.909378:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 684 00000100:00100000:1.0:1789304385.915438:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304385.915551:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765497984 00000100:00100000:3.0:1789304385.915561:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765497984 00000100:00100000:3.0:1789304385.915642:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 685 00000100:00100000:3.0:1789304385.915652:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:45232:x1876219765497984:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304385.915717:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304385.915744:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295bed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a7 expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.915765:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295b68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100284 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.915777:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:3.0:1789304385.915788:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304385.915813:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.915825:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.915835:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304385.966568:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ec7fbf4 reply state 0000000086077972 transno 4294967558 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304385.966606:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304385.966639:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000100:00100000:3.0:1789304385.966898:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:45232:x1876219765497984:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 51243us (51466us total) trans 4294967558 rc 0/0 00000100:00100000:3.0:1789304385.966908:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 685 00000001:00080000:2.0:1789304385.967136:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967556 is committed 00000001:00080000:2.0:1789304385.967150:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967557 is committed 00000004:00080000:2.0:1789304385.967155:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 54 committed 00000001:00080000:2.0:1789304385.967187:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967558 is committed 00010000:00010000:0.0:1789304385.970296:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.970316:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.970325:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.970332:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304385.970338:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.970346:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.970362:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:0.0:1789304385.970366:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304385.970371:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.970378:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295bf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304385.970912:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785596800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789304385.970979:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304385.971053:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785596800 00000100:00100000:3.0:1789304385.971062:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785596800 00000100:00100000:3.0:1789304385.971919:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1789304385.971932:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785596800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789304385.971962:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:21 count 1 00010000:00010000:3.0:1789304385.971987:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.972010:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f54809d8/0xefc0bb7231295bc3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a0 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.972020:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789304385.972024:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304385.972029:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.972060:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f54809d8/0xefc0bb7231295bc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a0 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304385.972075:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f54809d8/0xefc0bb7231295bc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a0 expref: 5 pid: 6693 timeout: 1935 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304385.972105:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785596928:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304385.972832:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c2e962e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789304385.978890:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304385.979510:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765498112 00000100:00100000:1.0:1789304385.979521:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765498112 00010000:00010000:1.0:1789304385.979568:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f54809d8/0xefc0bb7231295bc3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a0 expref: 6 pid: 6693 timeout: 1935 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304385.979623:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 355 00000100:00100000:1.0:1789304385.979643:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765498112:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304385.979659:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304385.979666:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f54809d8/0xefc0bb7231295bc3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a0 expref: 6 pid: 6693 timeout: 1935 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304385.979839:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f54809d8/0xefc0bb7231295bc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a0 expref: 6 pid: 6693 timeout: 1935 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304385.979869:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304385.979874:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304385.979880:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304385.979891:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304385.979912:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304385.979970:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765498112:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 329us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304385.979981:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 355 00010000:00010000:3.0:1789304385.983059:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f54809d8/0xefc0bb7231295bc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002a0 expref: 5 pid: 6693 timeout: 1935 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304385.983128:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785596928:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304385.983173:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.984542:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.984559:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.984583:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.984592:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304385.984646:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304385.984869:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304385.984878:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304385.984888:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304385.984892:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304385.984904:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304385.984933:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304385.984942:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231295bfb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304385.984968:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304385.984970:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304385.984972:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304385.986130:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785596800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14195us (15144us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1789304385.986142:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000004:00080000:1.0:1789304385.986387:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c385c6300/2, rc 0, transno 4294967339 00000100:00100000:1.0:1789304385.986395:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785596800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304386.044291:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304386.044369:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765498240 00000100:00100000:3.0:1789304386.044381:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765498240 00000100:00100000:3.0:1789304386.044444:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 686 00000100:00100000:3.0:1789304386.044455:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:45236:x1876219765498240:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304386.044482:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304386.044504:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295c02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002ae expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.044584:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.044601:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.044612:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.044636:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.044643:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.044650:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.044972:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295c17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.044981:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.044988:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304386.045018:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:3.0:1789304386.045022:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304386.045045:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045058:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045064:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045070:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045076:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304386.045080:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045112:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045125:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304386.045128:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304386.045133:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045139:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045150:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045156:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045162:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045167:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304386.045170:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045174:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045180:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304386.045183:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304386.045186:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045191:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045221:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295c02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ae expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045240:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ae expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.045247:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304386.045249:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304386.045251:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f600, rc 0) 00000100:00100000:3.0:1789304386.045316:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:45236:x1876219765498240:12345-192.168.202.29@tcp:101:touch.0 Request processed in 863us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304386.045324:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 686 00000100:00100000:0.0:1789304386.049175:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304386.049306:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765498496 00000100:00100000:1.0:1789304386.049319:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765498496 00000100:00100000:1.0:1789304386.049385:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 687 00000100:00100000:1.0:1789304386.049396:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:45236:x1876219765498496:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304386.049417:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304386.049445:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295c1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002b5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.050012:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.050030:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.050043:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.050062:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.050069:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.050076:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789304386.051970:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15:0x0], index 1: 0 00010000:00010000:1.0:1789304386.052553:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295c33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.052810:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.052830:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.052873:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.052881:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c25 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.052889:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.052895:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304386.052900:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.052907:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.052920:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:1.0:1789304386.052923:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304386.052929:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.052935:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304386.052949:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b22a21f reply state 000000000d2118f7 transno 4294967559 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304386.052958:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789304386.052995:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295c1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002b5 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.053017:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295c33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002b5 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.053025:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:1.0:1789304386.053027:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304386.053030:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e000, rc 0) 00000100:00100000:1.0:1789304386.053164:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:45236:x1876219765498496:12345-192.168.202.29@tcp:101:touch.0 Request processed in 3767us (4008us total) trans 4294967559 rc 0/0 00000100:00100000:1.0:1789304386.053175:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 687 00000100:00100000:2.0:1789304386.059004:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304386.059040:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765498752 00000100:00100000:2.0:1789304386.059050:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765498752 00000100:00100000:2.0:1789304386.059119:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 688 00000100:00100000:2.0:1789304386.059129:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:45236:x1876219765498752:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:2.0:1789304386.059185:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304386.059212:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295c33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002b5 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.059231:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:2.0:1789304386.059243:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304386.059288:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.059301:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.059312:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304386.059453:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b2abb70 reply state 00000000f437c3e4 transno 4294967560 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304386.059462:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304386.059546:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:45236:x1876219765498752:12345-192.168.202.29@tcp:36:touch.0 Request processed in 418us (553us total) trans 4294967560 rc 0/0 00000100:00100000:2.0:1789304386.059552:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 688 00010000:00010000:2.0:1789304386.063775:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.063794:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.063803:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.063809:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304386.063815:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.063824:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.063840:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304386.063843:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304386.063849:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.063855:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295c41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.064168:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.064177:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.064182:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.064187:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304386.064189:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.064195:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.064204:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c14addf00) 00010000:00010000:0.0:1789304386.064206:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304386.064210:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.064215:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295c2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304386.068021:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304386.068133:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765498880 00000100:00100000:1.0:1789304386.068144:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765498880 00000100:00100000:1.0:1789304386.068213:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 689 00000100:00100000:1.0:1789304386.068223:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:45236:x1876219765498880:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304386.068248:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304386.068271:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295c48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002bc expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.068329:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295c48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002bc expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.068342:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295c48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002bc expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.068361:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9e2c14add100) 00010000:00010000:1.0:1789304386.068365:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789304386.068369:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8ee00, rc 0) 00000100:00100000:1.0:1789304386.068424:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:45236:x1876219765498880:12345-192.168.202.29@tcp:101:touch.0 Request processed in 201us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304386.068431:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 689 00000100:00100000:2.0:1789304386.073972:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304386.074324:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765499008 00000100:00100000:3.0:1789304386.074337:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765499008 00000100:00100000:3.0:1789304386.074387:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 367 00000100:00100000:3.0:1789304386.074395:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876219765499008:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:3.0:1789304386.074429:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1835 last 0 00000020:00000080:3.0:1789304386.074466:0:6691:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231295c4f 00002000:00100000:3.0:1789304386.074479:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c3f69e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789304386.074503:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789304386.074973:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789304386.075006:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2c384bc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789304386.075178:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765499008:12345-192.168.202.29@tcp:8:touch.0 Request processed in 781us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304386.075188:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 367 00000100:00100000:2.0:1789304386.077994:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304386.082038:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765499136 00000100:00100000:3.0:1789304386.082056:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765499136 00000100:00100000:3.0:1789304386.082245:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 368 00000100:00100000:3.0:1789304386.082256:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765499136:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:1.0:1789304386.083053:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304386.158641:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:0:x1876219765499136:12345-192.168.202.29@tcp:2:touch.0 Request processed in 76358us (80628us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789304386.158655:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 368 00000001:00080000:1.0:1789304386.161460:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967338 is committed 00000001:00100000:1.0:1789304386.161481:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:3.0:1789304386.162328:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304386.162432:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765499392 00000100:00100000:2.0:1789304386.162445:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765499392 00000100:00100000:2.0:1789304386.162540:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 73 00000100:00100000:2.0:1789304386.162551:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:45236:x1876219765499392:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:2.0:1789304386.163064:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:45236:x1876219765499392:12345-192.168.202.29@tcp:35:touch.0 Request processed in 513us (741us total) trans 4294967561 rc 0/0 00000100:00100000:2.0:1789304386.163072:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 73 00000100:00100000:2.0:1789304386.214567:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304386.214998:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765499520 00000100:00100000:1.0:1789304386.215013:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765499520 00000100:00100000:3.0:1789304386.215592:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 690 00000100:00100000:3.0:1789304386.215608:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:45240:x1876219765499520:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304386.215643:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304386.215667:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295c56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002c3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.215853:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.215869:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.215883:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.215899:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.215906:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.215914:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216022:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295c6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216035:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216042:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304386.216086:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x39:0x0]: returning size 0 00000004:00200000:3.0:1789304386.216115:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304386.216139:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216153:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295c6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216474:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216480:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216487:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216493:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304386.216497:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216504:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216517:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304386.216521:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304386.216526:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216532:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295c5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216547:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216553:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216559:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216565:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304386.216568:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216574:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216580:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304386.216583:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304386.216586:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216591:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295c64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216641:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295c56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002c3 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216657:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295c6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002c3 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.216664:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9e2c14add100) 00010000:00010000:3.0:1789304386.216666:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304386.216668:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304386.216888:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:45240:x1876219765499520:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1283us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304386.216896:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 690 00000100:00100000:2.0:1789304386.220878:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304386.220961:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765499648 00000100:00100000:3.0:1789304386.220972:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765499648 00000100:00100000:3.0:1789304386.221035:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 369 00000100:00100000:3.0:1789304386.221047:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765499648:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304386.221071:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304386.221232:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231295c72 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002ca expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789304386.221264:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x6aa69e42, atime: 0x6aa69e42, ctime: 0x6aa69e42, blocks: 0x1 00010000:00010000:3.0:1789304386.221289:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=1835s v=(0 0) 00010000:00010000:3.0:1789304386.221295:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304386.221305:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231295c72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ca expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.221325:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231295c72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ca expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.221347:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304386.221491:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765499648:12345-192.168.202.29@tcp:101:rm.0 Request processed in 445us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304386.221499:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 369 00000100:00100000:0.0:1789304386.225867:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304386.226187:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765499904 00000100:00100000:2.0:1789304386.226200:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765499904 00000100:00100000:2.0:1789304386.226276:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 691 00000100:00100000:2.0:1789304386.226286:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:45240:x1876219765499904:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304386.226343:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304386.226372:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231295c6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002c3 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.226395:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295c48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002bc expref: 11 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.226405:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9e2c14add100) 00010000:00010000:2.0:1789304386.226417:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304386.226441:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295c79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.226455:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295c79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.226465:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295c79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.226483:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.226490:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.226496:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.226932:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295c87 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.226942:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295c87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.226950:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295c87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304386.227555:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 64 off9536 00000004:00080000:2.0:1789304386.227902:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1835905810322ns, next at 1836905474660ns, rc = 0 00010000:00010000:2.0:1789304386.227977:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.227990:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228000:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228007:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228013:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228019:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228087:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304386.228139:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295c87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228146:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295c87 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228152:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295c87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228171:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304386.228176:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295c87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228184:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295c87 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228197:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304386.228200:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304386.228206:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295c87 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228212:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295c87 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228235:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295c79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228240:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295c79 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228245:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295c79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228250:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304386.228253:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295c79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228259:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295c79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228266:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:2.0:1789304386.228268:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304386.228272:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295c79 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304386.228278:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295c79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304386.228288:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b6ce188 reply state 00000000627c8432 transno 4294967562 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304386.228303:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304386.228397:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:45240:x1876219765499904:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2110us (2829us total) trans 4294967562 rc 0/0 00000100:00100000:2.0:1789304386.228405:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 691 00010000:00010000:3.0:1789304386.233718:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.233736:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.233744:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.233751:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304386.233755:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.233763:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.233780:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c421d2600) 00010000:00010000:3.0:1789304386.233783:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304386.233788:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304386.233794:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295c80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.234306:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304386.234315:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.234321:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304386.234325:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.234333:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.234343:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:0.0:1789304386.234345:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789304386.234348:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304386.234353:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231295c8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304386.234426:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304386.234429:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304386.234431:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304386.834517:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785597184:0@lo:400:kworker.0 00000100:00100000:2.0:1789304386.834605:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304386.834730:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785597056:0@lo:400:kworker.0 00000100:00100000:3.0:1789304386.834767:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304386.834822:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785597056 00000100:00100000:3.0:1789304386.834830:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785597056 00000100:00100000:3.0:1789304386.834887:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:3.0:1789304386.834896:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785597056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304386.834947:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785597056:12345-0@lo:400:kworker.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304386.834955:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:3.0:1789304386.835008:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785597056:0@lo:400:kworker.0 00000100:00100000:3.0:1789304386.835286:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785597312:0@lo:400:kworker.0 00000100:00100000:3.0:1789304386.835314:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304386.839582:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785597184 00000100:00100000:3.0:1789304386.839598:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785597184 00000100:00100000:3.0:1789304386.839690:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1789304386.839700:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785597184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304386.839798:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785597184:12345-0@lo:400:kworker.0 Request processed in 99us (5193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304386.839806:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:0.0:1789304386.842134:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304386.842151:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785597440:0@lo:400:kworker.0 00000100:00100000:0.0:1789304386.842223:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304386.842287:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785597440 00000100:00100000:0.0:1789304386.842296:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785597440 00000100:00100000:0.0:1789304386.842352:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1789304386.842363:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785597440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304386.842417:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785597440:12345-0@lo:400:kworker.0 Request processed in 57us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304386.842424:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1789304386.842479:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785597440:0@lo:400:kworker.0 00000100:00100000:0.0:1789304386.842518:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785597568:0@lo:400:kworker.0 00000100:00100000:0.0:1789304386.842552:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304386.842599:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304386.842606:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785597696:0@lo:400:kworker.0 00000100:00100000:0.0:1789304386.842646:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304386.842673:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785597312 00000100:00100000:0.0:1789304386.842678:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785597312 00000100:00100000:0.0:1789304386.842705:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785597696 00000100:00100000:0.0:1789304386.842707:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785597696 00000100:00100000:0.0:1789304386.842730:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1789304386.842737:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785597312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304386.842772:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785597312:12345-0@lo:400:kworker.0 Request processed in 36us (7456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304386.842779:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1789304386.842791:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1789304386.842797:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785597696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304386.842823:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785597696:12345-0@lo:400:kworker.0 Request processed in 26us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304386.842828:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1789304386.842856:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785597696:0@lo:400:kworker.0 00000100:00100000:0.0:1789304386.842887:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785597312:0@lo:400:kworker.0 00000100:00080000:1.0:1789304386.843118:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304386.843123:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304386.843134:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785597568 00000100:00100000:1.0:1789304386.843138:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785597568 00000100:00100000:1.0:1789304386.843174:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1789304386.843182:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785597568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304386.843225:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785597568:12345-0@lo:400:kworker.0 Request processed in 44us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304386.843231:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1789304386.843260:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785597568:0@lo:400:kworker.0 00000100:00080000:0.0:1789304386.843375:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304386.843695:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785597184:0@lo:400:kworker.0 00010000:00010000:2.0:1789304386.898312:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304387.105945:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304387.106226:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765500032 00000100:00100000:1.0:1789304387.106237:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765500032 00000100:00100000:1.0:1789304387.106306:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 692 00000100:00100000:1.0:1789304387.106316:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:45255:x1876219765500032:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304387.106341:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304387.106363:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295c95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002d1 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.106430:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.106444:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.106455:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304387.106486:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:1.0:1789304387.106489:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304387.106508:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.106531:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295c95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002d1 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.106546:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002d1 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.106554:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:1.0:1789304387.106556:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304387.106560:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8fe00, rc 0) 00000100:00100000:1.0:1789304387.106613:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:45255:x1876219765500032:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 298us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304387.106632:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 692 00000100:00080000:3.0:1789304387.108922:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304387.109263:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304387.109351:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765500288 00000100:00100000:2.0:1789304387.109362:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765500288 00000100:00100000:2.0:1789304387.109450:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 693 00000100:00100000:2.0:1789304387.109461:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:45255:x1876219765500288:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:2.0:1789304387.109517:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304387.109547:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295c9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002d1 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.109568:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295c17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ae expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.109579:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:2.0:1789304387.109589:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304387.109631:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.109645:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.109657:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304387.109907:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed775190 reply state 000000006ea2317e transno 4294967563 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304387.109916:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789304387.109924:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000100:00100000:2.0:1789304387.110062:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:45255:x1876219765500288:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 601us (803us total) trans 4294967563 rc 0/0 00000100:00100000:2.0:1789304387.110068:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 693 00010000:00010000:0.0:1789304387.113824:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.113849:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.113857:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.113865:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304387.113871:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.113879:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.113897:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:0.0:1789304387.113900:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304387.113905:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.113912:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295ca3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304387.266308:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304387.266816:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765500416 00000100:00100000:0.0:1789304387.266827:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765500416 00000100:00100000:0.0:1789304387.266920:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 694 00000100:00100000:0.0:1789304387.266931:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:45267:x1876219765500416:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304387.267046:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:45267:x1876219765500416:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 117us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304387.267054:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 694 00000100:00100000:2.0:1789304387.272671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304387.277227:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765500544 00000100:00100000:0.0:1789304387.277245:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765500544 00000100:00100000:0.0:1789304387.277322:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 370 00000100:00100000:0.0:1789304387.277332:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:45267:x1876219765500544:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304387.277703:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:45267:x1876219765500544:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 372us (5053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304387.277711:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 370 00000100:00080000:3.0:1789304387.277826:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304387.283265:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304387.283317:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765500672 00000100:00100000:1.0:1789304387.283328:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765500672 00000100:00100000:1.0:1789304387.283386:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 371 00000100:00100000:1.0:1789304387.283396:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:45267:x1876219765500672:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304387.283804:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:45267:x1876219765500672:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 408us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304387.283812:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 371 00000100:00100000:1.0:1789304387.291492:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304387.291572:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765500800 00000100:00100000:2.0:1789304387.291583:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765500800 00000100:00100000:2.0:1789304387.291658:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 695 00000100:00100000:2.0:1789304387.291669:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:45267:x1876219765500800:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304387.292173:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:45267:x1876219765500800:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 503us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304387.292181:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 695 00000100:00100000:1.0:1789304387.296559:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304387.296670:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765500928 00000100:00100000:2.0:1789304387.296683:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765500928 00000100:00100000:2.0:1789304387.296782:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 696 00000100:00100000:2.0:1789304387.296804:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:45267:x1876219765500928:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304387.296919:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:45267:x1876219765500928:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 117us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304387.296931:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 696 00000100:00100000:3.0:1789304387.298784:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304387.298859:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765501056 00000100:00100000:0.0:1789304387.298869:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765501056 00000100:00100000:0.0:1789304387.298928:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 372 00000100:00100000:0.0:1789304387.298937:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:45267:x1876219765501056:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304387.299346:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:45267:x1876219765501056:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 410us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304387.299354:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 372 00000100:00100000:3.0:1789304387.303900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304387.304072:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765501184 00000100:00100000:1.0:1789304387.304086:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765501184 00000100:00100000:1.0:1789304387.304329:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 373 00000100:00100000:1.0:1789304387.304342:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:45267:x1876219765501184:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304387.304753:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:45267:x1876219765501184:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 412us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304387.304762:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 373 00000100:00100000:1.0:1789304387.308651:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304387.308774:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765501312 00000100:00100000:0.0:1789304387.308785:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765501312 00000100:00100000:0.0:1789304387.308854:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 697 00000100:00100000:0.0:1789304387.308864:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:45267:x1876219765501312:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304387.309635:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:45267:x1876219765501312:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 769us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304387.309644:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 697 00000100:00100000:3.0:1789304387.355776:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304387.355894:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765501440 00000100:00100000:1.0:1789304387.355905:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765501440 00000100:00100000:1.0:1789304387.355966:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 698 00000100:00100000:1.0:1789304387.355977:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:45271:x1876219765501440:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:1.0:1789304387.356003:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304387.356025:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295caa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002d8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356135:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295cb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356169:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356186:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356206:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295cb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356213:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356220:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356502:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295cbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356510:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356517:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304387.356549:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:1.0:1789304387.356553:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304387.356575:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356587:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356597:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295cb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356604:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356610:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304387.356628:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356636:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295cb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356650:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:1.0:1789304387.356653:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304387.356659:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295cb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356665:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295cb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356679:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356684:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295cb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356690:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356694:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304387.356697:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356703:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356709:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c14adde00) 00010000:00010000:1.0:1789304387.356712:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304387.356715:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295cb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356721:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295cb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356752:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295caa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002d8 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356767:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295cbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002d8 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.356774:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:1.0:1789304387.356776:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304387.356778:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e800, rc 0) 00000100:00100000:1.0:1789304387.356856:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:45271:x1876219765501440:12345-192.168.202.29@tcp:101:dd.0 Request processed in 881us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304387.356865:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 698 00000100:00100000:3.0:1789304387.359783:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304387.359892:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765501696 00000100:00100000:2.0:1789304387.359904:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765501696 00000100:00100000:2.0:1789304387.359970:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 699 00000100:00100000:2.0:1789304387.359980:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:45271:x1876219765501696:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:2.0:1789304387.360003:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304387.360023:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295cc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002df expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.360196:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295ccd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.360212:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295ccd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.360225:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295ccd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.360239:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.360246:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.360253:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789304387.360770:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16:0x0], index 0: 0 00010000:00010000:2.0:1789304387.360940:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295cdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.360952:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.360961:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295cdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.360998:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295ccd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.361006:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295ccd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.361014:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295ccd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.361021:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304387.361025:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295ccd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.361033:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295ccd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.361045:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:2.0:1789304387.361049:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304387.361054:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295ccd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.361060:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295ccd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304387.361074:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bfe3b31 reply state 0000000021f56643 transno 4294967564 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304387.361085:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304387.361145:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295cc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002df expref: 15 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.361162:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295cdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002df expref: 14 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.361170:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304387.361172:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304387.361174:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd200, rc 0) 00000100:00100000:2.0:1789304387.361257:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+15:45271:x1876219765501696:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1277us (1484us total) trans 4294967564 rc 0/0 00000100:00100000:2.0:1789304387.361264:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 699 00010000:00010000:0.0:1789304387.372511:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.372535:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.372543:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.372551:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304387.372555:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.372563:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.372581:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c421d2c00) 00010000:00010000:0.0:1789304387.372584:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304387.372590:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.372595:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295cd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304387.373622:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304387.373792:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765501824 00000100:00100000:0.0:1789304387.373803:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765501824 00000100:00100000:0.0:1789304387.374335:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 374 00000100:00100000:0.0:1789304387.374350:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:45271:x1876219765501824:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789304387.374372:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304387.374393:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231295ce9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002e6 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304387.374421:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789304387.374451:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=1837s v=(0 0) 00010000:00010000:0.0:1789304387.374456:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304387.374464:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231295ce9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002e6 expref: 6 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.374485:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231295ce9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002e6 expref: 6 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.374496:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afba00, rc 0) 00000100:00100000:0.0:1789304387.374561:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:45271:x1876219765501824:12345-192.168.202.29@tcp:101:dd.0 Request processed in 216us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304387.374567:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 374 00000100:00100000:3.0:1789304387.400999:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304387.401135:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765501952 00000100:00100000:2.0:1789304387.401148:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765501952 00002000:00100000:2.0:1789304387.401205:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (0->1048575) req@ffff9e2b02d80e00 x1876219765501952/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:453/0 lens 488/0 e 0 to 0 dl 1789304398 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304387.401217:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b02d80e00 with x1876219765501952 ext(0->1048575) 00002000:00010000:2.0:1789304387.401223:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2b02d80e00 00000100:00100000:2.0:1789304387.401256:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:2.0:1789304387.401266:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765501952:12345-192.168.202.29@tcp:4:dd.0 00000100:00100000:2.0:1789304387.416920:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765501952:12345-192.168.202.29@tcp:4:dd.0 Request processed in 15642us (15921us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789304387.416938:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 16 00002000:00100000:2.0:1789304387.416954:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (0->1048575) req@ffff9e2b02d80e00 x1876219765501952/t4294967340(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:453/0 lens 488/448 e 0 to 0 dl 1789304398 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304387.416965:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b02d80e00 with x1876219765501952 ext(0->1048575) 00002000:00010000:2.0:1789304387.416972:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2b02d80e00 00000100:00100000:0.0:1789304387.420245:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304387.420401:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765502080 00000100:00100000:2.0:1789304387.420413:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765502080 00000100:00100000:2.0:1789304387.420514:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 700 00000100:00100000:2.0:1789304387.420525:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+14:45271:x1876219765502080:12345-192.168.202.29@tcp:44:dd.0 00000001:00080000:1.0:1789304387.456310:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967559 is committed 00000001:00080000:1.0:1789304387.456332:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967564 is committed 00000004:00080000:1.0:1789304387.456341:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 61 committed 00000100:00100000:3.0:1789304387.456573:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304387.456594:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785597824:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789304387.456789:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304387.456898:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785597824 00000100:00100000:2.0:1789304387.456906:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785597824 00000100:00100000:2.0:1789304387.456954:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789304387.456963:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785597824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789304387.456992:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:21 count 1 00010000:00010000:2.0:1789304387.457021:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.457047:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231295c72 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ca expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.457057:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789304387.457062:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304387.457067:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.457120:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231295c72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ca expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.457141:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231295c72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ca expref: 5 pid: 6693 timeout: 1937 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304387.457153:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eaa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785597952:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789304387.457212:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c373ea0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304387.460577:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304387.460623:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765502208 00000100:00100000:2.0:1789304387.460633:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765502208 00010000:00010000:2.0:1789304387.460925:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231295c72 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ca expref: 6 pid: 6693 timeout: 1937 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304387.460965:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 356 00000100:00100000:2.0:1789304387.460976:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765502208:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304387.460993:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304387.460999:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231295c72 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ca expref: 6 pid: 6693 timeout: 1937 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.461014:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231295c72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ca expref: 6 pid: 6693 timeout: 1937 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.461044:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304387.461049:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304387.461055:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.461069:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304387.461111:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304387.461174:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765502208:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 199us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304387.461182:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 356 00000100:00100000:0.0:1789304387.462291:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:45271:x1876219765502080:12345-192.168.202.29@tcp:44:dd.0 Request processed in 41757us (42049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304387.462305:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 700 00010000:00010000:3.0:1789304387.462539:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231295c72 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ca expref: 5 pid: 6693 timeout: 1937 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304387.462558:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eaa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785597952:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304387.462581:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304387.462592:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304387.462599:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304387.462610:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304387.462630:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304387.462796:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789304387.463447:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785597824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6484us (6657us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1789304387.463456:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000004:00080000:3.0:1789304387.463510:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c41247100/2, rc 0, transno 4294967339 00000100:00100000:3.0:1789304387.463516:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785597824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789304387.465828:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304387.465903:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765502336 00000100:00100000:3.0:1789304387.465913:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765502336 00000100:00100000:3.0:1789304387.465977:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 376 00000100:00100000:3.0:1789304387.465988:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765502336:12345-192.168.202.29@tcp:16:dd.0 00010000:00010000:1.0:1789304387.466328:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304387.466339:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.466354:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304387.466359:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.466370:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.466393:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304387.466401:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb7231295cf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304387.466479:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304387.466482:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304387.466484:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304387.496590:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00000001:00080000:1.0:1789304387.496610:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00000100:00100000:0.0:1789304387.496953:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765502336:12345-192.168.202.29@tcp:16:dd.0 Request processed in 30960us (31127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304387.496966:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 376 00000100:00100000:3.0:1789304387.499404:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304387.499511:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765502592 00000100:00100000:0.0:1789304387.499522:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765502592 00000100:00100000:0.0:1789304387.499603:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 74 00000100:00100000:0.0:1789304387.499624:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:45271:x1876219765502592:12345-192.168.202.29@tcp:35:dd.0 00000100:00100000:0.0:1789304387.500153:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:45271:x1876219765502592:12345-192.168.202.29@tcp:35:dd.0 Request processed in 538us (757us total) trans 4294967565 rc 0/0 00000100:00100000:0.0:1789304387.500161:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 74 00010000:00010000:1.0:1789304387.926044:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304388.813148:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967565 is committed 00010000:00010000:2.0:1789304388.949147:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304389.394548:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785598080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304389.394674:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304389.394767:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785598080 00000100:00100000:1.0:1789304389.394777:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785598080 00000100:00100000:1.0:1789304389.394853:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1789304389.394863:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785598080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304389.394906:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304389.394961:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785598080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304389.394969:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1789304389.395023:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785598080:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304389.395464:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304389.474519:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304389.474680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304389.474722:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304389.474754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304389.474785:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765502720 00000100:00100000:3.0:1789304389.474795:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765502720 00000100:00100000:1.0:1789304389.476153:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765503104 00000100:00100000:1.0:1789304389.476170:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765503104 00000100:00100000:1.0:1789304389.476260:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765502976 00000100:00100000:1.0:1789304389.476264:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765502976 00000100:00100000:1.0:1789304389.476294:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 945 00000100:00100000:1.0:1789304389.476305:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765503104:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304389.476395:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765503104:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304389.476403:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 945 00000100:00100000:1.0:1789304389.476436:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 946 00000100:00100000:1.0:1789304389.476444:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765502976:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304389.476472:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765502976:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304389.476478:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 946 00000100:00080000:0.0:1789304389.476822:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304389.476828:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304389.476980:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1082 00000100:00100000:3.0:1789304389.476988:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765502720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304389.477020:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765502720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304389.477026:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1082 00000100:00100000:2.0:1789304389.481560:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765502848 00000100:00100000:2.0:1789304389.481577:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765502848 00000100:00080000:0.0:1789304389.481791:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304389.481923:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1293 00000100:00100000:2.0:1789304389.481936:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765502848:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304389.482054:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765502848:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 121us (7545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304389.482061:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1293 00010000:00010000:0.0:1789304389.971196:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304390.032070:0:78183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1839709975924ns, next at 1835770832215ns, rc = 0 00000004:00080000:3.0:1789304390.032318:0:78183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1839710226828ns, next at 1836905474660ns, rc = 0 00000004:00080000:1.0:1789304390.036041:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 62 committed 00000004:00080000:1.0:1789304390.036065:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 55 committed 00000100:00100000:1.0:1789304390.418418:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785598208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304390.418496:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304390.418928:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785598208 00000100:00100000:0.0:1789304390.418938:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785598208 00000100:00100000:0.0:1789304390.419003:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1789304390.419014:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785598208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304390.419058:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789304390.419149:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785598208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304390.419155:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1789304390.419450:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:2.0:1789304390.419457:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c385c6300, transno 4294967339 00000100:00080000:3.0:1789304390.419474:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304390.419481:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785598208:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304390.994319:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304391.318007:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967339 is committed 00000100:00100000:2.0:1789304391.461992:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304391.466996:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765503232 00000100:00100000:1.0:1789304391.467013:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765503232 00000100:00100000:1.0:1789304391.467158:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 701 00000100:00100000:1.0:1789304391.467171:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:45463:x1876219765503232:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304391.467272:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:45463:x1876219765503232:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 104us (5290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304391.467280:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 701 00000100:00080000:0.0:1789304391.470241:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304391.475844:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304391.479139:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765503360 00000100:00100000:1.0:1789304391.479166:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765503360 00000100:00100000:1.0:1789304391.479246:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 377 00000100:00100000:1.0:1789304391.479257:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:45463:x1876219765503360:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304391.485215:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:45463:x1876219765503360:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 5953us (9379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304391.485227:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 377 00000100:00080000:1.0:1789304391.485265:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304391.491387:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304391.492616:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765503488 00000100:00100000:1.0:1789304391.493671:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765503488 00000100:00100000:1.0:1789304391.493744:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 378 00000100:00100000:1.0:1789304391.493757:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45463:x1876219765503488:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304391.494140:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45463:x1876219765503488:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 385us (3279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304391.494148:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 378 00000100:00080000:1.0:1789304391.494176:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304391.500443:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304391.500823:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765503616 00000100:00100000:0.0:1789304391.500837:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765503616 00000100:00100000:0.0:1789304391.500910:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 702 00000100:00100000:0.0:1789304391.500922:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:45463:x1876219765503616:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304391.501441:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:45463:x1876219765503616:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 519us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304391.501451:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 702 00000100:00100000:2.0:1789304391.507034:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304391.507771:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765503744 00000100:00100000:0.0:1789304391.507782:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765503744 00000100:00100000:0.0:1789304391.507843:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 703 00000100:00100000:0.0:1789304391.507855:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:45463:x1876219765503744:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304391.507962:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:45463:x1876219765503744:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 108us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304391.507970:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 703 00000100:00100000:1.0:1789304391.510951:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304391.511033:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765503872 00000100:00100000:3.0:1789304391.511043:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765503872 00000100:00100000:3.0:1789304391.511123:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 379 00000100:00100000:3.0:1789304391.511134:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:45463:x1876219765503872:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304391.511547:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:45463:x1876219765503872:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 414us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304391.511555:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 379 00000100:00100000:3.0:1789304391.515059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304391.515176:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765504000 00000100:00100000:1.0:1789304391.515187:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765504000 00000100:00100000:1.0:1789304391.515250:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 380 00000100:00100000:1.0:1789304391.515259:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45463:x1876219765504000:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304391.515645:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45463:x1876219765504000:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 386us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304391.515662:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 380 00000100:00100000:2.0:1789304391.521440:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304391.521511:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765504128 00000100:00100000:3.0:1789304391.521522:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765504128 00000100:00100000:3.0:1789304391.521757:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 704 00000100:00100000:3.0:1789304391.521769:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:45463:x1876219765504128:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304391.522571:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:45463:x1876219765504128:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 801us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304391.522589:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 704 00000100:00100000:1.0:1789304391.604288:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304391.604907:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765504384 00000100:00100000:2.0:1789304391.604923:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765504384 00000100:00100000:2.0:1789304391.605072:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 705 00000100:00100000:2.0:1789304391.605085:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:45467:x1876219765504384:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304391.605200:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304391.605236:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295cdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002df expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.605262:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304391.605276:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304391.605303:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295cf7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.605318:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.605401:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.605419:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.605426:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.605431:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.607029:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295d05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.607049:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295d05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.607060:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295d05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304391.609447:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].22, 64 off9600 00000004:00080000:3.0:1789304391.609465:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1841287373526ns, next at 1842287370207ns, rc = 0 00010000:00010000:3.0:1789304391.609856:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.609877:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.609888:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.609898:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.609904:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.609911:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.609987:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304391.610017:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295d05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610024:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295d05 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610030:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295d05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610035:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304391.610040:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295d05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610049:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295d05 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610062:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:3.0:1789304391.610065:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304391.610070:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295d05 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610080:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295d05 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610126:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610132:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295cf7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610137:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295cf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610142:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304391.610144:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295cf7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610150:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295cf7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610159:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:3.0:1789304391.610161:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304391.610164:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295cf7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304391.610169:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295cf7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304391.610183:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b960b262 reply state 0000000084786157 transno 4294967566 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304391.610193:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304391.610308:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:45467:x1876219765504384:12345-192.168.202.29@tcp:36:rm.0 Request processed in 5222us (6029us total) trans 4294967566 rc 0/0 00000100:00100000:3.0:1789304391.610318:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 705 00010000:00010000:0.0:1789304391.612470:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304391.612486:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304391.612494:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304391.612500:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304391.612504:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304391.612512:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304391.612528:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c421d2100) 00010000:00010000:0.0:1789304391.612531:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304391.612546:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304391.612552:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295cfe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.612986:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304391.612997:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.613004:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304391.613008:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.613014:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.613026:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:2.0:1789304391.613029:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789304391.613032:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.613038:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295d0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304391.613054:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304391.613056:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304391.613058:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304391.955760:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785598592:0@lo:400:kworker.0 00000100:00100000:1.0:1789304391.955837:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304391.955842:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785598464:0@lo:400:kworker.0 00000100:00100000:2.0:1789304391.955892:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304391.955920:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785598976:0@lo:400:kworker.0 00000100:00100000:1.0:1789304391.955921:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304391.955933:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785598720:0@lo:400:kworker.0 00000100:00100000:2.0:1789304391.955948:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304391.955971:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304391.955973:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789304391.955982:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785598336:0@lo:400:kworker.0 00000100:00100000:2.0:1789304391.956017:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304391.956020:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785598592 00000100:00100000:1.0:1789304391.956030:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785598592 00000100:00100000:2.0:1789304391.956044:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785598848:0@lo:400:kworker.0 00000100:00100000:2.0:1789304391.956067:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304391.956294:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785598464 00000100:00100000:3.0:1789304391.956300:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785598464 00000100:00100000:3.0:1789304391.956332:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785598720 00000100:00100000:3.0:1789304391.956335:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785598720 00000100:00100000:2.0:1789304391.956368:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785598848 00000100:00100000:2.0:1789304391.956373:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785598848 00000100:00100000:3.0:1789304391.956375:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1789304391.956388:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785598464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304391.956406:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1789304391.956415:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785598720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304391.956453:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785598464:12345-0@lo:400:kworker.0 Request processed in 68us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304391.956462:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:2.0:1789304391.956479:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785598720:12345-0@lo:400:kworker.0 Request processed in 64us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304391.956486:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1789304391.956495:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785598848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304391.956496:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1789304391.956531:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785598848:12345-0@lo:400:kworker.0 Request processed in 38us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304391.956537:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1789304391.956587:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785598848:0@lo:400:kworker.0 00000100:00100000:3.0:1789304391.956599:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785598464:0@lo:400:kworker.0 00000100:00100000:1.0:1789304391.958763:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785598976 00000100:00100000:1.0:1789304391.958777:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785598976 00000100:00100000:1.0:1789304391.959850:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1789304391.959869:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785598592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304391.959966:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785598592:12345-0@lo:400:kworker.0 Request processed in 105us (4130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304391.959973:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1789304391.959991:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1789304391.959997:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785598976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304391.960037:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785598976:12345-0@lo:400:kworker.0 Request processed in 41us (4090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304391.960043:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1789304391.962170:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:2.0:1789304391.962186:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c41247100, transno 4294967339 00000100:00100000:2.0:1789304391.962216:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785598976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304391.963412:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785598336 00000100:00100000:0.0:1789304391.963427:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785598336 00000100:00100000:0.0:1789304391.963497:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1789304391.963507:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785598336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304391.963635:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785598336:12345-0@lo:400:kworker.0 Request processed in 130us (7618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304391.963643:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00080000:0.0:1789304391.963699:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304391.963713:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304391.963758:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785598720:0@lo:400:kworker.0 00000100:00100000:0.0:1789304391.963775:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785598592:0@lo:400:kworker.0 00000100:00100000:3.0:1789304391.964258:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785598336:0@lo:400:kworker.0 00010000:00010000:3.0:1789304392.021893:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304393.049588:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304393.856999:0:78331:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1843534905162ns, next at 1842287370207ns, rc = 0 00000004:00080000:3.0:1789304393.906516:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 57 committed 00000001:00080000:3.0:1789304393.906541:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967566 is committed 00000004:00080000:3.0:1789304393.906545:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 56 committed 00000100:00100000:3.0:1789304393.906753:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304393.906775:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785599104:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789304393.906852:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304393.906930:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785599104 00000100:00100000:3.0:1789304393.906938:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785599104 00000100:00100000:3.0:1789304393.906999:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789304393.907009:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785599104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789304393.907038:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:22 count 1 00010000:00010000:3.0:1789304393.907065:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304393.907087:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231295ce9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002e6 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304393.907122:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x16:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1789304393.907127:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304393.907131:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304393.907160:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231295ce9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002e6 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304393.907173:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231295ce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002e6 expref: 5 pid: 17212 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304393.907317:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785599232:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304393.907383:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c11b8b300 going to sleep for 11 seconds 00000100:00080000:0.0:1789304393.907807:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304393.912002:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304393.912063:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785599232:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304393.912121:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304393.912225:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765504512 00000100:00100000:2.0:1789304393.912235:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765504512 00010000:00010000:2.0:1789304393.912299:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231295ce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002e6 expref: 6 pid: 17212 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304393.912338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 357 00000100:00100000:2.0:1789304393.912348:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765504512:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304393.912363:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304393.912369:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231295ce9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002e6 expref: 6 pid: 17212 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304393.912383:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231295ce9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002e6 expref: 6 pid: 17212 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304393.912421:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231295ce9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002e6 expref: 6 pid: 17212 timeout: 1943 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304393.912784:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304393.912790:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304393.912798:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304393.912810:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304393.912847:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304393.912899:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765504512:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 551us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304393.912907:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 357 00010000:00010000:1.0:1789304393.912999:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304393.913087:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304393.913134:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304393.913142:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304393.913158:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789304393.913497:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304393.913580:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304393.913587:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304393.913605:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304393.913611:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304393.913622:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304393.913639:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304393.913647:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231295d13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304393.913671:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304393.913672:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304393.913674:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304393.916222:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785599104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9207us (9362us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789304393.916361:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000004:00080000:3.0:1789304393.919001:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b02d80700/2, rc 0, transno 4294967341 00000100:00100000:3.0:1789304393.919022:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785599104:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789304393.919424:0:78331:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1843597331758ns, next at 1836905474660ns, rc = 0 00000004:00080000:2.0:1789304393.930146:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 63 committed 00010000:00010000:3.0:1789304394.071184:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304394.515321:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304394.515345:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785599360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304394.515428:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304394.515585:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785599360 00000100:00100000:1.0:1789304394.515595:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785599360 00000100:00100000:1.0:1789304394.515652:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1789304394.515662:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785599360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304394.515696:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304394.515743:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785599360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304394.515763:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1789304394.515808:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785599360:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304394.515984:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304394.601195:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304394.601303:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304394.601331:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304394.601370:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304394.601405:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765504768 00000100:00100000:1.0:1789304394.601415:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765504768 00000100:00100000:1.0:1789304394.601478:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1297 00000100:00100000:1.0:1789304394.601489:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765504768:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304394.601583:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765504768:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304394.601591:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1297 00000100:00100000:1.0:1789304394.601617:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765504896 00000100:00100000:1.0:1789304394.601621:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765504896 00000100:00100000:1.0:1789304394.601645:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765505024 00000100:00100000:1.0:1789304394.601649:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765505024 00000100:00100000:1.0:1789304394.601670:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 949 00000100:00100000:1.0:1789304394.601676:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765504896:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304394.601719:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765504896:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 43us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304394.601726:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 949 00000100:00100000:1.0:1789304394.601737:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 950 00000100:00100000:1.0:1789304394.601760:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765505024:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304394.601786:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765505024:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 43us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304394.601790:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 950 00000100:00080000:1.0:1789304394.601966:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304394.601971:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304394.610240:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765504640 00000100:00100000:0.0:1789304394.610260:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765504640 00000100:00100000:0.0:1789304394.610333:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1084 00000100:00100000:0.0:1789304394.610353:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765504640:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304394.610450:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765504640:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 107us (9266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304394.610458:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1084 00010000:00010000:2.0:1789304395.098000:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304395.538582:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785599488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304395.538685:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304395.539219:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785599488 00000100:00100000:1.0:1789304395.539230:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785599488 00000100:00100000:1.0:1789304395.539304:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:1.0:1789304395.539316:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785599488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304395.539355:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789304395.539413:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785599488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304395.539420:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00080000:2.0:1789304395.539840:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304395.539938:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785599488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304396.114333:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304396.675913:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00000100:00100000:3.0:1789304397.079249:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785599616:0@lo:400:kworker.0 00000100:00100000:3.0:1789304397.079326:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304397.079481:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785599616 00000100:00100000:0.0:1789304397.079490:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785599616 00000100:00100000:0.0:1789304397.079561:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:0.0:1789304397.079571:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785599616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.079612:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785599744:0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.079675:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304397.079703:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304397.079709:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785599872:0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.079733:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304397.079762:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785599872 00000100:00100000:1.0:1789304397.079766:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785599872 00000100:00100000:1.0:1789304397.079803:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:1.0:1789304397.079810:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785599872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.079844:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785599872:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304397.079851:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00080000:1.0:1789304397.079872:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304397.079897:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:1.0:1789304397.079903:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b02d80700, transno 4294967341 00000100:00100000:1.0:1789304397.079916:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785599872:0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.081886:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785600256:0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.082016:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304397.082363:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785600256 00000100:00100000:1.0:1789304397.082372:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785600256 00000100:00100000:1.0:1789304397.082483:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1789304397.082494:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785600256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.082562:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785600256:12345-0@lo:400:kworker.0 Request processed in 71us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304397.082570:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1789304397.082614:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785600256:0@lo:400:kworker.0 00000100:00080000:2.0:1789304397.083581:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304397.086182:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785600000:0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.086257:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304397.086302:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304397.086309:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785600128:0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.086332:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304397.086763:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785599744 00000100:00100000:2.0:1789304397.086774:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785599744 00000100:00100000:2.0:1789304397.086965:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785600000 00000100:00100000:2.0:1789304397.086969:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785600000 00000100:00100000:1.0:1789304397.087666:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785600128 00000100:00100000:1.0:1789304397.087672:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785600128 00000100:00100000:1.0:1789304397.087711:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1789304397.087722:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785599744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.087805:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785599744:12345-0@lo:400:kworker.0 Request processed in 85us (8129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304397.087812:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1789304397.087832:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1789304397.087838:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785600000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.087877:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785600000:12345-0@lo:400:kworker.0 Request processed in 38us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304397.087882:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:1.0:1789304397.087895:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1789304397.087900:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785600128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.087930:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785600128:12345-0@lo:400:kworker.0 Request processed in 30us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304397.087936:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1789304397.088402:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785600128:0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.088416:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785600000:0@lo:400:kworker.0 00000100:00100000:0.0:1789304397.088662:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785599616:12345-0@lo:400:kworker.0 Request processed in 9091us (9334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304397.088672:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1789304397.088917:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785599616:0@lo:400:kworker.0 00000100:00100000:1.0:1789304397.089429:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785599744:0@lo:400:kworker.0 00000100:00080000:2.0:1789304397.089811:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304397.140111:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304398.162914:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304399.186371:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304399.634303:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304399.634330:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785600384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304399.634400:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304399.634580:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785600384 00000100:00100000:1.0:1789304399.634588:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785600384 00000100:00080000:3.0:1789304399.634746:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304399.634770:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:1.0:1789304399.634783:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785600384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304399.634821:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304399.634927:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785600384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304399.634935:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1789304399.642012:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785600384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304399.715236:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304399.715275:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304399.715314:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304399.715346:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304399.715379:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765505408 00000100:00100000:1.0:1789304399.715388:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765505408 00000100:00100000:1.0:1789304399.715446:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765505536 00000100:00100000:1.0:1789304399.715450:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765505536 00000100:00100000:1.0:1789304399.715472:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 953 00000100:00100000:1.0:1789304399.715482:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765505408:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304399.715581:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765505408:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 100us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304399.715590:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 953 00000100:00100000:1.0:1789304399.715609:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 954 00000100:00100000:1.0:1789304399.715616:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765505536:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304399.715641:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765505536:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304399.715646:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 954 00000100:00080000:1.0:1789304399.716072:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304399.716078:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304399.716184:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765505152 00000100:00100000:3.0:1789304399.716191:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765505152 00000100:00100000:3.0:1789304399.716233:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1086 00000100:00100000:3.0:1789304399.716242:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765505152:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304399.716278:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765505152:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304399.716286:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1086 00000100:00100000:0.0:1789304399.716595:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765505280 00000100:00100000:0.0:1789304399.716600:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765505280 00000100:00100000:0.0:1789304399.716655:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1301 00000100:00100000:0.0:1789304399.716676:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765505280:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304399.716708:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765505280:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 35us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304399.716714:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1301 00000100:00080000:3.0:1789304399.717039:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304400.210415:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304400.658406:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304400.658431:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785600512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304400.658512:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304400.658656:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785600512 00000100:00100000:0.0:1789304400.658666:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785600512 00000100:00100000:0.0:1789304400.658939:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1789304400.658952:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785600512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304400.658985:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304400.659145:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785600512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304400.659152:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00080000:3.0:1789304400.659222:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304400.659487:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785600512:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304401.234368:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304402.194841:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785600896:0@lo:400:kworker.0 00000100:00100000:1.0:1789304402.194920:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304402.194998:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789304402.195004:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785600768:0@lo:400:kworker.0 00000100:00100000:1.0:1789304402.195029:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304402.195046:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785601280:0@lo:400:kworker.0 00000100:00100000:1.0:1789304402.195067:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304402.195126:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785600896 00000100:00100000:1.0:1789304402.195135:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785600896 00000100:00100000:1.0:1789304402.195201:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785601280 00000100:00100000:1.0:1789304402.195205:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785601280 00000100:00100000:1.0:1789304402.195294:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1789304402.195304:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785600896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304402.195424:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785600896:12345-0@lo:400:kworker.0 Request processed in 121us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304402.195432:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1789304402.195450:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1789304402.195456:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785601280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304402.195496:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785601280:12345-0@lo:400:kworker.0 Request processed in 40us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304402.195502:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1789304402.195713:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785600768 00000100:00100000:1.0:1789304402.195717:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785600768 00000100:00100000:1.0:1789304402.195753:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:1.0:1789304402.195760:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785600768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304402.195792:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785600768:12345-0@lo:400:kworker.0 Request processed in 33us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304402.195798:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00080000:1.0:1789304402.195817:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304402.195821:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304402.195875:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785600768:0@lo:400:kworker.0 00000100:00100000:1.0:1789304402.195886:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785601280:0@lo:400:kworker.0 00000100:00100000:1.0:1789304402.195896:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785600896:0@lo:400:kworker.0 00000100:00100000:3.0:1789304402.195998:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785600640:0@lo:400:kworker.0 00000100:00100000:3.0:1789304402.196034:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304402.196069:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785601152:0@lo:400:kworker.0 00000100:00100000:3.0:1789304402.196111:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304402.196129:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304402.196135:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785601024:0@lo:400:kworker.0 00000100:00100000:3.0:1789304402.196156:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304402.196195:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785601152 00000100:00100000:3.0:1789304402.196199:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785601152 00000100:00100000:3.0:1789304402.196237:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785601024 00000100:00100000:3.0:1789304402.196240:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785601024 00000100:00100000:3.0:1789304402.196262:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1789304402.196268:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785601152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304402.196305:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785601152:12345-0@lo:400:kworker.0 Request processed in 36us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304402.196312:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:3.0:1789304402.196324:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1789304402.196330:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785601024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304402.196537:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785601024:12345-0@lo:400:kworker.0 Request processed in 207us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304402.196545:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1789304402.196581:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785601024:0@lo:400:kworker.0 00000100:00100000:3.0:1789304402.196591:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785601152:0@lo:400:kworker.0 00000100:00100000:1.0:1789304402.196872:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785600640 00000100:00100000:1.0:1789304402.196876:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785600640 00000100:00100000:1.0:1789304402.196914:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1789304402.196921:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785600640:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789304402.198984:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304402.199733:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785600640:12345-0@lo:400:kworker.0 Request processed in 2805us (3691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304402.199749:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1789304402.200377:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785600640:0@lo:400:kworker.0 00010000:00010000:3.0:1789304402.258341:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304403.282340:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304404.306594:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304404.754413:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785601408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304404.754512:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304404.755523:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785601408 00000100:00100000:1.0:1789304404.755535:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785601408 00000100:00100000:1.0:1789304404.755614:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1789304404.755623:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785601408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304404.755663:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304404.755896:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785601408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 273us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304404.755905:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00080000:0.0:1789304404.755970:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304404.756194:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785601408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304404.835602:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304404.835649:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304404.835691:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304404.835726:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304404.835923:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765505664 00000100:00100000:0.0:1789304404.835938:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765505664 00000100:00100000:0.0:1789304404.835992:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1088 00000100:00100000:0.0:1789304404.836002:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765505664:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304404.836087:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765505664:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304404.836116:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1088 00000100:00100000:2.0:1789304404.836592:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765505792 00000100:00100000:2.0:1789304404.836598:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765505792 00000100:00100000:2.0:1789304404.836668:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1305 00000100:00100000:2.0:1789304404.836677:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765505792:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304404.836721:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765505792:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 46us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304404.836727:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1305 00000100:00100000:3.0:1789304404.836998:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765506048 00000100:00100000:3.0:1789304404.837004:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765506048 00000100:00100000:3.0:1789304404.837044:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765505920 00000100:00100000:3.0:1789304404.837048:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765505920 00000100:00100000:3.0:1789304404.837071:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 957 00000100:00100000:3.0:1789304404.837078:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765506048:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304404.837163:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 958 00000100:00100000:1.0:1789304404.837172:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765505920:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304404.837218:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765505920:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 48us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304404.837225:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 958 00000100:00080000:0.0:1789304404.837604:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304404.837610:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304404.837613:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304404.837719:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765506048:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 640us (2068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304404.837726:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 957 00010000:00010000:3.0:1789304405.330615:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304405.778728:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304405.778769:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785601536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304405.778867:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304405.778923:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785601536 00000100:00100000:3.0:1789304405.778934:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785601536 00000100:00080000:0.0:1789304405.778973:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304405.778994:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1789304405.779005:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785601536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304405.779041:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304405.779124:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785601536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304405.779132:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1789304405.779285:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785601536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304406.354958:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304407.316918:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785601920:0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317005:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304407.317083:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789304407.317111:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785601792:0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317138:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304407.317164:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785602304:0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317185:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304407.317215:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785601792 00000100:00100000:3.0:1789304407.317223:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785601792 00000100:00100000:3.0:1789304407.317270:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:3.0:1789304407.317279:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785601792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317330:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785601792:12345-0@lo:400:kworker.0 Request processed in 52us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304407.317337:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:3.0:1789304407.317385:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785601792:0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317412:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785601664:0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317454:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304407.317488:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785602176:0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317510:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304407.317530:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304407.317536:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785602048:0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317556:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304407.317581:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785601664 00000100:00100000:3.0:1789304407.317585:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785601664 00000100:00100000:3.0:1789304407.317614:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1789304407.317622:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785601664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317658:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785601664:12345-0@lo:400:kworker.0 Request processed in 37us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304407.317664:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1789304407.317686:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785602176 00000100:00100000:3.0:1789304407.317690:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785602176 00000100:00100000:3.0:1789304407.317720:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785602048 00000100:00100000:3.0:1789304407.317723:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785602048 00000100:00100000:3.0:1789304407.317739:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1789304407.317745:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785602176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317773:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785602176:12345-0@lo:400:kworker.0 Request processed in 28us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304407.317778:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1789304407.317789:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1789304407.317794:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785602048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317817:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785602048:12345-0@lo:400:kworker.0 Request processed in 24us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304407.317823:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00080000:3.0:1789304407.317838:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304407.317862:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785602048:0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317871:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785601664:0@lo:400:kworker.0 00000100:00100000:3.0:1789304407.317879:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785602176:0@lo:400:kworker.0 00000100:00100000:1.0:1789304407.318174:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785601920 00000100:00100000:1.0:1789304407.318179:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785601920 00000100:00100000:1.0:1789304407.318221:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785602304 00000100:00100000:1.0:1789304407.318225:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785602304 00000100:00100000:1.0:1789304407.318245:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1789304407.318252:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785601920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304407.318292:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785601920:12345-0@lo:400:kworker.0 Request processed in 41us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304407.318299:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1789304407.318311:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1789304407.318317:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785602304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304407.318348:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785602304:12345-0@lo:400:kworker.0 Request processed in 32us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304407.318354:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1789304407.318387:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785602304:0@lo:400:kworker.0 00000100:00100000:1.0:1789304407.318399:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785601920:0@lo:400:kworker.0 00000100:00080000:3.0:1789304407.318468:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304407.318480:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304407.380824:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304407.675595:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304407.675840:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765506176 00000100:00100000:1.0:1789304407.675852:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765506176 00000100:00100000:1.0:1789304407.675912:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 706 00000100:00100000:1.0:1789304407.675920:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:45644:x1876219765506176:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304407.675996:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:45644:x1876219765506176:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 77us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304407.676001:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 706 00000100:00080000:3.0:1789304407.679728:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304407.687148:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304407.687208:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765506304 00000100:00100000:3.0:1789304407.687219:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765506304 00000100:00100000:3.0:1789304407.687284:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 382 00000100:00100000:3.0:1789304407.687296:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:45644:x1876219765506304:12345-192.168.202.29@tcp:19:lfs.0 00000100:00080000:0.0:1789304407.689072:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304407.692408:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:45644:x1876219765506304:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 1046us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304407.692436:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 382 00000100:00100000:1.0:1789304407.699464:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304407.699504:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765506432 00000100:00100000:1.0:1789304407.699515:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765506432 00000100:00100000:1.0:1789304407.699575:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 383 00000100:00100000:1.0:1789304407.699586:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:45644:x1876219765506432:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304407.699970:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:45644:x1876219765506432:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 385us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304407.699979:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 383 00000100:00080000:3.0:1789304407.700007:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304407.702072:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304407.702377:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765506560 00000100:00100000:1.0:1789304407.702388:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765506560 00000100:00100000:1.0:1789304407.702525:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 707 00000100:00100000:1.0:1789304407.702535:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:45644:x1876219765506560:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304407.702932:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:45644:x1876219765506560:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 398us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304407.702942:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 707 00000100:00100000:1.0:1789304407.733039:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304407.734015:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765506688 00000100:00100000:3.0:1789304407.734028:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765506688 00000100:00100000:3.0:1789304407.734114:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 708 00000100:00100000:3.0:1789304407.734125:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:45644:x1876219765506688:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304407.734304:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:45644:x1876219765506688:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 181us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304407.734312:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 708 00000100:00100000:1.0:1789304407.739843:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304407.740309:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765506816 00000100:00100000:0.0:1789304407.740324:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765506816 00000100:00100000:0.0:1789304407.740458:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 384 00000100:00100000:0.0:1789304407.740469:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45644:x1876219765506816:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304407.740838:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45644:x1876219765506816:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 370us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304407.740847:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 384 00000100:00100000:2.0:1789304407.743505:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304407.743549:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765506944 00000100:00100000:2.0:1789304407.743560:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765506944 00000100:00100000:2.0:1789304407.743616:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 385 00000100:00100000:2.0:1789304407.743626:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:45644:x1876219765506944:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304407.743961:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:45644:x1876219765506944:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 337us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304407.743970:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 385 00000100:00100000:2.0:1789304407.748592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304407.748666:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765507072 00000100:00100000:3.0:1789304407.748679:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765507072 00000100:00100000:3.0:1789304407.748736:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 709 00000100:00100000:3.0:1789304407.748746:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:45644:x1876219765507072:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304407.749494:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:45644:x1876219765507072:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 745us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304407.749503:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 709 00010000:00010000:2.0:1789304408.404222:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304409.291793:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304409.292076:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765507200 00000100:00100000:3.0:1789304409.292087:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765507200 00000100:00080000:0.0:1789304409.292326:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304409.292574:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 710 00000100:00100000:3.0:1789304409.292586:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:45659:x1876219765507200:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304409.292610:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304409.292650:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295d1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002ed expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.292749:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.292764:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.292777:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304409.292827:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:3.0:1789304409.292831:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304409.292851:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.292876:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295d1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ed expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.292892:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ed expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.292901:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:3.0:1789304409.292904:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304409.292908:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304409.292975:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:45659:x1876219765507200:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 391us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304409.292986:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 710 00000100:00100000:2.0:1789304409.298946:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304409.299015:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765507456 00000100:00100000:1.0:1789304409.299029:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765507456 00000100:00100000:1.0:1789304409.299120:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 711 00000100:00100000:1.0:1789304409.299134:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:45659:x1876219765507456:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789304409.299234:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304409.299262:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002ed expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304409.299294:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295cbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002d8 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304409.299307:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:1.0:1789304409.299610:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304409.299646:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304409.299662:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304409.299674:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789304409.383250:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967567 is committed 00000004:00010000:1.0:1789304409.384837:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b119a79 reply state 00000000be548ae3 transno 4294967567 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304409.384863:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304409.384878:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00080000:1.0:1789304409.385056:0:5852:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789304409.385082:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:45659:x1876219765507456:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 85947us (86145us total) trans 4294967567 rc 0/0 00000100:00100000:1.0:1789304409.385111:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 711 00010000:00010000:0.0:1789304409.385486:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.385497:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.385507:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.385512:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304409.385517:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.385528:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.385545:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:0.0:1789304409.385548:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304409.385554:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.385559:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb7231295d28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.426254:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304409.449827:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304409.449976:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765507584 00000100:00100000:3.0:1789304409.449987:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765507584 00000100:00100000:2.0:1789304409.450147:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 712 00000100:00100000:2.0:1789304409.450160:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:45663:x1876219765507584:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:2.0:1789304409.450186:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304409.450220:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295d2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002f4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.450307:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.450829:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.450843:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.450913:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.450923:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.450930:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452022:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295d44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452038:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452046:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304409.452073:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:2.0:1789304409.452078:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304409.452124:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295d44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452138:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452145:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452153:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452159:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304409.452164:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452173:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452185:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:2.0:1789304409.452188:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304409.452193:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452200:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452570:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452579:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452585:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452592:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304409.452595:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452601:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452611:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c421d2a00) 00010000:00010000:2.0:1789304409.452614:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304409.452617:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452627:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452668:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295d2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002f4 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452681:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295d44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002f4 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.452688:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304409.452691:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304409.452693:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecda00, rc 0) 00000100:00100000:2.0:1789304409.452770:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:45663:x1876219765507584:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 2611us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304409.452779:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 712 00000100:00100000:0.0:1789304409.457073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304409.457778:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765507840 00000100:00100000:3.0:1789304409.457790:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765507840 00000100:00100000:3.0:1789304409.457889:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 713 00000100:00100000:3.0:1789304409.457901:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:45663:x1876219765507840:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304409.457924:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304409.457946:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295d4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861002fb expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.458295:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295d52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.458319:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295d52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.458332:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295d52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.458347:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.458353:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.458753:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304409.459917:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16:0x0], index 1: 0 00010000:00010000:3.0:1789304409.460223:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.460237:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.460261:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.460948:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295d52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.460959:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295d52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.460966:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295d52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.460971:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304409.460976:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295d52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.460983:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295d52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.460996:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:3.0:1789304409.460999:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304409.461005:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295d52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.461016:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295d52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304409.461031:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d22d477 reply state 00000000ab7654e9 transno 4294967568 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304409.461041:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304409.461081:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295d4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002fb expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.461741:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002fb expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.461752:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304409.461754:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304409.461757:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304409.461841:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:45663:x1876219765507840:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 3942us (4778us total) trans 4294967568 rc 0/0 00000100:00100000:3.0:1789304409.461850:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 713 00010000:00010000:0.0:1789304409.463926:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.463942:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.463950:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.463956:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304409.463962:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.463969:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.463987:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c2ea19a00) 00010000:00010000:0.0:1789304409.463990:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304409.463996:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.464002:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231295d59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304409.465951:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304409.470206:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765508096 00000100:00100000:1.0:1789304409.470234:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765508096 00000100:00100000:1.0:1789304409.470801:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 714 00000100:00100000:1.0:1789304409.470814:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:45663:x1876219765508096:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:1.0:1789304409.470883:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304409.470916:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231295d60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002fb expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304409.470939:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:1.0:1789304409.470951:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304409.470999:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304409.471015:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304409.471027:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304409.471216:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8b82863 reply state 000000005368fb49 transno 4294967569 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304409.471231:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304409.471379:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:45663:x1876219765508096:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 567us (5438us total) trans 4294967569 rc 0/0 00000100:00100000:1.0:1789304409.471387:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 714 00000100:00100000:2.0:1789304409.474274:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304409.474379:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765508224 00000100:00100000:3.0:1789304409.474390:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765508224 00000100:00100000:3.0:1789304409.474457:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 715 00000100:00100000:3.0:1789304409.474474:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:45663:x1876219765508224:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304409.474498:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304409.474518:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295d75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100302 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.474583:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295d75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100302 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.474599:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295d75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100302 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.474619:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:3.0:1789304409.474622:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789304409.474626:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e000, rc 0) 00000100:00100000:3.0:1789304409.474689:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:45663:x1876219765508224:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 217us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304409.474696:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 715 00000100:00100000:2.0:1789304409.478370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304409.478771:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765508352 00000100:00100000:3.0:1789304409.478786:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765508352 00000100:00100000:3.0:1789304409.478867:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 386 00000100:00100000:3.0:1789304409.478880:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765508352:12345-192.168.202.29@tcp:2:touch.60003 00000100:00100000:3.0:1789304409.479281:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765508352:12345-192.168.202.29@tcp:2:touch.60003 Request processed in 403us (932us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789304409.479289:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 386 00000100:00080000:2.0:1789304409.480235:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304409.484784:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.484807:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.484815:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.484822:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304409.484828:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.484837:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.484856:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:0.0:1789304409.484859:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304409.484865:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304409.484871:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295d6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304409.486809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304409.486981:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765508608 00000100:00100000:2.0:1789304409.486994:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765508608 00000100:00100000:2.0:1789304409.487115:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 75 00000100:00100000:2.0:1789304409.487128:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:45663:x1876219765508608:12345-192.168.202.29@tcp:35:touch.60003 00000100:00100000:2.0:1789304409.487596:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:45663:x1876219765508608:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 469us (793us total) trans 4294967570 rc 0/0 00000100:00100000:2.0:1789304409.487606:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 75 00000100:00100000:3.0:1789304409.532783:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304409.532903:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765508736 00000100:00100000:2.0:1789304409.532914:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765508736 00000100:00100000:2.0:1789304409.532974:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 716 00000100:00100000:2.0:1789304409.532985:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:45667:x1876219765508736:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:2.0:1789304409.533012:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304409.533033:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100309 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533140:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d83 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533157:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533170:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533184:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295d8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533191:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533198:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533297:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295d91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533306:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533313:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304409.533346:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 0 00000004:00200000:2.0:1789304409.533351:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304409.533369:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533381:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533389:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533395:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d83 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533402:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533440:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304409.533445:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533453:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d83 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533465:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304409.533468:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304409.533473:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533479:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295d83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533497:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533503:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295d8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533509:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533515:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304409.533518:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533524:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295d8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533531:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c421d2a00) 00010000:00010000:2.0:1789304409.533534:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304409.533537:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295d8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533544:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295d8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533574:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295d7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100309 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533587:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295d91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100309 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.533600:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:2.0:1789304409.533602:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304409.533605:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd400, rc 0) 00000100:00100000:2.0:1789304409.533674:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:45667:x1876219765508736:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 691us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304409.533681:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 716 00000100:00100000:3.0:1789304409.538782:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304409.538872:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765508864 00000100:00100000:2.0:1789304409.538883:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765508864 00000100:00100000:2.0:1789304409.538947:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 387 00000100:00100000:2.0:1789304409.538959:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765508864:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:2.0:1789304409.538978:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304409.539000:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f54809d8/0xefc0bb7231295d98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100310 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304409.539026:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x6aa69e59, atime: 0x6aa69e59, ctime: 0x6aa69e59, blocks: 0x1 00010000:00010000:2.0:1789304409.539046:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1859s v=(0 0) 00010000:00010000:2.0:1789304409.539050:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304409.539059:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f54809d8/0xefc0bb7231295d98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100310 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.539079:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f54809d8/0xefc0bb7231295d98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100310 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.539124:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc400, rc 0) 00000100:00100000:2.0:1789304409.539190:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765508864:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 233us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304409.539205:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 387 00000100:00100000:0.0:1789304409.543819:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304409.543974:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765509120 00000100:00100000:2.0:1789304409.543984:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765509120 00000100:00100000:2.0:1789304409.544041:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 717 00000100:00100000:2.0:1789304409.544058:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:45667:x1876219765509120:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:2.0:1789304409.544152:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304409.544604:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295d91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100309 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.544628:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231295d75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100302 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.544641:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:2.0:1789304409.544652:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304409.544673:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295d9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.544686:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295d9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.544696:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295d9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.544712:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.544719:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.544726:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.544830:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295dad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.544839:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295dad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.544845:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295dad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304409.545910:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 64 off9600 00000004:00080000:2.0:1789304409.545921:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1859223830184ns, next at 1860223827417ns, rc = 0 00010000:00010000:2.0:1789304409.545976:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.545987:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.545995:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546002:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546009:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546015:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546087:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304409.546129:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295dad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546136:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295dad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546143:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295dad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546148:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304409.546153:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295dad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546169:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295dad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546179:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304409.546182:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304409.546187:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295dad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546193:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295dad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546214:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295d9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546219:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295d9f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546229:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295d9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546235:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304409.546237:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295d9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546243:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295d9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546250:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304409.546252:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304409.546254:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295d9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304409.546260:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231295d9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304409.546271:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000732cf83 reply state 0000000095fbedb0 transno 4294967571 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304409.546280:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304409.546374:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:45667:x1876219765509120:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 2321us (2572us total) trans 4294967571 rc 0/0 00000100:00100000:2.0:1789304409.546383:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 717 00010000:00010000:3.0:1789304409.551865:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304409.551881:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.551894:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304409.551900:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.551911:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.551928:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:3.0:1789304409.551931:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304409.551936:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.551941:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295db4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.551966:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304409.551967:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304409.551969:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304409.555082:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.555124:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.555132:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.555139:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304409.555144:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.555151:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.555181:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c421d2200) 00010000:00010000:3.0:1789304409.555184:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304409.555189:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304409.555196:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295da6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304409.874388:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785602432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304409.874549:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304409.874694:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785602432 00000100:00100000:0.0:1789304409.874704:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785602432 00000100:00100000:0.0:1789304409.874813:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1789304409.874823:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785602432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304409.874860:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304409.874908:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785602432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304409.874916:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1789304409.875003:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785602432:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304409.875132:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304409.960511:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304409.960563:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304409.960569:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765509248 00000100:00100000:2.0:1789304409.960579:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765509248 00000100:00100000:2.0:1789304409.960646:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1090 00000100:00100000:2.0:1789304409.960657:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765509248:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304409.960728:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765509248:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 72us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304409.960735:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1090 00000100:00100000:3.0:1789304409.960921:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765509376 00000100:00100000:3.0:1789304409.960926:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765509376 00000100:00100000:3.0:1789304409.960978:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 961 00000100:00100000:3.0:1789304409.960988:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765509376:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304409.961019:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765509376:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 34us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304409.961026:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 961 00000100:00080000:2.0:1789304409.961117:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304410.378801:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304410.378883:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765509504 00000100:00100000:0.0:1789304410.378894:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765509504 00000100:00100000:0.0:1789304410.378959:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 718 00000100:00100000:0.0:1789304410.378970:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:45683:x1876219765509504:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304410.378994:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304410.379014:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295dbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100317 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304410.379154:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295dc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304410.379167:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304410.379180:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304410.379216:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:0.0:1789304410.379220:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304410.379239:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304410.379338:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295dbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100317 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304410.379358:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100317 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304410.379366:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:0.0:1789304410.379369:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304410.379373:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb400, rc 0) 00000100:00100000:0.0:1789304410.379440:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:45683:x1876219765509504:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 471us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304410.379457:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 718 00000100:00100000:0.0:1789304410.387464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304410.390186:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765509760 00000100:00100000:1.0:1789304410.390199:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765509760 00000100:00100000:1.0:1789304410.390274:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 719 00000100:00100000:1.0:1789304410.390285:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:45683:x1876219765509760:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789304410.390335:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304410.390362:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295dc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100317 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.390382:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295d44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861002f4 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.390394:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:1.0:1789304410.390413:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304410.390439:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.390453:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.390463:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304410.450350:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304410.452194:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967572 is committed 00000004:00080000:2.0:1789304410.452215:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 64 committed 00000100:00100000:2.0:1789304410.452540:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785602560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789304410.452611:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1789304410.452756:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4be1dc2 reply state 00000000d656aae2 transno 4294967572 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304410.452770:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304410.452782:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00080000:1.0:1789304410.452863:0:30980:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789304410.452878:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:45683:x1876219765509760:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 62593us (65420us total) trans 4294967572 rc 0/0 00000100:00100000:1.0:1789304410.452887:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 719 00010000:00010000:1.0:1789304410.452921:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.452929:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.452938:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.452944:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304410.452949:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.452957:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.452971:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:1.0:1789304410.452974:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304410.452979:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.452985:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304410.457301:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785602560 00000100:00100000:3.0:1789304410.457316:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785602560 00000100:00100000:3.0:1789304410.457729:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789304410.457742:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785602560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789304410.457779:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:22 count 1 00010000:00010000:3.0:1789304410.457804:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304410.457830:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f54809d8/0xefc0bb7231295d98 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100310 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304410.457839:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789304410.457843:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304410.457849:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304410.457885:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f54809d8/0xefc0bb7231295d98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100310 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304410.457899:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f54809d8/0xefc0bb7231295d98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100310 expref: 6 pid: 6693 timeout: 1960 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304410.457913:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876219785602688:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304410.458031:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789304410.461209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304410.461312:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765509888 00000100:00100000:1.0:1789304410.461322:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765509888 00010000:00010000:1.0:1789304410.461362:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f54809d8/0xefc0bb7231295d98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100310 expref: 7 pid: 6693 timeout: 1960 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304410.461419:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 358 00000100:00100000:1.0:1789304410.461430:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03869450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765509888:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304410.461459:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304410.461467:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f54809d8/0xefc0bb7231295d98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100310 expref: 7 pid: 6693 timeout: 1960 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.461481:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f54809d8/0xefc0bb7231295d98 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100310 expref: 7 pid: 6693 timeout: 1960 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.461508:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304410.461512:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304410.461519:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.461530:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.461553:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304410.461603:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03869450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765509888:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 174us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304410.461614:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 358 00010000:00010000:3.0:1789304410.467523:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f54809d8/0xefc0bb7231295d98 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100310 expref: 6 pid: 6693 timeout: 1960 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304410.467558:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876219785602688:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304410.467586:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.468660:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.468675:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.468687:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.468694:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.468754:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789304410.469643:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785602560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11901us (17028us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789304410.469656:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000004:00080000:2.0:1789304410.472933:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c41245500/2, rc 0, transno 4294967341 00000100:00100000:2.0:1789304410.472953:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785602560:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789304410.475012:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304410.475030:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304410.475046:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304410.475051:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304410.475063:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304410.475085:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304410.475638:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c13998fa/0xefc0bb7231295dd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304410.480198:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304410.480207:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304410.480210:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304410.487256:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304410.487907:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765510016 00000100:00100000:1.0:1789304410.487918:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765510016 00000100:00100000:1.0:1789304410.488019:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 720 00000100:00100000:1.0:1789304410.488029:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:45687:x1876219765510016:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:1.0:1789304410.488055:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304410.488075:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610031e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488180:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295dde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488195:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295dde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488207:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295dde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488221:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295de5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488228:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295de5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488234:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295de5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488726:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295dec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488737:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488745:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304410.488767:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:1.0:1789304410.488770:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304410.488790:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488803:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295dde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488814:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295dde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488821:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295dde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488827:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304410.488832:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295dde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488840:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295dde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488851:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:1.0:1789304410.488853:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304410.488858:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295dde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488864:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295dde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488876:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295de5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488882:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295de5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488889:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295de5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488894:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304410.488897:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295de5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488903:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295de5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488909:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c14add700) 00010000:00010000:1.0:1789304410.488911:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304410.488913:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295de5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488919:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e000/0xefc0bb7231295de5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488947:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231295dd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610031e expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488959:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610031e expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304410.488965:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:1.0:1789304410.488968:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304410.488970:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e800, rc 0) 00000100:00100000:1.0:1789304410.489133:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:45687:x1876219765510016:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 1105us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304410.489141:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 720 00000100:00100000:1.0:1789304410.898438:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304410.898462:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785602816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304410.898546:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304410.898626:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785602816 00000100:00100000:1.0:1789304410.898650:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785602816 00000100:00100000:1.0:1789304410.898800:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1789304410.898811:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785602816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304410.898850:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789304410.898904:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304410.898904:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785602816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304410.898911:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1789304410.898962:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785602816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304411.399976:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304411.400045:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765510144 00000100:00100000:3.0:1789304411.400056:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765510144 00000100:00100000:3.0:1789304411.400160:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 721 00000100:00100000:3.0:1789304411.400171:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:45701:x1876219765510144:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304411.400192:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304411.400214:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295df3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100325 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304411.400286:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295dfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304411.400306:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304411.400318:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304411.400355:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:3.0:1789304411.400359:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304411.400378:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295dfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304411.400418:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295df3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100325 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304411.400435:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295dfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100325 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304411.400444:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:3.0:1789304411.400446:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304411.400450:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f800, rc 0) 00000100:00100000:3.0:1789304411.400514:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:45701:x1876219765510144:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 345us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304411.400522:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 721 00000100:00080000:2.0:1789304411.401446:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304411.402880:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304411.402958:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765510400 00000100:00100000:0.0:1789304411.402968:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765510400 00000100:00100000:0.0:1789304411.403021:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 722 00000100:00100000:0.0:1789304411.403032:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:45701:x1876219765510400:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304411.403079:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304411.403133:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231295dfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100325 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.403155:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231295dec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610031e expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.403167:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:0.0:1789304411.403178:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304411.403201:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.403215:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.403224:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304411.403563:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000572550f0 reply state 000000002d6035f5 transno 4294967573 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304411.403573:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304411.403582:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000100:00100000:0.0:1789304411.403665:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:45701:x1876219765510400:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 633us (789us total) trans 4294967573 rc 0/0 00000100:00100000:0.0:1789304411.403672:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 722 00010000:00010000:0.0:1789304411.405017:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.405031:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.405040:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.405047:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304411.405052:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.405060:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.405075:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304411.405078:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304411.405083:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.405114:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295e01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304411.474956:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304411.514608:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304411.514641:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765510528 00000100:00100000:1.0:1789304411.514650:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765510528 00000100:00100000:1.0:1789304411.514825:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 723 00000100:00100000:1.0:1789304411.514835:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:45713:x1876219765510528:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304411.514934:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:45713:x1876219765510528:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 101us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304411.514941:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 723 00000100:00100000:0.0:1789304411.521649:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304411.522588:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765510656 00000100:00100000:0.0:1789304411.522600:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765510656 00000100:00100000:0.0:1789304411.522670:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 389 00000100:00100000:0.0:1789304411.522750:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45713:x1876219765510656:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304411.523146:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45713:x1876219765510656:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 466us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304411.523155:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 389 00000100:00080000:2.0:1789304411.524941:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304411.525806:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304411.525839:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765510784 00000100:00100000:1.0:1789304411.525848:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765510784 00000100:00100000:1.0:1789304411.525901:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 390 00000100:00100000:1.0:1789304411.525911:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:45713:x1876219765510784:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304411.526260:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:45713:x1876219765510784:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 349us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304411.526268:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 390 00000100:00080000:2.0:1789304411.527605:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304411.535613:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304411.535654:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765510912 00000100:00100000:1.0:1789304411.535675:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765510912 00000100:00100000:1.0:1789304411.535738:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 724 00000100:00100000:1.0:1789304411.535748:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:45713:x1876219765510912:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304411.536225:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:45713:x1876219765510912:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 476us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304411.536234:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 724 00000100:00100000:2.0:1789304411.539786:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304411.539903:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765511040 00000100:00100000:3.0:1789304411.539915:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765511040 00000100:00100000:3.0:1789304411.539985:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 725 00000100:00100000:3.0:1789304411.539997:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:45713:x1876219765511040:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304411.540197:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:45713:x1876219765511040:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 201us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304411.540205:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 725 00000100:00100000:1.0:1789304411.543277:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304411.543382:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765511168 00000100:00100000:3.0:1789304411.543402:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765511168 00000100:00100000:3.0:1789304411.543464:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 391 00000100:00100000:3.0:1789304411.543475:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45713:x1876219765511168:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304411.543827:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45713:x1876219765511168:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 353us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304411.543835:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 391 00000100:00100000:3.0:1789304411.545219:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304411.545407:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765511296 00000100:00100000:1.0:1789304411.545419:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765511296 00000100:00100000:1.0:1789304411.545538:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 392 00000100:00100000:1.0:1789304411.545546:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:45713:x1876219765511296:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304411.545801:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:45713:x1876219765511296:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 254us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304411.545809:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 392 00000100:00100000:0.0:1789304411.546953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304411.546998:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765511424 00000100:00100000:1.0:1789304411.547005:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765511424 00000100:00100000:1.0:1789304411.547042:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 726 00000100:00100000:1.0:1789304411.547164:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:45713:x1876219765511424:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304411.547431:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:45713:x1876219765511424:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 271us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304411.547439:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 726 00000100:00100000:3.0:1789304411.587927:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304411.587996:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765511552 00000100:00100000:1.0:1789304411.588009:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765511552 00000100:00100000:1.0:1789304411.588072:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 727 00000100:00100000:1.0:1789304411.588082:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:45717:x1876219765511552:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:2.0:1789304411.588339:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304411.588366:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295e08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610032c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588509:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295e0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588522:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295e0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588532:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295e0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588544:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295e16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588548:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295e16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588552:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295e16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588849:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588858:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588865:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304411.588888:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:2.0:1789304411.588892:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304411.588914:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588927:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295e0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588934:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295e0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588945:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295e0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588951:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304411.588955:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295e0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588963:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295e0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588974:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:2.0:1789304411.588978:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304411.588983:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295e0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.588989:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295e0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.589001:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295e16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.589007:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295e16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.589013:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295e16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.589018:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304411.589021:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295e16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.589031:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295e16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.589038:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304411.589040:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304411.589043:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295e16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.589049:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295e16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.589081:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295e08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610032c expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.589143:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610032c expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.589152:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304411.589550:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304411.589554:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecda00, rc 0) 00000100:00100000:2.0:1789304411.589681:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:45717:x1876219765511552:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1599us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304411.589690:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 727 00000100:00100000:3.0:1789304411.592638:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304411.592768:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765511808 00000100:00100000:2.0:1789304411.592779:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765511808 00000100:00100000:2.0:1789304411.592845:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 728 00000100:00100000:2.0:1789304411.592856:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:45717:x1876219765511808:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:2.0:1789304411.592878:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304411.592898:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295e24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100333 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.593207:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295e2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.593222:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.593233:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.593304:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.593312:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.593319:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789304411.594011:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17:0x0], index 0: 0 00010000:00010000:2.0:1789304411.594270:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295e39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594282:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594290:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594330:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295e2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594337:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295e2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594343:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295e2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594349:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304411.594353:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295e2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594360:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295e2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594371:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304411.594374:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304411.594380:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295e2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594399:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295e2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304411.594415:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000863d52e1 reply state 0000000049798126 transno 4294967574 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304411.594424:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304411.594455:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295e24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100333 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594477:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100333 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304411.594485:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:2.0:1789304411.594488:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304411.594491:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd400, rc 0) 00000100:00100000:2.0:1789304411.594566:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:45717:x1876219765511808:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1712us (1936us total) trans 4294967574 rc 0/0 00000100:00100000:2.0:1789304411.594575:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 728 00010000:00010000:1.0:1789304411.598818:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304411.598837:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304411.598846:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304411.598853:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304411.598857:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304411.598866:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304411.598883:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c421d2c00) 00010000:00010000:1.0:1789304411.598886:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304411.598891:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304411.598898:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231295e32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304411.601143:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304411.602656:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765511936 00000100:00100000:0.0:1789304411.602671:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765511936 00000100:00100000:0.0:1789304411.602748:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 393 00000100:00100000:0.0:1789304411.602759:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45717:x1876219765511936:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304411.602777:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304411.602798:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0b6b3db/0xefc0bb7231295e47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610033a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304411.602825:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789304411.602850:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=1861s v=(0 0) 00010000:00010000:0.0:1789304411.602856:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304411.602866:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b6b3db/0xefc0bb7231295e47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610033a expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.602884:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a0b6b3db/0xefc0bb7231295e47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610033a expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304411.602896:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304411.602965:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:45717:x1876219765511936:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 208us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304411.602972:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 393 00000100:00100000:0.0:1789304411.626639:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304411.626740:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765512064 00000100:00100000:1.0:1789304411.626753:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765512064 00002000:00100000:1.0:1789304411.626814:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x17:0x0] (0->1048575) req@ffff9e2c41247800 x1876219765512064/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:477/0 lens 488/0 e 0 to 0 dl 1789304422 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304411.626837:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c41247800 with x1876219765512064 ext(0->1048575) 00002000:00010000:1.0:1789304411.626848:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2c41247800 00000100:00100000:1.0:1789304411.626901:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:1.0:1789304411.626919:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765512064:12345-192.168.202.29@tcp:4:dd.60003 00000100:00100000:1.0:1789304411.646925:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765512064:12345-192.168.202.29@tcp:4:dd.60003 Request processed in 20002us (20298us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789304411.646940:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 17 00002000:00100000:1.0:1789304411.646953:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x17:0x0] (0->1048575) req@ffff9e2c41247800 x1876219765512064/t4294967342(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:477/0 lens 488/448 e 0 to 0 dl 1789304422 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304411.646965:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c41247800 with x1876219765512064 ext(0->1048575) 00002000:00010000:1.0:1789304411.646971:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2c41247800 00000100:00100000:3.0:1789304411.651313:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304411.651562:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765512192 00000100:00100000:1.0:1789304411.651574:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765512192 00000100:00100000:1.0:1789304411.651735:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 729 00000100:00100000:1.0:1789304411.651746:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:45717:x1876219765512192:12345-192.168.202.29@tcp:44:dd.60003 00000001:00080000:2.0:1789304411.678263:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967573 is committed 00000001:00080000:2.0:1789304411.678280:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967574 is committed 00000100:00100000:1.0:1789304411.678530:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:45717:x1876219765512192:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 26779us (27217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304411.678543:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 729 00000100:00100000:2.0:1789304411.681988:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304411.682081:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765512320 00000100:00100000:1.0:1789304411.682122:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765512320 00000100:00100000:1.0:1789304411.682180:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 394 00000100:00100000:1.0:1789304411.682191:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765512320:12345-192.168.202.29@tcp:16:dd.60003 00000001:00080000:1.0:1789304411.718732:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00000100:00100000:0.0:1789304411.718980:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765512320:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 36785us (36994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304411.718992:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 394 00000100:00100000:0.0:1789304411.722596:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304411.722774:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765512576 00000100:00100000:2.0:1789304411.722787:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765512576 00000100:00100000:2.0:1789304411.722899:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 76 00000100:00100000:2.0:1789304411.722911:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:45717:x1876219765512576:12345-192.168.202.29@tcp:35:dd.60003 00000100:00100000:2.0:1789304411.723618:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:45717:x1876219765512576:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 705us (1029us total) trans 4294967575 rc 0/0 00000100:00100000:2.0:1789304411.723626:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 76 00000001:00080000:2.0:1789304412.000972:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967341 is committed 00000001:00080000:2.0:1789304412.001003:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967340 is committed 00000100:00100000:0.0:1789304412.434305:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785603072:0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.434389:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304412.434451:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785603584:0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.434476:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304412.434502:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789304412.434508:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785602944:0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.434535:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304412.434557:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785603456:0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.434578:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304412.434589:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785603200:0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.434601:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785603328:0@lo:400:kworker.0 00000100:00100000:1.0:1789304412.434616:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304412.434619:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304412.434650:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785603584 00000100:00100000:1.0:1789304412.434659:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785603584 00000100:00100000:1.0:1789304412.434705:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785603200 00000100:00100000:1.0:1789304412.434708:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785603200 00000100:00100000:1.0:1789304412.434731:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1789304412.434740:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785603584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.434778:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:0.0:1789304412.434787:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785603200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304412.434788:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785603584:12345-0@lo:400:kworker.0 Request processed in 50us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304412.434795:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1789304412.434822:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785603200:12345-0@lo:400:kworker.0 Request processed in 37us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304412.434827:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:1.0:1789304412.434838:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785603200:0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.434844:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785602944 00000100:00100000:0.0:1789304412.434847:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785602944 00000100:00100000:1.0:1789304412.434862:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:1.0:1789304412.434867:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c41245500, transno 4294967341 00000100:00100000:0.0:1789304412.434869:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1789304412.434875:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785602944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304412.434876:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785603584:0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.434906:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785602944:12345-0@lo:400:kworker.0 Request processed in 32us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304412.434912:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1789304412.434940:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785603072 00000100:00100000:0.0:1789304412.434943:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785603072 00000100:00100000:0.0:1789304412.434965:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785603456 00000100:00100000:0.0:1789304412.434967:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785603456 00000100:00100000:0.0:1789304412.434981:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785603328 00000100:00100000:0.0:1789304412.434983:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785603328 00000100:00100000:0.0:1789304412.434996:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1789304412.435000:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785603072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.435028:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785603072:12345-0@lo:400:kworker.0 Request processed in 27us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304412.435033:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1789304412.435043:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1789304412.435048:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785603456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.435074:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785603456:12345-0@lo:400:kworker.0 Request processed in 26us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304412.435079:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1789304412.435108:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:0.0:1789304412.435114:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785603328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.435142:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785603328:12345-0@lo:400:kworker.0 Request processed in 29us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304412.435148:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:0.0:1789304412.435174:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785603328:0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.435205:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785602944:0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.435214:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785603456:0@lo:400:kworker.0 00000100:00100000:0.0:1789304412.435222:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785603072:0@lo:400:kworker.0 00000100:00080000:2.0:1789304412.435406:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304412.435411:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304412.435413:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789304412.499067:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304412.594943:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967575 is committed 00010000:00010000:2.0:1789304413.523032:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304413.876772:0:78699:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1863554678611ns, next at 1842287370207ns, rc = 0 00000004:00080000:1.0:1789304413.878333:0:78699:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1863556239864ns, next at 1860223827417ns, rc = 0 00000004:00080000:3.0:1789304413.891119:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 65 committed 00000004:00080000:3.0:1789304413.891149:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 58 committed 00010000:00010000:3.0:1789304414.547315:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304414.909620:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304414.909708:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765512704 00000100:00100000:1.0:1789304414.909720:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765512704 00000100:00100000:1.0:1789304414.909799:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 730 00000100:00100000:1.0:1789304414.909810:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:45910:x1876219765512704:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304414.909923:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:45910:x1876219765512704:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304414.909931:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 730 00000100:00080000:2.0:1789304414.910202:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304414.919484:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304414.920052:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765512832 00000100:00100000:0.0:1789304414.920064:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765512832 00000100:00100000:0.0:1789304414.920156:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 395 00000100:00100000:0.0:1789304414.920167:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:45910:x1876219765512832:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304414.920541:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:45910:x1876219765512832:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 375us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304414.920548:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 395 00000100:00080000:2.0:1789304414.924218:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304414.934201:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304414.934866:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765512960 00000100:00100000:2.0:1789304414.934877:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765512960 00000100:00100000:2.0:1789304414.934961:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 396 00000100:00100000:2.0:1789304414.934972:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45910:x1876219765512960:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304414.935352:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45910:x1876219765512960:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 381us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304414.935377:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 396 00000100:00080000:1.0:1789304414.938622:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304414.948496:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304414.948534:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765513088 00000100:00100000:3.0:1789304414.948545:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765513088 00000100:00100000:3.0:1789304414.948603:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 731 00000100:00100000:3.0:1789304414.948615:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:45910:x1876219765513088:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304414.950172:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:45910:x1876219765513088:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 1554us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304414.950185:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 731 00000100:00100000:2.0:1789304414.959073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304414.961413:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765513216 00000100:00100000:3.0:1789304414.961428:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765513216 00000100:00100000:3.0:1789304414.961519:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 732 00000100:00100000:3.0:1789304414.961530:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:45910:x1876219765513216:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304414.961638:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:45910:x1876219765513216:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 110us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304414.961646:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 732 00000100:00100000:0.0:1789304414.970445:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304414.970547:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765513344 00000100:00100000:1.0:1789304414.970562:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765513344 00000100:00100000:1.0:1789304414.970666:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 397 00000100:00100000:1.0:1789304414.970678:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:45910:x1876219765513344:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304414.971154:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:45910:x1876219765513344:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 478us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304414.971164:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 397 00000100:00100000:2.0:1789304414.980650:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304414.994747:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765513472 00000100:00100000:0.0:1789304414.994763:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765513472 00000100:00100000:0.0:1789304414.994842:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 398 00000100:00100000:0.0:1789304414.994853:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45910:x1876219765513472:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304414.995238:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:45910:x1876219765513472:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 386us (14599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304414.995246:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 398 00000100:00100000:3.0:1789304414.999006:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304414.999033:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785603712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304414.999130:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304414.999187:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785603712 00000100:00100000:1.0:1789304414.999197:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785603712 00000100:00100000:1.0:1789304414.999282:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1789304414.999292:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785603712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304414.999331:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304414.999404:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785603712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304414.999411:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00080000:3.0:1789304415.003600:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304415.003688:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785603712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304415.003822:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304415.003905:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765513600 00000100:00100000:1.0:1789304415.003914:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765513600 00000100:00100000:1.0:1789304415.003972:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 733 00000100:00100000:1.0:1789304415.003982:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:45910:x1876219765513600:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304415.004498:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:45910:x1876219765513600:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 516us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304415.004506:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 733 00000100:00100000:1.0:1789304415.048872:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304415.049016:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765513856 00000100:00100000:3.0:1789304415.049027:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765513856 00000100:00100000:3.0:1789304415.049131:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 734 00000100:00100000:3.0:1789304415.049143:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:45914:x1876219765513856:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:3.0:1789304415.049203:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304415.049233:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231295e39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100333 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.049255:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:3.0:1789304415.049266:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304415.049291:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295e4e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.049304:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295e4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.049313:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295e4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.049325:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.049331:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.049337:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.049922:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295e5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.049930:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295e5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.049935:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295e5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304415.051008:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].23, 64 off9664 00000004:00080000:3.0:1789304415.051020:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1864728929287ns, next at 1865728926659ns, rc = 0 00010000:00010000:2.0:1789304415.051386:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051400:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051426:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051435:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051442:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051448:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051471:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304415.051500:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295e5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051509:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295e5c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051516:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295e5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051522:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304415.051527:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295e5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051534:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295e5c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051547:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:2.0:1789304415.051550:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304415.051554:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295e5c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051560:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231295e5c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051581:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295e4e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051587:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295e4e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051592:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295e4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051596:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304415.051600:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295e4e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051605:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295e4e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051622:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304415.051625:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304415.051629:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295e4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304415.051634:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231295e4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304415.051644:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d6cc23d reply state 00000000fe39b1de transno 4294967576 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304415.051652:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304415.051750:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:45914:x1876219765513856:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 2605us (2884us total) trans 4294967576 rc 0/0 00000100:00100000:2.0:1789304415.051760:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 734 00010000:00010000:3.0:1789304415.052381:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304415.052389:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.052409:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304415.052419:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.052427:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.052440:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304415.052443:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304415.052447:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.052452:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295e63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304415.052475:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304415.052477:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304415.052479:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304415.056825:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304415.056843:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304415.056849:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304415.056854:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304415.056858:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304415.056864:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304415.056880:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff9e2c2ea19d00) 00010000:00010000:0.0:1789304415.056883:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304415.056887:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304415.056892:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231295e55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304415.073435:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304415.073587:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765513984 00000100:00100000:0.0:1789304415.073601:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765513984 00000100:00100000:0.0:1789304415.073679:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1092 00000100:00100000:0.0:1789304415.073691:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765513984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304415.073782:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765513984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 92us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304415.073789:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1092 00010000:00010000:2.0:1789304415.572638:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304416.020616:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304416.020648:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785603840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304416.020725:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304416.020940:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785603840 00000100:00100000:2.0:1789304416.020949:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785603840 00000100:00100000:2.0:1789304416.021016:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1789304416.021028:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785603840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304416.021064:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00080000:3.0:1789304416.021153:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304416.021478:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785603840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 451us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304416.021497:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1789304416.025618:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785603840:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304416.598149:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304416.757320:0:78843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1866435226658ns, next at 1865728926659ns, rc = 0 00000004:00080000:2.0:1789304416.782074:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 60 committed 00000001:00080000:2.0:1789304416.782138:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967576 is committed 00000004:00080000:2.0:1789304416.782143:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 59 committed 00000100:00100000:0.0:1789304416.782537:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304416.782560:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785603968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304416.782633:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304416.782759:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785603968 00000100:00100000:3.0:1789304416.782769:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785603968 00000100:00100000:3.0:1789304416.782826:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789304416.782836:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785603968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789304416.782863:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:23 count 1 00010000:00010000:3.0:1789304416.782891:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304416.782920:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0b6b3db/0xefc0bb7231295e47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610033a expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304416.782930:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x17:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1789304416.782935:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304416.782939:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304416.782969:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a0b6b3db/0xefc0bb7231295e47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610033a expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304416.782984:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a0b6b3db/0xefc0bb7231295e47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610033a expref: 5 pid: 6691 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304416.782996:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785604096:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304416.783054:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03853b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789304416.786474:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304416.786577:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765514112 00000100:00100000:2.0:1789304416.786590:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765514112 00010000:00010000:2.0:1789304416.786662:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b6b3db/0xefc0bb7231295e47 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610033a expref: 6 pid: 6691 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304416.786702:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 359 00000100:00100000:2.0:1789304416.786713:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765514112:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304416.786729:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304416.786736:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a0b6b3db/0xefc0bb7231295e47 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610033a expref: 6 pid: 6691 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304416.786751:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a0b6b3db/0xefc0bb7231295e47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610033a expref: 6 pid: 6691 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304416.786779:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304416.786783:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304416.786789:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304416.786800:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304416.786823:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304416.786880:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765514112:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 169us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304416.786891:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 359 00000100:00080000:1.0:1789304416.787191:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304416.787483:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0b6b3db/0xefc0bb7231295e47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610033a expref: 5 pid: 6691 timeout: 1966 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304416.787505:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e0b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785604096:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304416.787531:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304416.787543:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304416.787552:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304416.787563:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304416.787572:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304416.787599:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304416.788301:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304416.788309:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304416.788319:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304416.788324:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304416.788336:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304416.788367:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304416.788375:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c1b8cbb/0xefc0bb7231295e6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304416.788405:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304416.788408:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304416.788409:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304416.789044:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785603968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6207us (6408us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789304416.789054:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000004:00080000:0.0:1789304416.790016:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b01e08700/2, rc 0, transno 4294967343 00000100:00100000:0.0:1789304416.790117:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785603968:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789304416.790653:0:78843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1866468561301ns, next at 1860223827417ns, rc = 0 00000004:00080000:2.0:1789304416.793077:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 66 committed 00000100:00100000:2.0:1789304417.557519:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785604224:0@lo:400:kworker.0 00000100:00100000:2.0:1789304417.557602:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304417.557619:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785604352:0@lo:400:kworker.0 00000100:00100000:3.0:1789304417.557664:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304417.557667:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785604736:0@lo:400:kworker.0 00000100:00100000:3.0:1789304417.557707:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785604864:0@lo:400:kworker.0 00000100:00100000:1.0:1789304417.557745:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785604224 00000100:00100000:1.0:1789304417.557753:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785604224 00000100:00100000:1.0:1789304417.557805:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1789304417.557815:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785604224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304417.560026:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304417.560166:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304417.560180:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785604608:0@lo:400:kworker.0 00000100:00100000:2.0:1789304417.560237:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304417.560289:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785604352 00000100:00100000:2.0:1789304417.560298:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785604352 00000100:00100000:2.0:1789304417.560355:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785604736 00000100:00100000:2.0:1789304417.560358:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785604736 00000100:00100000:2.0:1789304417.560389:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785604608 00000100:00100000:2.0:1789304417.560393:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785604608 00000100:00100000:2.0:1789304417.560415:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1789304417.560424:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304417.560426:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785604352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304417.560463:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304417.560475:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785604480:0@lo:400:kworker.0 00000100:00100000:2.0:1789304417.560489:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785604352:12345-0@lo:400:kworker.0 Request processed in 65us (2824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304417.560497:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1789304417.560508:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304417.560520:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1789304417.560529:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785604736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304417.560559:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785604352:0@lo:400:kworker.0 00000100:00100000:2.0:1789304417.560570:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785604736:12345-0@lo:400:kworker.0 Request processed in 41us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304417.560577:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1789304417.560592:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:2.0:1789304417.560599:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785604608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304417.560608:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785604864 00000100:00100000:3.0:1789304417.560613:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785604864 00000100:00100000:2.0:1789304417.560629:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785604608:12345-0@lo:400:kworker.0 Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304417.560637:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1789304417.560648:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785604480 00000100:00100000:3.0:1789304417.560653:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785604480 00000100:00080000:2.0:1789304417.560674:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304417.560680:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00080000:2.0:1789304417.560681:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304417.560690:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785604864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304417.560712:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785604608:0@lo:400:kworker.0 00000100:00100000:2.0:1789304417.560727:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785604736:0@lo:400:kworker.0 00000100:00100000:3.0:1789304417.560743:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785604864:12345-0@lo:400:kworker.0 Request processed in 55us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304417.560751:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:3.0:1789304417.560767:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1789304417.560774:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785604480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304417.560806:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785604480:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304417.560813:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1789304417.560840:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785604480:0@lo:400:kworker.0 00000100:00100000:3.0:1789304417.560849:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785604864:0@lo:400:kworker.0 00000100:00100000:1.0:1789304417.561037:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785604224:12345-0@lo:400:kworker.0 Request processed in 3222us (3434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304417.561047:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1789304417.561318:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785604224:0@lo:400:kworker.0 00010000:00010000:2.0:1789304417.618890:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304418.642382:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304419.667525:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304420.114641:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304420.114775:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785604992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304420.114848:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304420.116482:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785604992 00000100:00100000:0.0:1789304420.116495:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785604992 00000100:00100000:0.0:1789304420.116557:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1789304420.116566:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785604992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304420.116605:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304420.116670:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785604992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304420.116677:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00080000:2.0:1789304420.116976:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304420.117019:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785604992:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789304420.180032:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00000100:00100000:2.0:1789304420.194545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304420.194590:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304420.194626:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304420.194670:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304420.194702:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765514496 00000100:00100000:2.0:1789304420.194711:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765514496 00000100:00100000:2.0:1789304420.194764:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765514624 00000100:00100000:2.0:1789304420.194767:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765514624 00000100:00100000:2.0:1789304420.194789:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 966 00000100:00100000:2.0:1789304420.194798:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765514496:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304420.194988:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765514496:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 190us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304420.194997:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 966 00000100:00100000:2.0:1789304420.195015:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 967 00000100:00100000:2.0:1789304420.195022:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765514624:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304420.195050:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765514624:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304420.195057:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 967 00000100:00080000:2.0:1789304420.195072:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304420.195075:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304420.196672:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765514368 00000100:00100000:1.0:1789304420.196685:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765514368 00000100:00100000:1.0:1789304420.196777:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1315 00000100:00100000:1.0:1789304420.196788:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765514368:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304420.196857:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765514368:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 72us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304420.196875:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1315 00000100:00100000:3.0:1789304420.197197:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765514240 00000100:00100000:3.0:1789304420.197202:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765514240 00000100:00100000:3.0:1789304420.197240:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1094 00000100:00100000:3.0:1789304420.197247:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765514240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304420.197275:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765514240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (2740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304420.197281:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1094 00000100:00080000:2.0:1789304420.198791:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304420.691143:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304421.138484:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785605120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304421.138567:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304421.138688:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785605120 00000100:00100000:2.0:1789304421.138700:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785605120 00000100:00100000:2.0:1789304421.138767:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:2.0:1789304421.138777:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785605120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304421.138816:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304421.138865:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785605120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304421.138872:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:2.0:1789304421.138917:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:2.0:1789304421.138922:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b01e08700, transno 4294967343 00000100:00100000:2.0:1789304421.138937:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785605120:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304421.139216:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304421.716226:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304422.674954:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785605504:0@lo:400:kworker.0 00000100:00100000:0.0:1789304422.675041:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304422.675129:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789304422.675135:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785605376:0@lo:400:kworker.0 00000100:00100000:0.0:1789304422.675159:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304422.675177:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785605888:0@lo:400:kworker.0 00000100:00100000:0.0:1789304422.675196:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304422.675266:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785605248:0@lo:400:kworker.0 00000100:00100000:1.0:1789304422.675335:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304422.675363:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785605760:0@lo:400:kworker.0 00000100:00100000:1.0:1789304422.675394:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304422.675411:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304422.675416:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785605632:0@lo:400:kworker.0 00000100:00100000:1.0:1789304422.675434:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304422.675570:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785605248 00000100:00100000:0.0:1789304422.675579:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785605248 00000100:00100000:0.0:1789304422.675633:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1789304422.675641:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785605248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304422.675691:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785605248:12345-0@lo:400:kworker.0 Request processed in 52us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304422.675698:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1789304422.675745:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785605248:0@lo:400:kworker.0 00000100:00100000:2.0:1789304422.681567:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785605504 00000100:00100000:2.0:1789304422.681584:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785605504 00000100:00100000:2.0:1789304422.681656:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785605888 00000100:00100000:2.0:1789304422.681659:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785605888 00000100:00100000:2.0:1789304422.681713:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1789304422.681724:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785605504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304422.681832:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785605504:12345-0@lo:400:kworker.0 Request processed in 111us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304422.681840:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1789304422.681857:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1789304422.681863:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785605888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304422.681891:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785605888:12345-0@lo:400:kworker.0 Request processed in 28us (6694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304422.681896:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1789304422.681915:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785605376 00000100:00100000:2.0:1789304422.681918:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785605376 00000100:00100000:2.0:1789304422.681940:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785605760 00000100:00100000:2.0:1789304422.681942:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785605760 00000100:00100000:2.0:1789304422.681957:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785605632 00000100:00100000:2.0:1789304422.681960:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785605632 00000100:00100000:2.0:1789304422.681974:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1789304422.681979:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785605376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304422.682009:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785605376:12345-0@lo:400:kworker.0 Request processed in 30us (6849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304422.682014:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1789304422.682026:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:2.0:1789304422.682032:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785605760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304422.682062:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785605760:12345-0@lo:400:kworker.0 Request processed in 30us (6667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304422.682068:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:2.0:1789304422.682079:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1789304422.682084:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785605632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304422.682151:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785605632:12345-0@lo:400:kworker.0 Request processed in 67us (6716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304422.682157:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1789304422.682206:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785605376:0@lo:400:kworker.0 00000100:00100000:2.0:1789304422.682218:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785605888:0@lo:400:kworker.0 00000100:00100000:2.0:1789304422.682227:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785605504:0@lo:400:kworker.0 00000100:00080000:3.0:1789304422.687664:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789304422.687677:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304422.687798:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785605632:0@lo:400:kworker.0 00000100:00100000:0.0:1789304422.687812:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785605760:0@lo:400:kworker.0 00010000:00010000:2.0:1789304422.738327:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304423.762509:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304424.788839:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304425.235824:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785606016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304425.235902:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304425.235992:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785606016 00000100:00100000:0.0:1789304425.236000:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785606016 00000100:00100000:0.0:1789304425.236054:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1789304425.236064:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785606016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304425.236118:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304425.236167:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785606016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304425.236188:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1789304425.236236:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785606016:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304425.236638:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304425.313694:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304425.313738:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304425.313864:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304425.314056:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765514880 00000100:00100000:2.0:1789304425.314066:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765514880 00000100:00100000:2.0:1789304425.314157:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1319 00000100:00100000:2.0:1789304425.314167:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765514880:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304425.314246:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765514880:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304425.314254:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1319 00000100:00080000:1.0:1789304425.314570:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304425.314701:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765515008 00000100:00100000:0.0:1789304425.314707:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765515008 00000100:00100000:0.0:1789304425.314757:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 970 00000100:00100000:0.0:1789304425.314766:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765515008:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304425.314801:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765515008:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304425.314807:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 970 00000100:00080000:1.0:1789304425.314976:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304425.319772:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765514752 00000100:00100000:3.0:1789304425.319788:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765514752 00000100:00100000:3.0:1789304425.319848:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1096 00000100:00100000:3.0:1789304425.319860:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765514752:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304425.319946:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765514752:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (6206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304425.319954:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1096 00000100:00100000:2.0:1789304425.320408:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304425.320836:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765515136 00000100:00100000:3.0:1789304425.320842:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765515136 00000100:00100000:3.0:1789304425.320902:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 971 00000100:00100000:3.0:1789304425.320912:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765515136:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304425.321498:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765515136:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 52us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304425.321507:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 971 00000100:00080000:1.0:1789304425.321564:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304425.810283:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304426.259115:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785606144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304426.259192:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304426.261633:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785606144 00000100:00100000:2.0:1789304426.261647:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785606144 00000100:00100000:2.0:1789304426.261751:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1789304426.261762:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785606144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304426.261816:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304426.261873:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304426.262144:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785606144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 383us (2951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304426.262152:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1789304426.262531:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785606144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304426.837486:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304427.794407:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785606656:0@lo:400:kworker.0 00000100:00100000:3.0:1789304427.794479:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304427.794518:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785606656 00000100:00100000:1.0:1789304427.794527:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785606656 00000100:00100000:3.0:1789304427.794556:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789304427.794564:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785606272:0@lo:400:kworker.0 00000100:00100000:1.0:1789304427.794580:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1789304427.794595:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785606656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304427.794602:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304427.794632:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785606784:0@lo:400:kworker.0 00000100:00100000:1.0:1789304427.794663:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785606656:12345-0@lo:400:kworker.0 Request processed in 72us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304427.794664:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304427.794674:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1789304427.794694:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785606784 00000100:00100000:1.0:1789304427.794696:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785606784 00000100:00100000:3.0:1789304427.794708:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785606656:0@lo:400:kworker.0 00000100:00100000:1.0:1789304427.794716:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1789304427.794740:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785606784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304427.794741:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785606272 00000100:00100000:3.0:1789304427.794748:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785606272 00000100:00100000:1.0:1789304427.794783:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785606784:12345-0@lo:400:kworker.0 Request processed in 62us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304427.794788:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1789304427.794792:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1789304427.794801:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785606272:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789304427.794809:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304427.794841:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785606272:12345-0@lo:400:kworker.0 Request processed in 44us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304427.794848:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1789304427.794918:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785606528:0@lo:400:kworker.0 00000100:00100000:0.0:1789304427.794947:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304427.794957:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785606400:0@lo:400:kworker.0 00000100:00100000:0.0:1789304427.794976:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785606528 00000100:00100000:0.0:1789304427.794979:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785606528 00000100:00100000:2.0:1789304427.794995:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304427.795004:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:0.0:1789304427.795011:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785606528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304427.795023:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785606912:0@lo:400:kworker.0 00000100:00100000:0.0:1789304427.795059:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785606528:12345-0@lo:400:kworker.0 Request processed in 48us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304427.795060:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304427.795076:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:0.0:1789304427.795107:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785606912 00000100:00100000:0.0:1789304427.795110:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785606912 00000100:00100000:3.0:1789304427.795174:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785606400 00000100:00100000:3.0:1789304427.795180:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785606400 00000100:00100000:1.0:1789304427.795198:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785606528:0@lo:400:kworker.0 00000100:00100000:3.0:1789304427.795214:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:3.0:1789304427.795224:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785606400:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789304427.795224:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304427.795279:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785606400:12345-0@lo:400:kworker.0 Request processed in 57us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304427.795285:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:3.0:1789304427.795314:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785606272:0@lo:400:kworker.0 00000100:00100000:3.0:1789304427.795323:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785606784:0@lo:400:kworker.0 00000100:00100000:3.0:1789304427.795351:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785606400:0@lo:400:kworker.0 00000100:00100000:0.0:1789304427.795433:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1789304427.795441:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785606912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304427.795478:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785606912:12345-0@lo:400:kworker.0 Request processed in 38us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304427.795485:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1789304427.795587:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785606912:0@lo:400:kworker.0 00010000:00010000:1.0:1789304427.858553:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304428.882759:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304429.906390:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304430.363062:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304430.363084:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785607040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304430.363299:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304430.363418:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785607040 00000100:00100000:1.0:1789304430.363426:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785607040 00000100:00100000:1.0:1789304430.363599:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1789304430.363611:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785607040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304430.363647:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304430.363726:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785607040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304430.363736:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00080000:2.0:1789304430.363810:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304430.363848:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785607040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304430.433356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304430.433402:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304430.433443:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304430.433477:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304430.433501:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765515648 00000100:00100000:2.0:1789304430.433513:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765515264 00000100:00100000:0.0:1789304430.433515:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765515648 00000100:00100000:2.0:1789304430.433519:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765515264 00000100:00100000:0.0:1789304430.433574:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765515520 00000100:00100000:2.0:1789304430.433577:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1098 00000100:00100000:0.0:1789304430.433579:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765515520 00000100:00100000:2.0:1789304430.433590:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765515264:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304430.433608:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 974 00000100:00100000:0.0:1789304430.433618:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765515648:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304430.433663:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765515264:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304430.433664:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765515648:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304430.433680:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1098 00000100:00100000:0.0:1789304430.433681:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 974 00000100:00100000:0.0:1789304430.433705:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 975 00000100:00100000:0.0:1789304430.433713:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765515520:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:2.0:1789304430.433724:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304430.433730:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304430.433740:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765515520:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304430.433747:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 975 00000100:00100000:1.0:1789304430.434930:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765515392 00000100:00100000:1.0:1789304430.434941:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765515392 00000100:00100000:1.0:1789304430.435012:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1323 00000100:00100000:1.0:1789304430.435021:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765515392:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304430.435078:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765515392:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 58us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304430.435086:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1323 00000100:00080000:2.0:1789304430.435441:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304430.930539:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304431.378470:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304431.378495:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785607168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304431.378570:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304431.378797:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785607168 00000100:00100000:2.0:1789304431.378806:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785607168 00000100:00100000:2.0:1789304431.378875:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1789304431.378886:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785607168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304431.378921:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304431.378971:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785607168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304431.378978:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00080000:0.0:1789304431.379537:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304431.379579:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785607168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304431.956899:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304432.022645:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304432.022946:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765515776 00000100:00100000:3.0:1789304432.022961:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765515776 00000100:00100000:3.0:1789304432.023051:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 735 00000100:00100000:3.0:1789304432.023065:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:46131:x1876219765515776:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304432.023223:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:46131:x1876219765515776:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 161us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304432.023231:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 735 00000100:00080000:0.0:1789304432.023933:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304432.026543:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304432.026962:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765515904 00000100:00100000:1.0:1789304432.027036:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765515904 00000100:00080000:0.0:1789304432.027481:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304432.031543:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 400 00000100:00100000:1.0:1789304432.031564:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:46131:x1876219765515904:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304432.032006:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:46131:x1876219765515904:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 449us (6040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304432.032015:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 400 00000100:00100000:3.0:1789304432.034929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304432.041078:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765516032 00000100:00100000:2.0:1789304432.041102:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765516032 00000100:00100000:2.0:1789304432.041261:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 401 00000100:00100000:2.0:1789304432.041280:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:46131:x1876219765516032:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:3.0:1789304432.041869:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304432.042422:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:46131:x1876219765516032:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1146us (7500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304432.042428:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 401 00000100:00100000:3.0:1789304432.047345:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304432.047400:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765516160 00000100:00100000:2.0:1789304432.047410:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765516160 00000100:00100000:2.0:1789304432.047465:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 736 00000100:00100000:2.0:1789304432.047475:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46131:x1876219765516160:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304432.047947:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46131:x1876219765516160:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 472us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304432.047954:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 736 00000100:00100000:3.0:1789304432.051937:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304432.052392:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765516288 00000100:00100000:0.0:1789304432.052402:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765516288 00000100:00100000:0.0:1789304432.052461:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 737 00000100:00100000:0.0:1789304432.052472:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46131:x1876219765516288:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304432.052666:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46131:x1876219765516288:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 187us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304432.052675:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 737 00000100:00100000:0.0:1789304432.058190:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304432.058376:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765516416 00000100:00100000:3.0:1789304432.058386:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765516416 00000100:00100000:3.0:1789304432.058484:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 402 00000100:00100000:3.0:1789304432.058495:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:46131:x1876219765516416:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304432.058861:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:46131:x1876219765516416:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 369us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304432.058867:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 402 00000100:00100000:2.0:1789304432.061022:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304432.061078:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765516544 00000100:00100000:1.0:1789304432.061103:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765516544 00000100:00100000:1.0:1789304432.061222:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 403 00000100:00100000:1.0:1789304432.061234:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:46131:x1876219765516544:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304432.061575:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:46131:x1876219765516544:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 343us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304432.061583:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 403 00000100:00100000:3.0:1789304432.063262:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304432.063449:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765516672 00000100:00100000:2.0:1789304432.063459:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765516672 00000100:00100000:2.0:1789304432.063504:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 738 00000100:00100000:2.0:1789304432.063514:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:46131:x1876219765516672:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304432.063852:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:46131:x1876219765516672:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 339us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304432.063859:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 738 00000100:00100000:0.0:1789304432.089375:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304432.089522:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765516800 00000100:00100000:2.0:1789304432.089534:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765516800 00000100:00100000:2.0:1789304432.089726:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 739 00000100:00100000:2.0:1789304432.089742:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46132:x1876219765516800:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304432.089774:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304432.089799:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100341 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.089875:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295e78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.089892:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.089905:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304432.089943:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:2.0:1789304432.089947:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304432.089966:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.089992:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100341 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.090011:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100341 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.090026:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304432.090030:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304432.090034:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789304432.090205:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:46132:x1876219765516800:12345-192.168.202.29@tcp:101:rm.0 Request processed in 458us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304432.090212:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 739 00000100:00100000:3.0:1789304432.109052:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304432.109304:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765517056 00000100:00100000:0.0:1789304432.109318:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765517056 00000100:00100000:0.0:1789304432.109386:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 740 00000100:00100000:0.0:1789304432.109397:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:46132:x1876219765517056:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304432.109422:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304432.109446:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231295e7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100348 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304432.109535:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00010000:0.0:1789304432.110944:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231295e7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100348 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304432.110963:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:0.0:1789304432.110966:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789304432.110972:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231295e7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100348 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304432.110986:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afae00, rc 0) 00000100:00100000:0.0:1789304432.111135:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:46132:x1876219765517056:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1739us (2091us total) trans 4294967577 rc 301/301 00000100:00100000:0.0:1789304432.111144:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 740 00000100:00100000:0.0:1789304432.116528:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304432.116713:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765517184 00000100:00100000:2.0:1789304432.116723:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765517184 00000100:00100000:2.0:1789304432.116822:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:2.0:1789304432.116834:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:46132:x1876219765517184:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:2.0:1789304432.121129:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:46132:x1876219765517184:12345-192.168.202.29@tcp:37:rm.0 Request processed in 4254us (4568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304432.121143:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:3.0:1789304432.125809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304432.125921:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765517440 00000100:00100000:1.0:1789304432.125934:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765517440 00000100:00100000:1.0:1789304432.125997:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 78 00000100:00100000:1.0:1789304432.126008:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:46132:x1876219765517440:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:1.0:1789304432.126299:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:46132:x1876219765517440:12345-192.168.202.29@tcp:35:rm.0 Request processed in 292us (714us total) trans 4294967578 rc 0/0 00000100:00100000:1.0:1789304432.126308:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 78 00000100:00100000:0.0:1789304432.131214:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304432.131569:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765517696 00000100:00100000:2.0:1789304432.131582:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765517696 00000100:00100000:2.0:1789304432.135124:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 741 00000100:00100000:2.0:1789304432.135142:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:46132:x1876219765517696:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304432.135212:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789304432.135250:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295e78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100341 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.135275:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295e1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610032c expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.135288:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304432.135306:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231295b29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100276 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.135318:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:2.0:1789304432.135327:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304432.135353:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.135368:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.135377:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.135390:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.135397:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.135403:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.135994:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295e9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.136005:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.136013:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304432.138731:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00010000:2.0:1789304432.138760:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138772:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295e9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138780:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295e9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138787:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304432.138791:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295e9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138798:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295e9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138813:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9e2c421d2200) 00010000:00010000:2.0:1789304432.138817:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304432.138822:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295e9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138829:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295e9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138858:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138865:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e8d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138872:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138877:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304432.138881:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138887:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e8d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138895:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:2.0:1789304432.138898:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304432.138901:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e8d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304432.138906:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295e8d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304432.138919:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a166821 reply state 00000000aa0f104f transno 4294967579 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304432.138928:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304432.139082:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:46132:x1876219765517696:12345-192.168.202.29@tcp:36:rm.0 Request processed in 3940us (7881us total) trans 4294967579 rc 0/0 00000100:00100000:2.0:1789304432.139119:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 741 00010000:00010000:3.0:1789304432.147942:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304432.147958:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304432.147966:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304432.147974:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304432.147979:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304432.147988:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304432.148006:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c421d2d00) 00010000:00010000:3.0:1789304432.148009:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304432.148015:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304432.148021:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295e94 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789304432.469746:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967577 is committed 00000001:00080000:3.0:1789304432.469765:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967578 is committed 00000001:00080000:3.0:1789304432.469771:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967579 is committed 00000100:00100000:1.0:1789304432.925390:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304432.925416:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785607424:0@lo:400:kworker.0 00000100:00100000:1.0:1789304432.925482:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304432.925551:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785607424 00000100:00100000:1.0:1789304432.925560:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785607424 00000100:00100000:1.0:1789304432.925609:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1789304432.925617:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785607424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304432.925669:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785607424:12345-0@lo:400:kworker.0 Request processed in 52us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304432.925677:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1789304432.925721:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785607424:0@lo:400:kworker.0 00000100:00100000:1.0:1789304432.925758:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785607552:0@lo:400:kworker.0 00000100:00100000:1.0:1789304432.925782:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304432.925831:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304432.925837:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785607936:0@lo:400:kworker.0 00000100:00100000:1.0:1789304432.925858:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304432.925882:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785607552 00000100:00100000:1.0:1789304432.925885:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785607552 00000100:00100000:1.0:1789304432.925908:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785607936 00000100:00100000:1.0:1789304432.925911:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785607936 00000100:00100000:1.0:1789304432.925938:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1789304432.926215:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785607296:0@lo:400:kworker.0 00000100:00100000:0.0:1789304432.926319:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304432.926347:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785607808:0@lo:400:kworker.0 00000100:00100000:0.0:1789304432.926371:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304432.926391:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304432.926396:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785607680:0@lo:400:kworker.0 00000100:00100000:0.0:1789304432.926419:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304432.926448:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1789304432.926457:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785607936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304432.926492:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785607936:12345-0@lo:400:kworker.0 Request processed in 38us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304432.926498:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1789304432.926518:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785607296 00000100:00100000:0.0:1789304432.926523:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785607296 00000100:00100000:0.0:1789304432.926551:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1789304432.926556:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785607296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304432.926586:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785607296:12345-0@lo:400:kworker.0 Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304432.926591:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1789304432.926617:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785607808 00000100:00100000:0.0:1789304432.926621:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785607808 00000100:00100000:0.0:1789304432.926644:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785607680 00000100:00100000:0.0:1789304432.926646:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785607680 00000100:00100000:0.0:1789304432.926664:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1789304432.926670:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785607808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304432.926698:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785607808:12345-0@lo:400:kworker.0 Request processed in 29us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304432.926704:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1789304432.926715:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1789304432.926721:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785607680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304432.926747:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785607680:12345-0@lo:400:kworker.0 Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304432.926753:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1789304432.926786:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785607680:0@lo:400:kworker.0 00000100:00100000:0.0:1789304432.926793:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785607296:0@lo:400:kworker.0 00000100:00100000:0.0:1789304432.926800:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785607808:0@lo:400:kworker.0 00000100:00100000:0.0:1789304432.926829:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785607936:0@lo:400:kworker.0 00000100:00100000:1.0:1789304432.928059:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785607552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304432.928197:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785607552:12345-0@lo:400:kworker.0 Request processed in 2244us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304432.928205:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00080000:1.0:1789304432.928235:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304432.928439:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304432.928561:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785607552:0@lo:400:kworker.0 00010000:00010000:2.0:1789304432.978809:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304434.002533:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304434.800083:0:79160:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfb51ed40 20000000:00000080:3.0:1789304434.800130:0:79160:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3fcbe400 uarg=0000000000000000 10000000:01000000:3.0:1789304434.800209:0:79160:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304434.800229:0:79160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304434.800247:0:79160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295b1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295b14 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304434.800256:0:79160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304434.800297:0:79160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295b1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295b14 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304434.800316:0:79160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295b1b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295b14 expref: 18 pid: 5846 timeout: 2034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304434.800332:0:79160:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79160:1876219785608064:0@lo:104: 00000100:00100000:3.0:1789304434.800413:0:79160:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304434.800472:0:79160:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03853540 going to sleep for 11 seconds 00000100:00100000:2.0:1789304434.800670:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785608064 00000100:00100000:2.0:1789304434.800688:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785608064 00000100:00100000:2.0:1789304434.800745:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789304434.800754:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:79160:x1876219785608064:12345-0@lo:104: 00010000:00010000:2.0:1789304434.800769:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.800836:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304434.800843:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:79160:x1876219785608064:12345-0@lo:104: Request processed in 90us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304434.800851:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00010000:2.0:1789304434.800873:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304434.800879:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.800887:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304434.800890:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.800898:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304434.800905:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304434.800910:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304434.800950:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.800956:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304434.800975:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.800982:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e600/0xefc0bb7231295b14 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295b1b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.800995:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304434.800997:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304434.800999:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304434.801013:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304434.801024:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785608192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304434.801052:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304434.801083:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785608192 00000100:00100000:2.0:1789304434.801109:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785608192 00010000:00010000:2.0:1789304434.801128:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295b1b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295b14 expref: 19 pid: 5846 timeout: 2034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304434.801149:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1789304434.801155:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785608192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304434.801165:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304434.801180:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295b1b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295b14 expref: 19 pid: 5846 timeout: 2034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801192:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295b1b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295b14 expref: 19 pid: 5846 timeout: 2034 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801207:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801215:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801229:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801236:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801243:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801254:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801260:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304434.801264:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801272:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801280:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304434.801290:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304434.801316:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785608192:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304434.801322:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1789304434.801358:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785608192:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304434.801767:0:79160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231295b1b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295b14 expref: 18 pid: 5846 timeout: 2034 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304434.801779:0:79160:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79160:1876219785608064:0@lo:104: 00010000:00010000:3.0:1789304434.801794:0:79160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304434.801803:0:79160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304434.801809:0:79160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304434.801815:0:79160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231295ea2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304435.026922:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304435.482566:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785608320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304435.482650:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304435.482728:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785608320 00000100:00100000:3.0:1789304435.482736:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785608320 00000100:00100000:3.0:1789304435.482800:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1789304435.482810:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785608320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304435.482846:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304435.482903:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785608320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304435.482910:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1789304435.483065:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785608320:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304435.485817:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304435.563114:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304435.563147:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304435.563186:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304435.563211:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304435.563240:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765518080 00000100:00100000:0.0:1789304435.563250:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765518080 00000100:00100000:0.0:1789304435.563304:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765518208 00000100:00100000:0.0:1789304435.563307:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765518208 00000100:00100000:1.0:1789304435.564414:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765517824 00000100:00100000:1.0:1789304435.564420:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765517824 00000100:00100000:1.0:1789304435.564450:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1100 00000100:00100000:1.0:1789304435.564458:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765517824:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304435.564520:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765517824:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 64us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304435.564525:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1100 00000100:00100000:1.0:1789304435.564559:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765517952 00000100:00100000:1.0:1789304435.564563:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765517952 00000100:00100000:1.0:1789304435.564592:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1327 00000100:00100000:1.0:1789304435.564599:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765517952:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304435.564639:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765517952:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304435.564646:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1327 00000100:00100000:1.0:1789304435.564667:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 978 00000100:00100000:1.0:1789304435.564675:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765518080:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304435.564701:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765518080:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304435.564710:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 978 00000100:00080000:1.0:1789304435.564733:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304435.564737:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304435.564739:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304435.565055:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 979 00000100:00100000:0.0:1789304435.565064:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765518208:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304435.565116:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765518208:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 53us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304435.565121:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 979 10000000:01000000:3.0:1789304435.859320:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304435.859329:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304435.859335:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304435.859418:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304435.859431:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304435.859442:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304435.859472:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785608448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304435.859545:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304435.859656:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13cf80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304435.859671:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785608448 00000100:00100000:2.0:1789304435.859679:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785608448 00000020:00000080:0.0:1789304435.861208:0:79209:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc45afb860 20000000:00000080:0.0:1789304435.861225:0:79209:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36f25400 uarg=0000000000000000 10000000:01000000:0.0:1789304435.861268:0:79209:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304435.861287:0:79209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304435.861302:0:79209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304435.861312:0:79209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304435.861319:0:79209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304435.861326:0:79209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304435.861334:0:79209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304435.861340:0:79209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304435.861344:0:79209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304435.861352:0:79209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304435.861365:0:79209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304435.861373:0:79209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304435.861379:0:79209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231295eb0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304435.869231:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1789304435.869252:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785608448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304435.869273:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304435.869297:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295eb7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295ea9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304435.869485:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295eb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295ea9 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304435.869506:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295eb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295ea9 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304435.869517:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40eccc00, rc 0) 00000100:00100000:2.0:1789304435.869603:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785608448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 360us (10058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304435.869611:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1789304435.869718:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785608448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304435.869737:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304435.869747:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304435.869768:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304435.869773:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304435.869781:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304436.052712:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304436.505628:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304436.505650:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785608576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304436.505718:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304436.507655:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785608576 00000100:00100000:3.0:1789304436.507670:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785608576 00000100:00100000:3.0:1789304436.507738:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1789304436.507748:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785608576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304436.507783:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304436.507860:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785608576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304436.507867:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1789304436.507920:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785608576:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304436.508661:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304437.074404:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304438.035484:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785608960:0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.035634:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785608704:0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.035759:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304438.035805:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785609216:0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.035832:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304438.035857:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789304438.035863:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785608832:0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.035882:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304438.035896:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785609344:0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.035916:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304438.035949:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785608704 00000100:00100000:0.0:1789304438.035969:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785608704 00000100:00100000:0.0:1789304438.036346:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1789304438.036357:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785608704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.036420:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785608704:12345-0@lo:400:kworker.0 Request processed in 65us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304438.036427:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1789304438.036460:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785609216 00000100:00100000:0.0:1789304438.036465:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785609216 00000100:00100000:0.0:1789304438.036508:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785608832 00000100:00100000:0.0:1789304438.036512:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785608832 00000100:00100000:0.0:1789304438.036532:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1789304438.036539:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785609216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.036571:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785609216:12345-0@lo:400:kworker.0 Request processed in 32us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304438.036577:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1789304438.036590:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1789304438.036595:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785608832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.036620:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785608832:12345-0@lo:400:kworker.0 Request processed in 25us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304438.036625:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1789304438.036647:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785609344 00000100:00100000:0.0:1789304438.036650:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785609344 00000100:00100000:0.0:1789304438.036676:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:0.0:1789304438.036682:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785609344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.036709:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785609344:12345-0@lo:400:kworker.0 Request processed in 28us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304438.036715:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:0.0:1789304438.036771:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785608832:0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.036781:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785609344:0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.036788:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785608704:0@lo:400:kworker.0 00000100:00100000:0.0:1789304438.036796:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785609216:0@lo:400:kworker.0 00000100:00100000:1.0:1789304438.037827:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304438.037862:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304438.037871:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785609088:0@lo:400:kworker.0 00000100:00100000:2.0:1789304438.037874:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785608960 00000100:00100000:2.0:1789304438.037880:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785608960 00000100:00100000:1.0:1789304438.037896:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304438.037911:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1789304438.037919:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785608960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789304438.037928:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304438.037931:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304438.037934:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304438.037942:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785609088 00000100:00100000:1.0:1789304438.037946:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785609088 00000100:00100000:2.0:1789304438.037962:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785608960:12345-0@lo:400:kworker.0 Request processed in 44us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304438.037969:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1789304438.037995:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1789304438.038001:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785609088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304438.038181:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785609088:12345-0@lo:400:kworker.0 Request processed in 180us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304438.038295:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00080000:1.0:1789304438.038311:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304438.038330:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785609088:0@lo:400:kworker.0 00000100:00100000:1.0:1789304438.038336:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785608960:0@lo:400:kworker.0 00010000:00010000:1.0:1789304438.098646:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304438.326994:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304438.327490:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765518336 00000100:00100000:2.0:1789304438.327500:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765518336 00000100:00100000:2.0:1789304438.327576:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 742 00000100:00100000:2.0:1789304438.327593:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:46246:x1876219765518336:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304438.327726:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304438.327750:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295ebe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610034f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.327878:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295ec5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.327893:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.327906:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304438.327941:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789304438.327945:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304438.327965:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.327988:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231295ebe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610034f expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.328008:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610034f expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.328016:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304438.328020:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304438.328023:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecda00, rc 0) 00000100:00100000:2.0:1789304438.328083:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46246:x1876219765518336:12345-192.168.202.29@tcp:101:rm.0 Request processed in 498us (1098us total) trans 0 rc 0/0 00000100:00080000:1.0:1789304438.328317:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304438.328479:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 742 00000100:00100000:1.0:1789304438.331353:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304438.331490:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765518464 00000100:00100000:2.0:1789304438.331501:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765518464 00000100:00100000:2.0:1789304438.331557:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 743 00000100:00100000:2.0:1789304438.331567:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:46246:x1876219765518464:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304438.331596:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304438.331621:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295ecc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100356 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331681:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295ed3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331696:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331708:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331723:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295eda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331730:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295eda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331737:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295eda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331943:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295ed3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331952:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295ed3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331958:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331963:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304438.331968:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331979:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295ed3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.331990:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304438.331994:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304438.331998:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295ed3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332004:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231295ed3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332017:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295eda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332023:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295eda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332028:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295eda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332033:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304438.332036:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295eda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332042:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295eda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332049:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304438.332052:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304438.332054:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295eda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332064:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231295eda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332124:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295ecc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100356 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332134:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304438.332149:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304438.332154:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231295ecc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100356 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304438.332164:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecca00, rc 0) 00000100:00100000:2.0:1789304438.332230:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:46246:x1876219765518464:12345-192.168.202.29@tcp:101:rm.0 Request processed in 663us (886us total) trans 0 rc 301/301 00000100:00100000:2.0:1789304438.332236:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 743 00000100:00100000:3.0:1789304438.366607:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304438.366748:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765518848 00000100:00100000:1.0:1789304438.366760:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765518848 00000100:00100000:1.0:1789304438.366843:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 744 00000100:00100000:1.0:1789304438.366855:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:46250:x1876219765518848:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:1.0:1789304438.366909:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304438.366938:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231295ec5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610034f expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.366960:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:1.0:1789304438.366972:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304438.367454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304438.367585:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765518592 00000100:00100000:0.0:1789304438.367608:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765518592 00000100:00100000:0.0:1789304438.367646:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 745 00000100:00100000:0.0:1789304438.367654:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765518592:12345-192.168.202.29@tcp:41:mkdir.0 00000004:00000024:0.0:1789304438.367684:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789304438.367754:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765518592:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 101us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304438.367773:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 745 00010000:00010000:1.0:1789304438.368159:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ee1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.368175:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.368191:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.368203:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.368211:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.368217:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304438.373502:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00010000:1.0:1789304438.373525:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ee1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.373537:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ee1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.373545:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ee1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.373551:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304438.373556:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ee1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.373564:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ee1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.373580:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:1.0:1789304438.373583:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304438.373714:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ee1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.373722:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295ee1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304438.373743:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b1e494c reply state 000000003affe12d transno 4294967580 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304438.373753:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304438.374886:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46250:x1876219765518848:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 8028us (8284us total) trans 4294967580 rc 0/0 00000100:00100000:1.0:1789304438.374898:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 744 00010000:00010000:0.0:1789304438.376714:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.376729:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.376738:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.376745:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304438.376749:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.376757:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.377453:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c14adda00) 00010000:00010000:0.0:1789304438.377458:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304438.377463:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.377471:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ee8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304438.415467:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304438.415543:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765518976 00000100:00100000:1.0:1789304438.415555:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765518976 00000100:00100000:1.0:1789304438.415719:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 746 00000100:00100000:1.0:1789304438.415730:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:46254:x1876219765518976:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:1.0:1789304438.415757:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304438.415782:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295eef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610035d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.415849:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ef6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.415867:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.415880:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304438.415918:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789304438.415922:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304438.415942:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.415964:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295eef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610035d expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.415983:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610035d expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.415991:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:1.0:1789304438.415994:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304438.415998:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8fe00, rc 0) 00000100:00100000:1.0:1789304438.416063:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46254:x1876219765518976:12345-192.168.202.29@tcp:101:chown.0 Request processed in 334us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304438.416071:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 746 00000100:00100000:2.0:1789304438.417828:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304438.417925:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765519104 00000100:00100000:0.0:1789304438.417934:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765519104 00000100:00100000:0.0:1789304438.418014:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 747 00000100:00100000:0.0:1789304438.418025:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:46254:x1876219765519104:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:0.0:1789304438.418041:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304438.418058:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295efd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100364 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418157:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295f04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418172:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295f04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418182:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295f04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418195:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295f0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418202:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295f0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418208:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295f0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418304:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295f12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418312:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418319:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304438.418348:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:0.0:1789304438.418352:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304438.418371:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295f12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418384:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295f04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418391:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295f04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418398:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295f04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418405:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304438.418410:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295f04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418418:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295f04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418429:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:0.0:1789304438.418432:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304438.418437:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295f04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418443:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231295f04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418456:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295f0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418462:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295f0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418468:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295f0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418474:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304438.418477:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295f0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418483:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295f0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418491:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c0558d400) 00010000:00010000:0.0:1789304438.418493:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304438.418496:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295f0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418502:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231295f0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418530:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231295efd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100364 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418543:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295f12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100364 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304438.418551:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558d200) 00010000:00010000:0.0:1789304438.418553:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304438.418555:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa800, rc 0) 00000100:00100000:0.0:1789304438.418951:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:46254:x1876219765519104:12345-192.168.202.29@tcp:101:chown.0 Request processed in 926us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304438.418959:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 747 00000100:00100000:3.0:1789304438.421948:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304438.422047:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765519360 00000100:00100000:1.0:1789304438.422056:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765519360 00000100:00100000:1.0:1789304438.422296:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 748 00000100:00100000:1.0:1789304438.422307:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:46254:x1876219765519360:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:1.0:1789304438.422356:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304438.422383:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231295f12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100364 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.422403:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558d200) 00010000:00010000:1.0:1789304438.422413:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304438.422439:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.422456:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304438.422466:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789304438.461076:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967581 is committed 00000004:00010000:1.0:1789304438.463870:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bbc2772 reply state 000000003b28b1ae transno 4294967581 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304438.463890:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304438.463906:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00080000:1.0:1789304438.464015:0:7654:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789304438.464109:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46254:x1876219765519360:12345-192.168.202.29@tcp:36:chown.0 Request processed in 41786us (42152us total) trans 4294967581 rc 0/0 00000100:00100000:1.0:1789304438.464118:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 748 00010000:00010000:3.0:1789304438.465169:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304438.465233:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304438.465243:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304438.465249:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304438.465254:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304438.465263:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304438.465280:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c14add400) 00010000:00010000:3.0:1789304438.465283:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304438.465288:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304438.465294:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231295f19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304439.123237:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304439.154886:0:79406:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe75cdb770 20000000:00000080:3.0:1789304439.154905:0:79406:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c4126f800 uarg=0000000000000000 10000000:01000000:3.0:1789304439.154951:0:79406:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304439.154972:0:79406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304439.154989:0:79406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295eb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295ea9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304439.156308:0:79406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304439.156365:0:79406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295eb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295ea9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304439.156379:0:79406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295eb7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295ea9 expref: 18 pid: 5845 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304439.156396:0:79406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79406:1876219785609472:0@lo:104: 00000100:00100000:3.0:1789304439.156532:0:79406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304439.156643:0:79406:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8780 going to sleep for 11 seconds 00000100:00100000:1.0:1789304439.156818:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785609472 00000100:00100000:1.0:1789304439.156827:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785609472 00000100:00100000:1.0:1789304439.156886:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789304439.156896:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:79406:x1876219785609472:12345-0@lo:104: 00010000:00010000:1.0:1789304439.156909:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304439.157075:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304439.157082:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:79406:x1876219785609472:12345-0@lo:104: Request processed in 188us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304439.157109:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00010000:2.0:1789304439.157121:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304439.157137:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157145:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304439.157149:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157158:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304439.157170:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304439.157176:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304439.157214:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157221:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304439.157241:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157253:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231295ea9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295eb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157271:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304439.157273:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304439.157275:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304439.157330:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785609600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304439.157357:0:79406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79406:1876219785609472:0@lo:104: 00000100:00100000:1.0:1789304439.157361:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789304439.157377:0:79406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304439.157449:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785609600 00000100:00100000:2.0:1789304439.157454:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785609600 00010000:00010000:2.0:1789304439.157473:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295eb7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295ea9 expref: 19 pid: 5845 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304439.157501:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789304439.157508:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785609600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304439.157519:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304439.157524:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295eb7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295ea9 expref: 19 pid: 5845 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157535:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295eb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295ea9 expref: 19 pid: 5845 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157547:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb7231295eb7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295ea9 expref: 19 pid: 5845 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157561:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157567:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157576:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157581:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157586:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157590:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157593:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304439.157596:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157600:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157613:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.157625:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304439.157632:0:79406:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304439.157640:0:79406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304439.157647:0:79406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231295f20 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304439.157919:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785609600:12345-0@lo:103:ldlm_bl.0 Request processed in 411us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304439.157926:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1789304439.158116:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785609600:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789304439.928087:0:79454:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0e7c2700 20000000:00000080:2.0:1789304439.928830:0:79454:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02055c00 uarg=0000000000000000 10000000:01000000:2.0:1789304439.928888:0:79454:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304439.928976:0:79454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.928995:0:79454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.929008:0:79454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.929016:0:79454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.929023:0:79454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.929030:0:79454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.929037:0:79454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304439.929042:0:79454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.929050:0:79454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.929064:0:79454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.929072:0:79454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304439.929138:0:79454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231295f27 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304440.148707:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304440.210343:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304440.210351:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304440.210357:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304440.210410:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304440.210423:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304440.210434:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304440.210463:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785609728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304440.210610:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304440.210668:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0172ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304440.210867:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785609728 00000100:00100000:0.0:1789304440.210877:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785609728 00000100:00100000:0.0:1789304440.210934:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1789304440.210944:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785609728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304440.210958:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304440.210973:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231295f35 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231295f2e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304440.210996:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231295f35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231295f2e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304440.211007:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231295f35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295f2e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304440.211016:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa400, rc 0) 00000100:00100000:0.0:1789304440.211062:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785609728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304440.211069:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1789304440.211153:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785609728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304440.211169:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304440.211191:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304440.211212:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304440.211217:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304440.211229:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304440.594295:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785609856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304440.594367:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304440.597513:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785609856 00000100:00100000:3.0:1789304440.597530:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785609856 00000100:00080000:1.0:1789304440.597586:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304440.597633:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1789304440.597646:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785609856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304440.597683:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304440.597891:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785609856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 246us (3522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304440.597899:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1789304440.597911:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785609856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304440.704498:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304440.704625:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304440.704666:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304440.704690:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304440.704755:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765519744 00000100:00100000:3.0:1789304440.704767:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765519744 00000100:00100000:3.0:1789304440.704821:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765519872 00000100:00100000:3.0:1789304440.704823:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765519872 00000100:00100000:3.0:1789304440.704842:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 982 00000100:00100000:3.0:1789304440.704851:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765519744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304440.704934:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765519744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304440.704941:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 982 00000100:00100000:3.0:1789304440.704955:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 983 00000100:00100000:3.0:1789304440.704960:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765519872:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304440.705001:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765519872:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304440.705007:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 983 00000100:00100000:3.0:1789304440.705025:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765519616 00000100:00100000:3.0:1789304440.705028:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765519616 00000100:00100000:3.0:1789304440.705055:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1331 00000100:00100000:3.0:1789304440.705061:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765519616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304440.705110:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765519616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304440.705127:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1331 00000100:00080000:3.0:1789304440.705146:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789304440.705150:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304440.705152:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304440.705647:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765519488 00000100:00100000:0.0:1789304440.705653:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765519488 00000100:00100000:0.0:1789304440.705713:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1104 00000100:00100000:0.0:1789304440.705721:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765519488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304440.705763:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765519488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 44us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304440.705770:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1104 00010000:00010000:3.0:1789304441.171265:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304441.618737:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304441.618813:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785609984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304441.618905:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304441.618954:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785609984 00000100:00100000:0.0:1789304441.618964:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785609984 00000100:00080000:3.0:1789304441.619047:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304441.619083:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1789304441.619137:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785609984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304441.619174:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304441.619238:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785609984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304441.619246:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1789304441.619430:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785609984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304442.194600:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304442.387824:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304442.387966:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765520000 00000100:00100000:2.0:1789304442.387977:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765520000 00000100:00100000:2.0:1789304442.388064:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:2.0:1789304442.388074:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:5594:x1876219765520000:12345-192.168.202.29@tcp:103:ldlm_bl.0 00000100:00080000:0.0:1789304442.388263:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304442.388301:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304442.388332:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb7231295ef6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610035d expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304442.388352:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:2.0:1789304442.388365:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304442.389254:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:5594:x1876219765520000:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 1176us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304442.389266:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:1.0:1789304443.154859:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785610496:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.154932:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304443.154991:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789304443.154997:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785610112:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.155029:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304443.155052:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785610624:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.155073:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304443.155129:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785610240:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.155153:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304443.155171:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785610752:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.155192:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304443.155211:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304443.155216:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785610368:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.155234:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304443.155269:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785610496 00000100:00100000:1.0:1789304443.155277:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785610496 00000100:00100000:1.0:1789304443.155332:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785610624 00000100:00100000:1.0:1789304443.155335:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785610624 00000100:00100000:1.0:1789304443.155352:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785610240 00000100:00100000:1.0:1789304443.155355:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785610240 00000100:00100000:1.0:1789304443.155383:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1789304443.155391:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785610496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.155442:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785610496:12345-0@lo:400:kworker.0 Request processed in 51us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304443.155448:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1789304443.155465:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1789304443.155470:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785610624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.155494:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785610624:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304443.155500:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1789304443.155509:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1789304443.155513:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785610240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.155559:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785610240:12345-0@lo:400:kworker.0 Request processed in 45us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304443.155567:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1789304443.155748:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785610240:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.157705:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785610112 00000100:00100000:1.0:1789304443.157718:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785610112 00000100:00100000:1.0:1789304443.157960:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:1.0:1789304443.157969:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785610112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.158048:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785610112:12345-0@lo:400:kworker.0 Request processed in 81us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304443.158055:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:1.0:1789304443.158118:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785610752 00000100:00100000:1.0:1789304443.158123:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785610752 00000100:00100000:1.0:1789304443.158151:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785610368 00000100:00100000:1.0:1789304443.158154:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785610368 00000100:00100000:1.0:1789304443.158174:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1789304443.158180:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785610752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.158216:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785610752:12345-0@lo:400:kworker.0 Request processed in 36us (3022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304443.158221:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1789304443.158231:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:1.0:1789304443.158236:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785610368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.158259:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785610368:12345-0@lo:400:kworker.0 Request processed in 23us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304443.158264:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00080000:1.0:1789304443.158283:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304443.158287:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304443.158290:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304443.158346:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785610368:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.158361:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785610752:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.158393:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785610112:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.158404:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785610624:0@lo:400:kworker.0 00000100:00100000:1.0:1789304443.158415:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785610496:0@lo:400:kworker.0 00010000:00010000:3.0:1789304443.219300:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304443.239834:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304443.239919:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765520128 00000100:00100000:0.0:1789304443.239930:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765520128 00000100:00100000:0.0:1789304443.239993:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 749 00000100:00100000:0.0:1789304443.240004:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:46359:x1876219765520128:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304443.240026:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304443.240049:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610036b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.240313:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295f43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.240331:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.240344:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304443.240387:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789304443.240392:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304443.240413:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.240440:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610036b expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.240458:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295f43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610036b expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.240466:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304443.240469:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304443.240473:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afba00, rc 0) 00000100:00100000:0.0:1789304443.240541:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46359:x1876219765520128:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 538us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304443.240548:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 749 00000100:00100000:0.0:1789304443.254271:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304443.254494:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765520256 00000100:00100000:2.0:1789304443.254504:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765520256 00000100:00100000:2.0:1789304443.254570:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 750 00000100:00100000:2.0:1789304443.254581:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:46359:x1876219765520256:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304443.254602:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304443.254625:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295f4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100372 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.254709:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295f51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.254725:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.254740:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.254755:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295f58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.254763:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.254770:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255337:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295f5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255349:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255357:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304443.255396:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:2.0:1789304443.255400:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304443.255423:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255439:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295f51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255447:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295f51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255456:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295f51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255462:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304443.255479:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295f51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255491:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295f51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255504:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:2.0:1789304443.255508:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304443.255513:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295f51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255521:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295f51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255538:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295f58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255545:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295f58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255552:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295f58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255558:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304443.255561:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295f58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255567:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295f58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255575:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c421d2300) 00010000:00010000:2.0:1789304443.255577:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304443.255580:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295f58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255586:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231295f58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255623:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231295f4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100372 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255640:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100372 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.255648:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304443.255651:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304443.255653:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecce00, rc 0) 00000100:00100000:2.0:1789304443.255743:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46359:x1876219765520256:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 1164us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304443.255751:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 750 00000100:00100000:3.0:1789304443.258955:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304443.259067:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765520512 00000100:00100000:0.0:1789304443.259077:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765520512 00000100:00100000:0.0:1789304443.259190:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 751 00000100:00100000:0.0:1789304443.259200:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:46359:x1876219765520512:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304443.259250:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304443.259275:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231295f5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100372 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.259295:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:0.0:1789304443.259306:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304443.259332:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.259345:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.259355:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304443.314671:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001786f2b7 reply state 0000000064849170 transno 4294967582 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304443.314697:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304443.314714:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000100:00100000:0.0:1789304443.314824:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:46359:x1876219765520512:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 55621us (55876us total) trans 4294967582 rc 0/0 00000100:00100000:0.0:1789304443.314833:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 751 00000001:00080000:1.0:1789304443.314907:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967582 is committed 00010000:00010000:0.0:1789304443.314952:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.314966:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.314974:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.314981:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304443.314986:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.314995:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.315011:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558d000) 00010000:00010000:0.0:1789304443.315014:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304443.315019:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.315024:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304443.350977:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304443.351495:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765520640 00000100:00100000:0.0:1789304443.351507:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765520640 00000100:00100000:0.0:1789304443.351583:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 752 00000100:00100000:0.0:1789304443.351593:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46363:x1876219765520640:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789304443.351621:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304443.351642:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100379 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.351705:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.351719:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.351730:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.351745:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295f7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.351752:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.351758:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352058:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295f82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352067:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352074:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304443.352383:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:0.0:1789304443.352388:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304443.352409:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352420:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352429:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352435:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352440:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304443.352445:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352452:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352463:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304443.352466:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304443.352471:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352477:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231295f74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352489:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352494:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295f7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352500:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295f7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352505:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304443.352508:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295f7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352514:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295f7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352521:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c0558d000) 00010000:00010000:0.0:1789304443.352523:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304443.352526:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295f7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352532:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231295f7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352563:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231295f6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100379 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352710:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295f82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100379 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.352720:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:0.0:1789304443.352722:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304443.352724:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:0.0:1789304443.352922:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:46363:x1876219765520640:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1330us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304443.352930:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 752 00000100:00100000:0.0:1789304443.360858:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304443.361042:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765520896 00000100:00100000:3.0:1789304443.361051:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765520896 00000100:00100000:3.0:1789304443.361147:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 753 00000100:00100000:3.0:1789304443.361159:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46363:x1876219765520896:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304443.361183:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304443.361205:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295f89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100380 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.361451:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295f90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.361465:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295f90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.361475:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295f90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.362977:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.362994:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.363003:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304443.363804:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17:0x0], index 1: 0 00010000:00010000:3.0:1789304443.364027:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295f9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.364036:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295f9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.364042:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295f9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.364068:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295f90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.364073:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295f90 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.364078:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295f90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.364082:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304443.364085:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295f90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.364974:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295f90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.364989:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:3.0:1789304443.364991:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304443.364996:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295f90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.365001:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295f90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304443.365012:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006259f41e reply state 000000000215711c transno 4294967583 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304443.365018:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304443.365050:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295f89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100380 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.365064:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295f9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100380 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.365069:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304443.365071:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304443.365072:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f400, rc 0) 00000100:00100000:3.0:1789304443.365203:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:46363:x1876219765520896:12345-192.168.202.29@tcp:101:touch.0 Request processed in 4045us (4352us total) trans 4294967583 rc 0/0 00000100:00100000:3.0:1789304443.365212:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 753 00010000:00010000:0.0:1789304443.367332:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.367354:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.367361:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.367366:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304443.367372:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.367381:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.367396:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c2ea19000) 00010000:00010000:0.0:1789304443.367399:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304443.367403:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.367409:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231295f97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304443.368716:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304443.368784:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765521152 00000100:00100000:1.0:1789304443.368795:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765521152 00000100:00100000:1.0:1789304443.368857:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 754 00000100:00100000:1.0:1789304443.368936:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:46363:x1876219765521152:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:1.0:1789304443.368994:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304443.369017:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231295f9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100380 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.369032:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:1.0:1789304443.369039:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304443.369075:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.369086:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.369135:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304443.369342:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc4888b0 reply state 0000000050600719 transno 4294967584 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304443.369353:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304443.369432:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:46363:x1876219765521152:12345-192.168.202.29@tcp:36:touch.0 Request processed in 500us (724us total) trans 4294967584 rc 0/0 00000100:00100000:1.0:1789304443.369440:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 754 00010000:00010000:1.0:1789304443.371828:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.371846:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.371854:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.371859:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304443.372120:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.372131:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.372352:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:1.0:1789304443.372358:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304443.372363:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.372371:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231295fac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304443.372562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304443.372657:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765521280 00000100:00100000:1.0:1789304443.372667:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765521280 00000100:00100000:1.0:1789304443.372971:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 755 00000100:00100000:1.0:1789304443.372983:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:46363:x1876219765521280:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304443.373007:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304443.373026:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295fb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100387 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.373081:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100387 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.373288:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100387 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.373310:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:1.0:1789304443.373313:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789304443.373316:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e600, rc 0) 00000100:00100000:1.0:1789304443.373369:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:46363:x1876219765521280:12345-192.168.202.29@tcp:101:touch.0 Request processed in 389us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304443.373376:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 755 00000100:00100000:2.0:1789304443.375205:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304443.375358:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765521408 00000100:00100000:1.0:1789304443.375368:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765521408 00000100:00080000:0.0:1789304443.375417:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304443.375426:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 404 00000100:00100000:1.0:1789304443.375436:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765521408:12345-192.168.202.29@tcp:2:touch.0 00000100:00100000:1.0:1789304443.375813:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765521408:12345-192.168.202.29@tcp:2:touch.0 Request processed in 378us (622us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789304443.375821:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 404 00000100:00100000:3.0:1789304443.377460:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304443.377543:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765521664 00000100:00100000:2.0:1789304443.377551:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765521664 00000100:00100000:2.0:1789304443.377599:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 79 00000100:00100000:1.0:1789304443.377605:0:5856:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1789304443.377608:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:46363:x1876219765521664:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:1.0:1789304443.377613:0:5856:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789304443.377927:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:46363:x1876219765521664:12345-192.168.202.29@tcp:35:touch.0 Request processed in 318us (470us total) trans 4294967585 rc 0/0 00000100:00100000:2.0:1789304443.377934:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 79 00000100:00100000:0.0:1789304443.440535:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304443.440735:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765521792 00000100:00100000:3.0:1789304443.440748:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765521792 00000100:00100000:3.0:1789304443.440816:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 756 00000100:00100000:3.0:1789304443.440827:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:46367:x1876219765521792:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304443.440848:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304443.440880:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295fba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610038e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.440947:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295fc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.440961:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.440972:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.440994:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295fc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441002:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441009:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441152:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441161:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441168:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304443.441204:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 0 00000004:00200000:3.0:1789304443.441209:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304443.441232:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441244:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441252:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441258:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295fc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441268:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441274:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304443.441278:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441285:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295fc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441296:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:3.0:1789304443.441299:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304443.441304:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295fc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441310:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231295fc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441323:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441329:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295fc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441334:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441339:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304443.441341:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441350:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441356:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304443.441358:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304443.441360:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295fc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441364:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231295fc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441394:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295fba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610038e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441406:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610038e expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.441413:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:3.0:1789304443.441415:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304443.441418:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fa00, rc 0) 00000100:00100000:3.0:1789304443.441497:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:46367:x1876219765521792:12345-192.168.202.29@tcp:101:rm.0 Request processed in 672us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304443.441504:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 756 00000100:00100000:0.0:1789304443.448839:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304443.448900:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765521920 00000100:00100000:1.0:1789304443.448913:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765521920 00000100:00100000:1.0:1789304443.448977:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 405 00000100:00100000:1.0:1789304443.448987:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765521920:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304443.449007:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304443.449027:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072cfb9eb/0xefc0bb7231295fd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100395 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789304443.449054:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x6aa69e7b, atime: 0x6aa69e7b, ctime: 0x6aa69e7b, blocks: 0x1 00010000:00010000:1.0:1789304443.449075:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=1893s v=(0 0) 00010000:00010000:1.0:1789304443.449080:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304443.449139:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072cfb9eb/0xefc0bb7231295fd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100395 expref: 7 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.449161:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072cfb9eb/0xefc0bb7231295fd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100395 expref: 7 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304443.449175:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8f400, rc 0) 00000100:00100000:1.0:1789304443.449285:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765521920:12345-192.168.202.29@tcp:101:rm.0 Request processed in 298us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304443.449292:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 405 00000100:00100000:1.0:1789304443.459969:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304443.460399:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765522176 00000100:00100000:2.0:1789304443.460412:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765522176 00000100:00100000:2.0:1789304443.460474:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 757 00000100:00100000:2.0:1789304443.460485:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:46367:x1876219765522176:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304443.460536:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304443.460562:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231295fcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610038e expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.460655:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb7231295fb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100387 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.460667:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:2.0:1789304443.460678:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304443.460701:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295fdd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.460715:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295fdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.460726:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295fdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.460755:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.460763:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.460769:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.460884:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295feb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.460891:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295feb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.460896:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295feb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304443.461708:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9664 00000004:00080000:2.0:1789304443.461721:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1893139629599ns, next at 1894139627015ns, rc = 0 00010000:00010000:2.0:1789304443.461826:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.461838:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.461846:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.461854:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.461998:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462004:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462061:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304443.462085:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295feb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462130:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295feb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462136:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295feb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462143:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304443.462147:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295feb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462155:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295feb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462167:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:2.0:1789304443.462171:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304443.462175:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295feb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462181:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231295feb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462200:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295fdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462207:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295fdd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462212:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295fdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462217:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304443.462220:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295fdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462226:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295fdd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462234:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:2.0:1789304443.462237:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304443.462240:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295fdd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304443.462245:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231295fdd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304443.462256:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001af466f7 reply state 0000000053c791c4 transno 4294967586 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304443.462265:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304443.462343:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:46367:x1876219765522176:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1856us (2378us total) trans 4294967586 rc 0/0 00000100:00100000:2.0:1789304443.462353:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 757 00010000:00010000:3.0:1789304443.463221:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304443.463229:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.463238:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304443.463242:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.463250:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.463262:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:3.0:1789304443.463264:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304443.463268:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.463274:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231295ff2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304443.463291:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304443.463293:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304443.463295:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304443.472017:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.472036:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.472044:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.472051:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304443.472056:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.472064:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.472080:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c421d2300) 00010000:00010000:0.0:1789304443.472083:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304443.472319:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304443.472327:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231295fe4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.244360:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304444.432567:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304444.432731:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765522304 00000100:00100000:3.0:1789304444.432741:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765522304 00000100:00100000:3.0:1789304444.433195:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 758 00000100:00100000:3.0:1789304444.433207:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:46382:x1876219765522304:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304444.433243:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304444.433268:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610039c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.433338:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296000 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.433353:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.433368:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304444.433407:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:3.0:1789304444.433411:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304444.433433:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.433459:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231295ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610039c expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.433476:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296000 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610039c expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.433486:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:3.0:1789304444.433489:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304444.433492:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ea00, rc 0) 00000100:00100000:3.0:1789304444.433553:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:46382:x1876219765522304:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 349us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304444.433560:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 758 00000100:00080000:0.0:1789304444.437790:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304444.450661:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304444.450797:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765522560 00000100:00100000:3.0:1789304444.450806:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765522560 00000100:00100000:3.0:1789304444.450856:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 759 00000100:00100000:3.0:1789304444.450864:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:46382:x1876219765522560:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304444.450913:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304444.450936:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296000 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610039c expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.450953:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231295f82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100379 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.450969:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:3.0:1789304444.450977:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304444.450997:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.451007:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.451016:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304444.499943:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000598c636 reply state 0000000037508382 transno 4294967587 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304444.499958:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304444.500053:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000001:00080000:1.0:1789304444.500209:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967584 is committed 00000001:00080000:1.0:1789304444.500221:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967586 is committed 00000004:00080000:1.0:1789304444.500226:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 67 committed 00000001:00080000:1.0:1789304444.500252:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967587 is committed 00000100:00100000:0.0:1789304444.500489:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785610880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789304444.500554:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789304444.500681:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304444.500693:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46382:x1876219765522560:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 49828us (50041us total) trans 4294967587 rc 0/0 00000100:00100000:3.0:1789304444.500700:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 759 00010000:00010000:1.0:1789304444.500770:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.500778:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.500784:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.500788:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304444.500792:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.500797:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.500809:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:1.0:1789304444.500812:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304444.500816:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.500820:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296007 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304444.502474:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785610880 00000100:00100000:2.0:1789304444.502485:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785610880 00000100:00100000:2.0:1789304444.502536:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1789304444.502545:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785610880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789304444.502571:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:23 count 1 00010000:00010000:2.0:1789304444.502592:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304444.502610:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072cfb9eb/0xefc0bb7231295fd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100395 expref: 6 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304444.502619:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789304444.502623:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304444.502628:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304444.502657:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072cfb9eb/0xefc0bb7231295fd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100395 expref: 6 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304444.502671:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072cfb9eb/0xefc0bb7231295fd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100395 expref: 6 pid: 17212 timeout: 1994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304444.502684:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785611008:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789304444.502758:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c07978f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789304444.506918:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304444.506942:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785611008:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304444.506951:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765522688 00000100:00100000:3.0:1789304444.506958:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765522688 00010000:00010000:2.0:1789304444.506983:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.506996:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072cfb9eb/0xefc0bb7231295fd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100395 expref: 7 pid: 17212 timeout: 1994 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304444.507029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 362 00000100:00100000:3.0:1789304444.507038:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765522688:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789304444.507053:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304444.507060:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072cfb9eb/0xefc0bb7231295fd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100395 expref: 7 pid: 17212 timeout: 1994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.507072:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072cfb9eb/0xefc0bb7231295fd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100395 expref: 7 pid: 17212 timeout: 1994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.507171:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072cfb9eb/0xefc0bb7231295fd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100395 expref: 7 pid: 17212 timeout: 1994 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.507187:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304444.507192:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304444.507198:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.507208:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.507232:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304444.507248:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304444.507257:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304444.507266:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304444.507273:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304444.507282:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765522688:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 246us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304444.507290:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 362 00010000:00010000:2.0:1789304444.507327:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789304444.507844:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785610880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5299us (7287us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789304444.507853:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000004:00080000:0.0:1789304444.507884:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c08b36a00/2, rc 0, transno 4294967343 00000100:00100000:0.0:1789304444.507892:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785610880:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789304444.507901:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304444.507910:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.507919:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304444.507923:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.507937:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.507952:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.507960:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b0a1dc7/0xefc0bb723129600e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.507989:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304444.507990:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304444.507992:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304444.544025:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304444.544242:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765522816 00000100:00100000:1.0:1789304444.544253:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765522816 00000100:00100000:1.0:1789304444.544314:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 760 00000100:00100000:1.0:1789304444.544325:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:46386:x1876219765522816:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304444.544349:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304444.544373:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231296015 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003a3 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544437:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129601c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544452:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129601c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544464:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129601c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544479:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231296023 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544485:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231296023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544489:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231296023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544730:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129602a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544739:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129602a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544746:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129602a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304444.544773:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:1.0:1789304444.544778:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304444.544796:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129602a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544805:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129601c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544810:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129601c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544814:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129601c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544821:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304444.544824:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129601c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544829:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129601c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544837:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:1.0:1789304444.544839:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304444.544843:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129601c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544846:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ea00/0xefc0bb723129601c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544854:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231296023 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544858:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231296023 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544862:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231296023 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544865:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304444.544866:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231296023 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544869:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231296023 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544876:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c14add700) 00010000:00010000:1.0:1789304444.544877:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304444.544879:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231296023 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544882:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fa00/0xefc0bb7231296023 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544911:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e800/0xefc0bb7231296015 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003a3 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544920:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129602a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003a3 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.544924:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:1.0:1789304444.544926:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304444.544927:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c10e8e600, rc 0) 00000100:00100000:1.0:1789304444.544996:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46386:x1876219765522816:12345-192.168.202.29@tcp:101:touch.0 Request processed in 673us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304444.545006:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 760 00000100:00100000:0.0:1789304444.547701:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304444.547782:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765523072 00000100:00100000:1.0:1789304444.547792:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765523072 00000100:00100000:1.0:1789304444.547863:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 761 00000100:00100000:1.0:1789304444.547870:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:46386:x1876219765523072:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304444.547887:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304444.547911:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231296031 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003aa expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.548209:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231296038 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.548223:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231296038 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.548234:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231296038 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.548248:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.548255:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.548262:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789304444.548928:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18:0x0], index 0: 0 00010000:00010000:1.0:1789304444.549256:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296046 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549268:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549363:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549402:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231296038 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549414:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231296038 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549421:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231296038 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549427:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304444.549432:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231296038 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549441:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231296038 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549452:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:1.0:1789304444.549455:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304444.549459:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231296038 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549465:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8ee00/0xefc0bb7231296038 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304444.549478:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000145886a6 reply state 000000008d807698 transno 4294967588 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304444.549486:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789304444.549514:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8f400/0xefc0bb7231296031 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003aa expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549528:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003aa expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.549540:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:1.0:1789304444.549542:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304444.549544:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370600, rc 0) 00000100:00100000:1.0:1789304444.549606:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:46386:x1876219765523072:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1735us (1914us total) trans 4294967588 rc 0/0 00000100:00100000:1.0:1789304444.549614:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 761 00000100:00100000:2.0:1789304444.554621:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:1.0:1789304444.554634:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.554648:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.554656:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.554662:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304444.554666:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.554674:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.554690:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c14add200) 00010000:00010000:1.0:1789304444.554693:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304444.554699:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.554705:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8fe00/0xefc0bb723129603f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304444.554805:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765523328 00000100:00100000:3.0:1789304444.554816:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765523328 00000100:00100000:3.0:1789304444.554878:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 762 00000100:00100000:3.0:1789304444.554888:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:46386:x1876219765523328:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:3.0:1789304444.554938:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304444.554955:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296046 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003aa expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.554968:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:3.0:1789304444.554975:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304444.555015:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.555028:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.555038:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304444.555400:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae3ba939 reply state 00000000cdd794c4 transno 4294967589 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304444.555410:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304444.555579:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:46386:x1876219765523328:12345-192.168.202.29@tcp:36:touch.0 Request processed in 690us (968us total) trans 4294967589 rc 0/0 00000100:00100000:3.0:1789304444.555587:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 762 00000100:00100000:2.0:1789304444.558003:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304444.558118:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765523456 00000100:00100000:3.0:1789304444.558139:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765523456 00000100:00100000:3.0:1789304444.558197:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 763 00000100:00100000:3.0:1789304444.558207:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:46386:x1876219765523456:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304444.558231:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304444.558250:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb723129605b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003b1 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.558313:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb723129605b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003b1 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.558333:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb723129605b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003b1 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.558352:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304444.558355:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789304444.558359:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f000, rc 0) 00000100:00100000:3.0:1789304444.558409:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:46386:x1876219765523456:12345-192.168.202.29@tcp:101:touch.0 Request processed in 204us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304444.558414:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 763 00010000:00010000:1.0:1789304444.559154:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.559167:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.559175:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.559182:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304444.559186:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.559195:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.559209:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:1.0:1789304444.559212:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304444.559216:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.559222:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296054 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304444.560429:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304444.560468:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765523584 00000100:00100000:1.0:1789304444.560478:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765523584 00000100:00100000:1.0:1789304444.560542:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 407 00000100:00100000:1.0:1789304444.560552:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765523584:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:0.0:1789304444.560589:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304444.560847:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765523584:12345-192.168.202.29@tcp:2:touch.0 Request processed in 297us (421us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1789304444.560859:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 407 00000100:00100000:2.0:1789304444.562504:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304444.562562:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765523840 00000100:00100000:0.0:1789304444.562570:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765523840 00000100:00100000:0.0:1789304444.562610:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 80 00000100:00100000:0.0:1789304444.562619:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:46386:x1876219765523840:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:0.0:1789304444.562875:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:46386:x1876219765523840:12345-192.168.202.29@tcp:35:touch.0 Request processed in 258us (376us total) trans 4294967590 rc 0/0 00000100:00100000:0.0:1789304444.562881:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 80 00000100:00100000:2.0:1789304444.582932:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304444.582997:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765523968 00000100:00100000:1.0:1789304444.583006:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765523968 00000100:00100000:3.0:1789304444.583133:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 764 00000100:00100000:3.0:1789304444.583146:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:46390:x1876219765523968:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304444.583180:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304444.583204:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003b8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583463:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296069 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583478:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296069 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583490:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296069 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583506:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583518:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583525:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583607:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296077 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583615:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583622:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304444.583654:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3f:0x0]: returning size 0 00000004:00200000:3.0:1789304444.583659:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304444.583677:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583687:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583693:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296069 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583696:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296069 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583700:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296069 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583707:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304444.583710:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296069 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583715:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296069 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583722:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:3.0:1789304444.583724:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304444.583728:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296069 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583731:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296069 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583739:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583743:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296070 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583747:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583749:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304444.583751:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583754:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583760:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c2ea19800) 00010000:00010000:3.0:1789304444.583762:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304444.583763:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296070 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583767:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583786:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003b8 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583795:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296077 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003b8 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.583799:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304444.583800:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304444.583802:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f400, rc 0) 00000100:00100000:3.0:1789304444.583855:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:46390:x1876219765523968:12345-192.168.202.29@tcp:101:rm.0 Request processed in 713us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304444.583860:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 764 00000100:00100000:2.0:1789304444.585525:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304444.585574:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765524096 00000100:00100000:1.0:1789304444.585581:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765524096 00000100:00100000:1.0:1789304444.585618:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 408 00000100:00100000:1.0:1789304444.585626:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765524096:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304444.585640:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304444.585657:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce78f918/0xefc0bb723129607e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003bf expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789304444.585679:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x6aa69e7c, atime: 0x6aa69e7c, ctime: 0x6aa69e7c, blocks: 0x1 00010000:00010000:1.0:1789304444.585694:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=1894s v=(0 0) 00010000:00010000:1.0:1789304444.585697:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304444.585703:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce78f918/0xefc0bb723129607e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003bf expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.585717:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce78f918/0xefc0bb723129607e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003bf expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.585725:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370400, rc 0) 00000100:00100000:1.0:1789304444.585762:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765524096:12345-192.168.202.29@tcp:101:rm.0 Request processed in 137us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304444.585769:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 408 00000100:00100000:2.0:1789304444.587185:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304444.587344:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765524352 00000100:00100000:3.0:1789304444.587351:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765524352 00000100:00100000:3.0:1789304444.587404:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 765 00000100:00100000:3.0:1789304444.587414:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:46390:x1876219765524352:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:3.0:1789304444.587468:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304444.587489:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296077 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003b8 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.587508:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb723129605b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003b1 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.587514:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304444.587522:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304444.587537:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296085 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.587546:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296085 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.587552:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296085 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.587561:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.587565:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.587569:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.587645:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296093 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.587649:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.587653:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304444.589264:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].24, 64 off9728 00000004:00080000:3.0:1789304444.589278:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1894267186959ns, next at 1895267183994ns, rc = 0 00010000:00010000:3.0:1789304444.589349:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589365:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589376:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589385:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589392:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589399:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589425:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304444.589451:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296093 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589457:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296093 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589464:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296093 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589470:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304444.589477:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296093 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589485:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296093 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589498:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304444.589502:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304444.589506:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296093 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589513:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296093 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589533:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296085 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589539:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296085 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589544:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296085 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589549:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304444.589551:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296085 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589558:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296085 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589566:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:3.0:1789304444.589568:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304444.589571:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296085 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304444.589577:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296085 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304444.589586:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3c9bcfb reply state 00000000ce7a6f6d transno 4294967591 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304444.589595:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304444.589679:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:46390:x1876219765524352:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2264us (2501us total) trans 4294967591 rc 0/0 00000100:00100000:3.0:1789304444.589689:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 765 00010000:00010000:1.0:1789304444.589885:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304444.589892:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.589898:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304444.589901:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.589907:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.589916:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:1.0:1789304444.589918:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304444.589921:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.589926:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129609a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.589940:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304444.589942:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304444.589944:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304444.593245:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.593266:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.593275:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.593282:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304444.593287:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.593298:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.593317:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c2ea19900) 00010000:00010000:1.0:1789304444.593320:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304444.593326:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304444.593332:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb723129608c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.274274:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304445.324653:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304445.324727:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765524480 00000100:00100000:0.0:1789304445.324738:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765524480 00000100:00100000:0.0:1789304445.324803:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 766 00000100:00100000:0.0:1789304445.324813:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:46404:x1876219765524480:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304445.324839:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304445.324858:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312960a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003c6 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.324923:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312960a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.324937:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312960a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.324950:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312960a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304445.324984:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:0.0:1789304445.324988:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304445.325007:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312960a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.325032:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312960a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003c6 expref: 13 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.325050:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312960a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003c6 expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.325058:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:0.0:1789304445.325061:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304445.325064:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa200, rc 0) 00000100:00100000:0.0:1789304445.325168:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:46404:x1876219765524480:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 355us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304445.325175:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 766 00000100:00100000:3.0:1789304445.332730:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304445.332762:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765524736 00000100:00100000:3.0:1789304445.332771:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765524736 00000100:00100000:3.0:1789304445.332823:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 767 00000100:00100000:3.0:1789304445.332831:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:46404:x1876219765524736:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304445.332881:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304445.332908:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312960a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003c6 expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304445.332926:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c10e8e600/0xefc0bb723129602a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003a3 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304445.332934:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:3.0:1789304445.332944:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304445.332964:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304445.332978:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304445.332988:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304445.333247:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091f9ee92 reply state 00000000b2f969d8 transno 4294967592 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304445.333254:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304445.333261:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000100:00100000:3.0:1789304445.333325:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:46404:x1876219765524736:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 496us (602us total) trans 4294967592 rc 0/0 00000100:00100000:3.0:1789304445.333331:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 767 00010000:00010000:2.0:1789304445.335435:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.335451:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.335459:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.335465:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304445.335469:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.335477:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.335491:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:2.0:1789304445.335493:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789304445.335498:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.335504:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312960af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304445.447714:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304445.447800:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765524864 00000100:00100000:0.0:1789304445.447811:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765524864 00000100:00100000:0.0:1789304445.447868:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 768 00000100:00100000:0.0:1789304445.447878:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:46416:x1876219765524864:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304445.447977:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:46416:x1876219765524864:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 100us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304445.447985:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 768 00000100:00100000:0.0:1789304445.455489:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304445.455772:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765524992 00000100:00100000:3.0:1789304445.455783:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765524992 00000100:00100000:3.0:1789304445.455851:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 409 00000100:00100000:3.0:1789304445.455906:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:46416:x1876219765524992:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304445.456857:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:46416:x1876219765524992:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 992us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304445.456869:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 409 00000100:00100000:3.0:1789304445.461152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304445.461481:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765525120 00000100:00100000:3.0:1789304445.461491:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765525120 00000100:00100000:3.0:1789304445.461588:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 410 00000100:00100000:3.0:1789304445.461599:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46416:x1876219765525120:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304445.461930:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46416:x1876219765525120:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 331us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304445.461938:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 410 00000100:00080000:2.0:1789304445.462412:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304445.471926:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304445.474599:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765525248 00000100:00100000:3.0:1789304445.474616:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765525248 00000100:00100000:3.0:1789304445.474684:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 769 00000100:00100000:3.0:1789304445.474695:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:46416:x1876219765525248:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304445.475164:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:46416:x1876219765525248:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 461us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304445.475173:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 769 00000100:00100000:3.0:1789304445.481640:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304445.481841:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765525376 00000100:00100000:1.0:1789304445.481852:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765525376 00000100:00100000:1.0:1789304445.481910:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 770 00000100:00100000:1.0:1789304445.481921:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:46416:x1876219765525376:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304445.482012:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:46416:x1876219765525376:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 92us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304445.482019:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 770 00000100:00100000:3.0:1789304445.488537:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304445.489233:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765525504 00000100:00100000:1.0:1789304445.489244:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765525504 00000100:00100000:1.0:1789304445.489308:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 411 00000100:00100000:1.0:1789304445.489320:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46416:x1876219765525504:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304445.489699:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46416:x1876219765525504:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 381us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304445.489707:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 411 00000100:00100000:1.0:1789304445.492215:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304445.492278:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765525632 00000100:00100000:3.0:1789304445.492289:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765525632 00000100:00100000:3.0:1789304445.492344:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 412 00000100:00100000:3.0:1789304445.492355:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46416:x1876219765525632:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304445.492746:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46416:x1876219765525632:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 392us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304445.492755:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 412 00000100:00100000:3.0:1789304445.499179:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304445.499253:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765525760 00000100:00100000:0.0:1789304445.499264:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765525760 00000100:00100000:0.0:1789304445.499326:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 771 00000100:00100000:0.0:1789304445.499337:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:46416:x1876219765525760:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304445.499832:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:46416:x1876219765525760:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 496us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304445.499841:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 771 00000100:00100000:0.0:1789304445.538762:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304445.538963:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765525888 00000100:00100000:3.0:1789304445.538973:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765525888 00000100:00100000:3.0:1789304445.539080:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 772 00000100:00100000:3.0:1789304445.539299:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:46420:x1876219765525888:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:2.0:1789304445.539378:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304445.539399:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312960b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003cd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539457:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312960bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539471:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312960bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539489:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312960bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539505:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312960c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539510:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312960c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539514:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312960c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539776:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312960cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539782:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312960cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539787:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312960cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304445.539811:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:2.0:1789304445.539814:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304445.539830:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312960cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539839:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312960bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539843:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312960bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539851:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312960bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539855:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304445.539858:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312960bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539863:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312960bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539870:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:2.0:1789304445.539872:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304445.539876:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312960bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539880:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312960bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539888:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312960c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539892:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312960c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539895:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312960c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539898:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304445.539900:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312960c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539950:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312960c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539956:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c421d2800) 00010000:00010000:2.0:1789304445.539957:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304445.539959:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312960c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539963:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb72312960c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539985:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312960b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003cd expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539993:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312960cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003cd expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.539998:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304445.539999:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304445.540001:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd400, rc 0) 00000100:00100000:2.0:1789304445.540242:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:46420:x1876219765525888:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1152us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304445.540249:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 772 00000100:00100000:2.0:1789304445.542449:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304445.542538:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765526144 00000100:00100000:1.0:1789304445.542557:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765526144 00000100:00100000:1.0:1789304445.542610:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 773 00000100:00100000:1.0:1789304445.542619:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:46420:x1876219765526144:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:1.0:1789304445.542638:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304445.542657:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312960d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003d4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.542789:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312960d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.542805:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312960d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.542813:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312960d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.542823:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.542827:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.542831:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789304445.543717:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18:0x0], index 1: 0 00010000:00010000:2.0:1789304445.543855:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312960e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.543868:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312960e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.543874:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312960e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.543899:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312960d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.543906:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312960d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.543914:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312960d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.543920:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304445.543925:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312960d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.543933:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312960d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.543946:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304445.543950:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304445.543955:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312960d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.543961:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312960d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304445.543971:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000620ba430 reply state 00000000cf955c6d transno 4294967593 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304445.543978:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304445.544008:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312960d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003d4 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.544022:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312960e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003d4 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.544029:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:2.0:1789304445.544031:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304445.544033:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc400, rc 0) 00000100:00100000:2.0:1789304445.544129:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+15:46420:x1876219765526144:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1510us (1684us total) trans 4294967593 rc 0/0 00000100:00100000:2.0:1789304445.544137:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 773 00010000:00010000:1.0:1789304445.547392:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.547409:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.547422:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.547428:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370c00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304445.547433:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.547441:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.547457:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c14addf00) 00010000:00010000:1.0:1789304445.547460:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304445.547465:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304445.547471:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb72312960e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304445.550749:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304445.550839:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765526272 00000100:00100000:3.0:1789304445.550851:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765526272 00000100:00100000:3.0:1789304445.550917:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 413 00000100:00100000:3.0:1789304445.550928:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:46420:x1876219765526272:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:3.0:1789304445.550948:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304445.550968:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb72312960f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003db expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789304445.550999:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789304445.551022:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=1895s v=(0 0) 00010000:00010000:3.0:1789304445.551028:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304445.551037:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb72312960f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003db expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304445.551054:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb72312960f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003db expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304445.551077:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304445.551152:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:46420:x1876219765526272:12345-192.168.202.29@tcp:101:dd.0 Request processed in 226us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304445.551159:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 413 00000100:00100000:3.0:1789304445.564820:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304445.564940:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765526400 00000100:00100000:2.0:1789304445.564951:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765526400 00002000:00100000:2.0:1789304445.565024:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x18:0x0] (0->1048575) req@ffff9e2b02d52680 x1876219765526400/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:511/0 lens 488/0 e 0 to 0 dl 1789304456 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304445.565037:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b02d52680 with x1876219765526400 ext(0->1048575) 00002000:00010000:2.0:1789304445.565043:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b02d52680 00000100:00100000:2.0:1789304445.565139:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:2.0:1789304445.565153:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765526400:12345-192.168.202.29@tcp:4:dd.0 00000100:00100000:3.0:1789304445.586027:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:2356:x1876219765526400:12345-192.168.202.29@tcp:4:dd.0 Request processed in 20861us (21202us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789304445.586042:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 18 00002000:00100000:3.0:1789304445.586054:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x18:0x0] (0->1048575) req@ffff9e2b02d52680 x1876219765526400/t4294967344(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:511/0 lens 488/448 e 0 to 0 dl 1789304456 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789304445.586066:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b02d52680 with x1876219765526400 ext(0->1048575) 00002000:00010000:3.0:1789304445.586081:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b02d52680 00000100:00100000:3.0:1789304445.589740:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304445.589859:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765526528 00000100:00100000:2.0:1789304445.589870:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765526528 00000100:00100000:2.0:1789304445.589966:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 774 00000100:00100000:2.0:1789304445.589978:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+14:46420:x1876219765526528:12345-192.168.202.29@tcp:44:dd.0 00000100:00100000:2.0:1789304445.618324:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+14:46420:x1876219765526528:12345-192.168.202.29@tcp:44:dd.0 Request processed in 28337us (28583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304445.618338:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 774 00000001:00080000:2.0:1789304445.618380:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967590 is committed 00000001:00080000:2.0:1789304445.618393:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967593 is committed 00000004:00080000:2.0:1789304445.618406:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 61 committed 00000100:00100000:2.0:1789304445.618606:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785611136:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789304445.618665:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304445.619025:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785611136 00000100:00100000:0.0:1789304445.619036:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785611136 00000100:00080000:2.0:1789304445.619296:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304445.619336:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1789304445.619347:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785611136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789304445.619374:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:24 count 1 00010000:00010000:0.0:1789304445.619401:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.619422:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce78f918/0xefc0bb723129607e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003bf expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.619442:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789304445.619447:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304445.619451:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.619480:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce78f918/0xefc0bb723129607e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003bf expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.619495:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce78f918/0xefc0bb723129607e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003bf expref: 6 pid: 6693 timeout: 1995 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304445.619508:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785611264:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304445.619571:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c02e47600 going to sleep for 11 seconds 00000100:00100000:0.0:1789304445.628634:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304445.634795:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304445.634828:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765526784 00000100:00100000:0.0:1789304445.634838:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765526784 00010000:00010000:0.0:1789304445.634880:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce78f918/0xefc0bb723129607e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003bf expref: 7 pid: 6693 timeout: 1995 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304445.634917:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 363 00000100:00100000:0.0:1789304445.634928:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765526784:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789304445.634943:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304445.634949:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce78f918/0xefc0bb723129607e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003bf expref: 7 pid: 6693 timeout: 1995 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.634963:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce78f918/0xefc0bb723129607e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003bf expref: 7 pid: 6693 timeout: 1995 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.634994:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304445.634999:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304445.635006:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.635016:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.635037:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304445.635113:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765526784:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 187us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304445.635430:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 363 00010000:00010000:2.0:1789304445.636230:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce78f918/0xefc0bb723129607e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003bf expref: 6 pid: 6693 timeout: 1995 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304445.636260:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785611264:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789304445.636282:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.636292:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.636299:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.636309:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.636321:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304445.636340:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789304445.636865:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785611136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17519us (18199us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789304445.636876:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00010000:00010000:0.0:1789304445.636933:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304445.636940:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.636949:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304445.636953:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.636963:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.636978:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.636984:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b95cbb7/0xefc0bb72312960fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304445.637003:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304445.637005:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304445.637007:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304445.637658:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765526656 00000100:00100000:1.0:1789304445.637670:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765526656 00000100:00100000:1.0:1789304445.637731:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 415 00000100:00100000:1.0:1789304445.637741:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:2354:x1876219765526656:12345-192.168.202.29@tcp:16:dd.0 00000004:00080000:0.0:1789304445.638287:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c03618e00/2, rc 0, transno 4294967345 00000100:00100000:0.0:1789304445.638295:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785611136:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789304445.696630:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967342 is committed 00000001:00080000:0.0:1789304445.696650:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967343 is committed 00000001:00080000:0.0:1789304445.696657:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967344 is committed 00000100:00100000:3.0:1789304445.696823:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765526656:12345-192.168.202.29@tcp:16:dd.0 Request processed in 59077us (68194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304445.696834:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 415 00000100:00100000:0.0:1789304445.699623:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304445.699712:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765527040 00000100:00100000:1.0:1789304445.699723:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765527040 00000100:00100000:1.0:1789304445.699814:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00100000:1.0:1789304445.699824:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:46420:x1876219765527040:12345-192.168.202.29@tcp:35:dd.0 00000100:00100000:1.0:1789304445.700467:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:46420:x1876219765527040:12345-192.168.202.29@tcp:35:dd.0 Request processed in 642us (855us total) trans 4294967594 rc 0/0 00000100:00100000:1.0:1789304445.700478:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00100000:0.0:1789304445.715214:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304445.715238:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785611392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304445.715313:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304445.715388:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785611392 00000100:00100000:0.0:1789304445.715397:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785611392 00000100:00100000:0.0:1789304445.715458:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1789304445.715467:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785611392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304445.715493:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789304445.715543:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785611392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304445.715550:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00080000:0.0:1789304445.715577:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304445.715605:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:0.0:1789304445.715611:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c08b36a00, transno 4294967343 00000100:00100000:0.0:1789304445.715628:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785611392:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789304445.794652:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00000001:00080000:0.0:1789304445.794671:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00000100:00100000:0.0:1789304445.806006:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304445.808437:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765527168 00000100:00100000:1.0:1789304445.808456:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765527168 00000100:00100000:1.0:1789304445.808526:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1106 00000100:00100000:1.0:1789304445.808536:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765527168:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304445.808636:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765527168:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 102us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304445.808644:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1106 00010000:00010000:1.0:1789304446.291495:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304446.742261:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304446.742284:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785611520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304446.742359:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304446.742546:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785611520 00000100:00100000:1.0:1789304446.742555:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785611520 00000100:00100000:1.0:1789304446.742608:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1789304446.742618:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785611520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304446.742656:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304446.742707:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785611520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304446.742714:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1789304446.742755:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:1.0:1789304446.742761:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c03618e00, transno 4294967345 00000100:00100000:1.0:1789304446.742778:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785611520:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789304447.160995:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967594 is committed 00010000:00010000:2.0:1789304447.314984:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304448.275743:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785612032:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.275830:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304448.275921:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789304448.275929:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785611648:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.275967:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304448.275993:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785612160:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276017:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304448.276063:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785611776:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276302:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304448.276323:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785612288:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276350:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304448.276369:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304448.276374:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785611904:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276391:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304448.276425:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785612032 00000100:00100000:1.0:1789304448.276433:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785612032 00000100:00100000:1.0:1789304448.276491:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785612160 00000100:00100000:1.0:1789304448.276494:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785612160 00000100:00100000:1.0:1789304448.276508:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785611776 00000100:00100000:1.0:1789304448.276510:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785611776 00000100:00100000:1.0:1789304448.276522:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:1.0:1789304448.276529:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785612032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276575:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785612032:12345-0@lo:400:kworker.0 Request processed in 46us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304448.276582:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:1.0:1789304448.276601:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:1.0:1789304448.276605:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785612160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276626:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785612160:12345-0@lo:400:kworker.0 Request processed in 21us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304448.276632:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:1.0:1789304448.276640:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1789304448.276645:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785611776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276666:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785611776:12345-0@lo:400:kworker.0 Request processed in 21us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304448.276672:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1789304448.276687:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785611648 00000100:00100000:1.0:1789304448.276691:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785611648 00000100:00100000:1.0:1789304448.276712:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1789304448.276717:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785611648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276743:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785611648:12345-0@lo:400:kworker.0 Request processed in 25us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304448.276748:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1789304448.276771:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785612288 00000100:00100000:1.0:1789304448.276774:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785612288 00000100:00100000:1.0:1789304448.276793:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785611904 00000100:00100000:1.0:1789304448.276794:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785611904 00000100:00100000:1.0:1789304448.276810:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1789304448.276816:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785612288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276840:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785612288:12345-0@lo:400:kworker.0 Request processed in 24us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304448.276845:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1789304448.276854:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1789304448.276859:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785611904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276880:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785611904:12345-0@lo:400:kworker.0 Request processed in 21us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304448.276885:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1789304448.276962:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785611904:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276974:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785611776:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.276985:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785612288:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.280475:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785611648:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.280504:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785612160:0@lo:400:kworker.0 00000100:00100000:1.0:1789304448.280517:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785612032:0@lo:400:kworker.0 00000100:00080000:1.0:1789304448.281226:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304448.281234:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304448.281237:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304448.338429:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304448.673552:0:79848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1898351458475ns, next at 1895267183994ns, rc = 0 00000004:00080000:3.0:1789304448.673662:0:79848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1898351571125ns, next at 1894139627015ns, rc = 0 00000004:00080000:2.0:1789304448.677117:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 68 committed 00000004:00080000:2.0:1789304448.677152:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 62 committed 00010000:00010000:2.0:1789304449.363284:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304450.066545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304450.066766:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765527296 00000100:00100000:2.0:1789304450.066777:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765527296 00000100:00100000:2.0:1789304450.066851:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 775 00000100:00100000:2.0:1789304450.066861:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:46613:x1876219765527296:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304450.066952:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:46613:x1876219765527296:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 91us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304450.066959:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 775 00000100:00080000:0.0:1789304450.067179:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304450.075185:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304450.075483:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765527424 00000100:00100000:0.0:1789304450.075496:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765527424 00000100:00100000:0.0:1789304450.075565:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 416 00000100:00100000:0.0:1789304450.075575:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:46613:x1876219765527424:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304450.075920:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:46613:x1876219765527424:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 345us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304450.075927:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 416 00000100:00080000:1.0:1789304450.077801:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304450.083202:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304450.083245:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765527552 00000100:00100000:2.0:1789304450.083254:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765527552 00000100:00100000:2.0:1789304450.083306:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 417 00000100:00100000:2.0:1789304450.083315:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46613:x1876219765527552:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304450.083640:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46613:x1876219765527552:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 325us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304450.083648:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 417 00000100:00080000:2.0:1789304450.083668:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304450.086322:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304450.086395:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765527680 00000100:00100000:2.0:1789304450.086406:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765527680 00000100:00100000:2.0:1789304450.086471:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 776 00000100:00100000:2.0:1789304450.086482:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:46613:x1876219765527680:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304450.086941:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:46613:x1876219765527680:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 460us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304450.086950:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 776 00000100:00100000:2.0:1789304450.098862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304450.098954:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765527808 00000100:00100000:0.0:1789304450.098966:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765527808 00000100:00100000:0.0:1789304450.099040:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 777 00000100:00100000:0.0:1789304450.099053:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:46613:x1876219765527808:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304450.099179:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:46613:x1876219765527808:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304450.099187:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 777 00000100:00100000:1.0:1789304450.111736:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304450.111820:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765527936 00000100:00100000:3.0:1789304450.111832:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765527936 00000100:00100000:3.0:1789304450.111895:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 418 00000100:00100000:3.0:1789304450.111909:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:46613:x1876219765527936:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304450.112382:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:46613:x1876219765527936:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 474us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304450.112391:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 418 00000100:00100000:0.0:1789304450.134397:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304450.134492:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765528064 00000100:00100000:1.0:1789304450.134506:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765528064 00000100:00100000:1.0:1789304450.134620:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 419 00000100:00100000:1.0:1789304450.134633:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46613:x1876219765528064:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304450.135056:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46613:x1876219765528064:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 425us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304450.135065:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 419 00000100:00100000:1.0:1789304450.146540:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304450.147392:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765528192 00000100:00100000:3.0:1789304450.147404:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765528192 00000100:00100000:3.0:1789304450.147460:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 778 00000100:00100000:3.0:1789304450.147471:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:46613:x1876219765528192:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304450.147919:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:46613:x1876219765528192:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 449us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304450.147930:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 778 00000100:00100000:0.0:1789304450.253630:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304450.253707:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765528448 00000100:00100000:2.0:1789304450.253718:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765528448 00000100:00100000:2.0:1789304450.253777:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 779 00000100:00100000:2.0:1789304450.253787:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:46617:x1876219765528448:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304450.253840:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304450.253869:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312960e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003d4 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.253888:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:2.0:1789304450.253898:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304450.253919:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296103 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.253933:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.253942:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.253958:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.253965:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.253973:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.254570:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231296111 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.254581:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231296111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.254589:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231296111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304450.256049:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].24, 64 off9728 00000004:00080000:2.0:1789304450.256062:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1899933971067ns, next at 1900933967697ns, rc = 0 00010000:00010000:2.0:1789304450.256681:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256697:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256707:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256716:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256726:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256732:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256798:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304450.256824:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231296111 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256830:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231296111 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256837:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231296111 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256843:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304450.256847:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231296111 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256855:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231296111 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256866:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304450.256870:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304450.256875:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231296111 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256881:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231296111 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256899:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296103 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256905:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296103 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256910:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296103 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256915:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304450.256918:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296103 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256923:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296103 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256931:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304450.256933:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304450.256935:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296103 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.256941:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296103 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304450.256951:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064799318 reply state 000000003c4dcf2e transno 4294967595 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304450.256959:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304450.257060:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:46617:x1876219765528448:12345-192.168.202.29@tcp:36:rm.0 Request processed in 3271us (3436us total) trans 4294967595 rc 0/0 00000100:00100000:2.0:1789304450.257070:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 779 00010000:00010000:1.0:1789304450.257474:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304450.257482:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304450.257490:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304450.257493:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304450.257503:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304450.257514:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:1.0:1789304450.257517:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304450.257520:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304450.257525:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296118 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304450.257610:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304450.257613:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304450.257615:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304450.262504:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.262530:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.262539:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.262545:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304450.262550:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.262560:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.262580:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c421d2000) 00010000:00010000:2.0:1789304450.262584:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304450.262589:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304450.262595:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129610a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304450.386257:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304450.840700:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785612416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304450.840911:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304450.841869:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785612416 00000100:00100000:0.0:1789304450.841880:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785612416 00000100:00100000:0.0:1789304450.841948:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1789304450.841958:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785612416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304450.841997:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789304450.849123:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785612416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7135us (8180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304450.849138:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00080000:0.0:1789304450.849175:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304450.855643:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785612416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304450.928289:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304450.928328:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304450.928359:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304450.928384:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304450.928408:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765528704 00000100:00100000:0.0:1789304450.928418:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765528704 00000100:00100000:0.0:1789304450.928472:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1338 00000100:00100000:0.0:1789304450.928481:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765528704:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304450.928556:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765528704:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304450.928563:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1338 00000100:00100000:0.0:1789304450.928586:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765528832 00000100:00100000:0.0:1789304450.928590:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765528832 00000100:00100000:0.0:1789304450.928614:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765528960 00000100:00100000:0.0:1789304450.928617:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765528960 00000100:00100000:0.0:1789304450.928637:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 988 00000100:00100000:0.0:1789304450.928643:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765528832:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304450.928672:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765528832:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304450.928679:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 988 00000100:00100000:0.0:1789304450.928691:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 989 00000100:00100000:0.0:1789304450.928698:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765528960:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304450.928721:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765528960:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304450.928726:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 989 00000100:00100000:2.0:1789304450.928934:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765528576 00000100:00100000:2.0:1789304450.928940:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765528576 00000100:00100000:2.0:1789304450.929005:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1108 00000100:00100000:2.0:1789304450.929013:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765528576:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304450.929050:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765528576:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304450.929057:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1108 00010000:00010000:1.0:1789304451.411348:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304451.858561:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304451.858588:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785612544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304451.858884:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304451.859139:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785612544 00000100:00100000:3.0:1789304451.859151:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785612544 00000100:00100000:3.0:1789304451.859225:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1789304451.859237:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785612544:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789304451.859395:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789304451.860124:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304451.860254:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785612544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1018us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304451.860272:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1789304451.862473:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785612544:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1789304452.372836:0:79993:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1902050743082ns, next at 1895267183994ns, rc = 0 00000004:00080000:0.0:1789304452.372946:0:79993:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1902050855228ns, next at 1900933967697ns, rc = 0 00010000:00010000:0.0:1789304452.436335:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304452.463891:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 70 committed 00000004:00080000:2.0:1789304452.463913:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 63 committed 00000001:00080000:2.0:1789304452.463936:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967595 is committed 00000004:00080000:2.0:1789304452.463942:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 69 committed 00000100:00100000:2.0:1789304452.464122:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785612672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789304452.464212:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304452.464352:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785612672 00000100:00100000:0.0:1789304452.464361:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785612672 00000100:00100000:0.0:1789304452.464436:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789304452.464448:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785612672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789304452.464490:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:24 count 1 00000100:00080000:2.0:1789304452.464513:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304452.464519:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304452.464547:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb72312960f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003db expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304452.464558:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x18:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1789304452.464564:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304452.464570:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304452.464603:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb72312960f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003db expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304452.464617:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb72312960f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003db expref: 5 pid: 6691 timeout: 2002 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304452.464629:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785612800:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304452.464700:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c2023d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789304452.472124:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785612800:192.168.202.29@tcp:104: 00010000:00010000:1.0:1789304452.472159:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304452.472251:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304452.472334:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765529088 00000100:00100000:3.0:1789304452.472343:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765529088 00010000:00010000:3.0:1789304452.472402:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb72312960f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003db expref: 6 pid: 6691 timeout: 2002 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789304452.472405:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304452.472449:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 364 00000100:00100000:3.0:1789304452.472464:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765529088:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789304452.472482:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304452.472488:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb72312960f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003db expref: 6 pid: 6691 timeout: 2002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304452.472502:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb72312960f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003db expref: 6 pid: 6691 timeout: 2002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304452.472528:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb72312960f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003db expref: 6 pid: 6691 timeout: 2002 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304452.472548:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304452.472553:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304452.472559:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304452.472570:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304452.472606:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304452.472720:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765529088:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 261us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304452.472728:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 364 00010000:00010000:1.0:1789304452.473224:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304452.473237:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304452.473248:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304452.473257:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304452.473281:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789304452.473848:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304452.473858:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304452.473870:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304452.473875:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304452.473885:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304452.473915:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304452.473924:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000505e9677/0xefc0bb723129611f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304452.473944:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785612672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9497us (9731us total) trans 4294967345 rc 0/0 00010000:00010000:0.0:1789304452.473945:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304452.473949:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304452.473957:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00010000:00010000:0.0:1789304452.474466:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304452.486204:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c3f67a680/2, rc 0, transno 4294967345 00000100:00100000:2.0:1789304452.486238:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785612672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789304453.394490:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785612928:0@lo:400:kworker.0 00000100:00100000:3.0:1789304453.394518:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785613056:0@lo:400:kworker.0 00000100:00100000:2.0:1789304453.395072:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785613312:0@lo:400:kworker.0 00000100:00100000:3.0:1789304453.397775:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304453.397852:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785613568:0@lo:400:kworker.0 00000100:00100000:3.0:1789304453.398908:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304453.398978:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304453.398990:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785613440:0@lo:400:kworker.0 00000100:00100000:3.0:1789304453.399034:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304453.399386:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785613184:0@lo:400:kworker.0 00000100:00100000:3.0:1789304453.399417:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304453.399508:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785613056 00000100:00100000:3.0:1789304453.399518:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785613056 00000100:00100000:3.0:1789304453.399632:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785613440 00000100:00100000:3.0:1789304453.399636:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785613440 00000100:00100000:3.0:1789304453.399751:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1789304453.399761:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785613056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304453.399831:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785613056:12345-0@lo:400:kworker.0 Request processed in 71us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304453.399838:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1789304453.399857:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1789304453.399865:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785613440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304453.400032:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785613440:12345-0@lo:400:kworker.0 Request processed in 167us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304453.400038:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1789304453.400222:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785613440:0@lo:400:kworker.0 00000100:00100000:3.0:1789304453.400236:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785613056:0@lo:400:kworker.0 00000100:00100000:1.0:1789304453.400508:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785613568 00000100:00100000:1.0:1789304453.400515:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785613568 00000100:00100000:1.0:1789304453.400622:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785613184 00000100:00100000:1.0:1789304453.400626:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785613184 00000100:00100000:1.0:1789304453.400730:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1789304453.400739:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785613568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304453.400790:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785613568:12345-0@lo:400:kworker.0 Request processed in 53us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304453.400797:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1789304453.400811:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1789304453.400818:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785613184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304453.400853:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785613184:12345-0@lo:400:kworker.0 Request processed in 36us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304453.400859:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1789304453.400971:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785613184:0@lo:400:kworker.0 00000100:00100000:1.0:1789304453.401016:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785613568:0@lo:400:kworker.0 00000100:00100000:0.0:1789304453.401372:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304453.401438:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785612928 00000100:00100000:3.0:1789304453.401444:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785612928 00000100:00100000:3.0:1789304453.401472:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1789304453.401480:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785612928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304453.401519:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785612928:12345-0@lo:400:kworker.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304453.401525:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1789304453.401577:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785612928:0@lo:400:kworker.0 00000100:00080000:0.0:1789304453.402378:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304453.402385:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304453.404807:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304453.405049:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785613312 00000100:00100000:0.0:1789304453.405058:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785613312 00000100:00100000:0.0:1789304453.405152:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1789304453.405163:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785613312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304453.405225:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785613312:12345-0@lo:400:kworker.0 Request processed in 66us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304453.405233:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00080000:2.0:1789304453.406377:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304453.406586:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785613312:0@lo:400:kworker.0 00010000:00010000:2.0:1789304453.459266:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304454.482301:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304455.506413:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304455.524844:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967345 is committed 00000100:00100000:2.0:1789304455.954640:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304455.954669:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785613696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304455.954744:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304455.954943:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785613696 00000100:00100000:0.0:1789304455.954952:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785613696 00000100:00100000:0.0:1789304455.955053:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1789304455.955063:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785613696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304455.955282:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304455.955335:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785613696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 274us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304455.955343:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00080000:2.0:1789304455.955537:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304455.955566:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:2.0:1789304455.955572:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c3f67a680, transno 4294967345 00000100:00100000:2.0:1789304455.955598:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785613696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304456.033851:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304456.033899:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304456.033937:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304456.033981:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304456.034014:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765529600 00000100:00100000:2.0:1789304456.034035:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765529600 00000100:00100000:2.0:1789304456.034139:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765529472 00000100:00100000:2.0:1789304456.034144:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765529472 00000100:00100000:2.0:1789304456.034172:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 992 00000100:00100000:2.0:1789304456.034182:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765529600:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304456.034256:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765529600:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304456.034263:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 992 00000100:00100000:2.0:1789304456.034280:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 993 00000100:00100000:2.0:1789304456.034287:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765529472:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304456.034313:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765529472:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304456.034318:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 993 00000100:00080000:2.0:1789304456.034334:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304456.034338:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304456.034685:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765529216 00000100:00100000:3.0:1789304456.034692:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765529216 00000100:00100000:3.0:1789304456.034735:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1110 00000100:00100000:3.0:1789304456.034743:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765529216:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304456.034773:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765529216:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304456.034779:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1110 00000100:00100000:0.0:1789304456.034909:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765529344 00000100:00100000:0.0:1789304456.034914:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765529344 00000100:00100000:1.0:1789304456.035197:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1342 00000100:00100000:1.0:1789304456.035208:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765529344:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304456.035242:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765529344:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304456.035248:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1342 00000100:00080000:2.0:1789304456.035796:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304456.530671:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304456.981390:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304456.981412:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785613824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304456.981475:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304456.981534:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785613824 00000100:00100000:3.0:1789304456.981541:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785613824 00000100:00100000:3.0:1789304456.981589:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1789304456.981596:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785613824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304456.981629:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304456.981668:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785613824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304456.981675:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1789304456.981722:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785613824:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789304456.982337:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304457.558284:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304458.514388:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785614208:0@lo:400:kworker.0 00000100:00100000:3.0:1789304458.514463:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304458.514534:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304458.514540:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785614336:0@lo:400:kworker.0 00000100:00100000:3.0:1789304458.514563:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304458.514627:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785614080:0@lo:400:kworker.0 00000100:00100000:1.0:1789304458.514653:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304458.514676:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785614592:0@lo:400:kworker.0 00000100:00100000:1.0:1789304458.514691:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304458.514707:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789304458.514712:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785613952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304458.514739:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304458.514759:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785614464:0@lo:400:kworker.0 00000100:00100000:1.0:1789304458.514776:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304458.514798:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785614208 00000100:00100000:1.0:1789304458.514804:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785614208 00000100:00100000:1.0:1789304458.514859:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785614592 00000100:00100000:1.0:1789304458.514862:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785614592 00000100:00100000:1.0:1789304458.514884:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:1.0:1789304458.514891:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785614208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304458.514936:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785614208:12345-0@lo:400:kworker.0 Request processed in 45us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304458.514943:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:1.0:1789304458.514968:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1789304458.514973:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785614592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304458.515011:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785614592:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304458.515018:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1789304458.515034:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785613952 00000100:00100000:1.0:1789304458.515037:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785613952 00000100:00100000:1.0:1789304458.515054:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1789304458.515059:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785613952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304458.515083:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785613952:12345-0@lo:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304458.515106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1789304458.515145:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785613952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304458.515156:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785614592:0@lo:400:kworker.0 00000100:00100000:3.0:1789304458.515274:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785614336 00000100:00100000:3.0:1789304458.515278:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785614336 00000100:00100000:3.0:1789304458.515308:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785614080 00000100:00100000:3.0:1789304458.515310:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785614080 00000100:00100000:3.0:1789304458.515322:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785614464 00000100:00100000:3.0:1789304458.515324:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785614464 00000100:00100000:3.0:1789304458.515336:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:3.0:1789304458.515341:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785614336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304458.515373:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785614336:12345-0@lo:400:kworker.0 Request processed in 31us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304458.515378:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:3.0:1789304458.515390:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1789304458.515394:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785614080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304458.515421:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785614080:12345-0@lo:400:kworker.0 Request processed in 26us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304458.515426:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1789304458.515434:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1789304458.515439:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785614464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304458.515458:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785614464:12345-0@lo:400:kworker.0 Request processed in 19us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304458.515463:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1789304458.515492:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785614336:0@lo:400:kworker.0 00000100:00100000:3.0:1789304458.515500:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785614208:0@lo:400:kworker.0 00000100:00100000:3.0:1789304458.515518:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785614464:0@lo:400:kworker.0 00000100:00100000:3.0:1789304458.515526:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785614080:0@lo:400:kworker.0 00000100:00080000:2.0:1789304458.515902:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304458.515908:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304458.515910:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304458.578257:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304459.602366:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304460.627534:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304461.075104:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304461.075138:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785614720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304461.075201:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304461.075270:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785614720 00000100:00100000:3.0:1789304461.075277:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785614720 00000100:00100000:3.0:1789304461.075334:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1789304461.075342:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785614720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304461.075377:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304461.075424:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785614720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304461.075431:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00080000:3.0:1789304461.075454:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304461.075489:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785614720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304461.161056:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304461.161339:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304461.161430:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304461.161474:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304461.161667:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765529856 00000100:00100000:3.0:1789304461.161679:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765529856 00000100:00100000:3.0:1789304461.161878:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1346 00000100:00100000:3.0:1789304461.161889:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765529856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304461.161976:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765529856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304461.161984:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1346 00000100:00080000:3.0:1789304461.162076:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304461.162386:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765529728 00000100:00100000:0.0:1789304461.162392:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765529728 00000100:00100000:0.0:1789304461.162437:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1112 00000100:00100000:0.0:1789304461.162445:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765529728:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304461.162472:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765529728:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304461.162478:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1112 00000100:00100000:2.0:1789304461.167676:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765530112 00000100:00100000:2.0:1789304461.167693:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765530112 00000100:00100000:2.0:1789304461.167769:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765529984 00000100:00100000:2.0:1789304461.167773:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765529984 00000100:00100000:2.0:1789304461.167808:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 996 00000100:00100000:2.0:1789304461.167818:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765530112:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304461.167896:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765530112:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (6557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304461.167902:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 996 00000100:00100000:2.0:1789304461.167936:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 997 00000100:00100000:2.0:1789304461.167943:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765529984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304461.167967:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765529984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (6493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304461.167972:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 997 00000100:00080000:3.0:1789304461.168330:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304461.168335:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304461.650271:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304462.098742:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304462.098770:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785614848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304462.098846:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304462.099012:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785614848 00000100:00100000:0.0:1789304462.099022:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785614848 00000100:00100000:0.0:1789304462.099116:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1789304462.099128:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785614848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304462.099165:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304462.099225:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785614848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304462.099233:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00080000:1.0:1789304462.099343:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304462.099498:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785614848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304462.676195:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304463.635705:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785615360:0@lo:400:kworker.0 00000100:00100000:0.0:1789304463.635773:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304463.635837:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304463.635843:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785615232:0@lo:400:kworker.0 00000100:00100000:0.0:1789304463.635872:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304463.635935:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785615360 00000100:00100000:0.0:1789304463.635943:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785615360 00000100:00100000:0.0:1789304463.636002:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1789304463.636013:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785615360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304463.636063:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785615360:12345-0@lo:400:kworker.0 Request processed in 51us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304463.636070:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00080000:0.0:1789304463.636118:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304463.636146:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785615360:0@lo:400:kworker.0 00000100:00100000:3.0:1789304463.636364:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785615104:0@lo:400:kworker.0 00000100:00100000:3.0:1789304463.636396:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304463.636428:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785615616:0@lo:400:kworker.0 00000100:00100000:3.0:1789304463.636451:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304463.636471:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789304463.636477:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785614976:0@lo:400:kworker.0 00000100:00100000:3.0:1789304463.636506:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304463.636528:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785615488:0@lo:400:kworker.0 00000100:00100000:3.0:1789304463.636549:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304463.636575:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785614976 00000100:00100000:3.0:1789304463.636579:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785614976 00000100:00100000:3.0:1789304463.636619:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:3.0:1789304463.636626:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785614976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304463.636661:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785614976:12345-0@lo:400:kworker.0 Request processed in 36us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304463.636667:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:3.0:1789304463.636708:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785615104 00000100:00100000:3.0:1789304463.636711:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785615104 00000100:00100000:3.0:1789304463.636731:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785615488 00000100:00100000:3.0:1789304463.636734:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785615488 00000100:00100000:3.0:1789304463.636757:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1789304463.636763:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785615104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304463.636792:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785615104:12345-0@lo:400:kworker.0 Request processed in 29us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304463.636797:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1789304463.636808:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1789304463.636813:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785615488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304463.636837:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785615488:12345-0@lo:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304463.636842:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00080000:3.0:1789304463.636861:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304463.636877:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785614976:0@lo:400:kworker.0 00000100:00100000:3.0:1789304463.636886:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785615488:0@lo:400:kworker.0 00000100:00100000:3.0:1789304463.636894:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785615104:0@lo:400:kworker.0 00000100:00100000:2.0:1789304463.637719:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785615232 00000100:00100000:2.0:1789304463.637726:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785615232 00000100:00100000:2.0:1789304463.637765:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785615616 00000100:00100000:2.0:1789304463.637768:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785615616 00000100:00100000:2.0:1789304463.637802:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1789304463.637810:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785615232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304463.637863:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785615232:12345-0@lo:400:kworker.0 Request processed in 54us (1990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304463.637870:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1789304463.637883:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1789304463.637889:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785615616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304463.637939:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785615616:12345-0@lo:400:kworker.0 Request processed in 51us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304463.637945:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1789304463.637979:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785615232:0@lo:400:kworker.0 00000100:00100000:2.0:1789304463.638005:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785615616:0@lo:400:kworker.0 00000100:00080000:3.0:1789304463.638153:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304463.698464:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304464.722398:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304465.749612:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304466.194836:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785615744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304466.195190:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304466.205162:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785615744 00000100:00100000:3.0:1789304466.205386:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785615744 00000100:00100000:3.0:1789304466.205543:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1789304466.205555:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785615744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304466.205595:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304466.205705:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785615744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (10783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304466.205715:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1789304466.208208:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785615744:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304466.214845:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304466.274768:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304466.274941:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765530240 00000100:00100000:2.0:1789304466.274951:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765530240 00000100:00100000:2.0:1789304466.275007:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1114 00000100:00100000:2.0:1789304466.275017:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765530240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304466.275126:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765530240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 110us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304466.275133:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1114 00000100:00100000:2.0:1789304466.280267:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304466.280501:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765530368 00000100:00100000:0.0:1789304466.280512:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765530368 00000100:00100000:0.0:1789304466.280601:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1350 00000100:00100000:0.0:1789304466.280613:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765530368:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304466.280709:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765530368:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 98us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304466.280717:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1350 00000100:00080000:3.0:1789304466.281717:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304466.282650:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304466.282693:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304466.282776:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765530624 00000100:00100000:2.0:1789304466.282785:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765530624 00000100:00100000:2.0:1789304466.282841:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765530496 00000100:00100000:2.0:1789304466.282845:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765530496 00000100:00100000:2.0:1789304466.282867:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1000 00000100:00100000:2.0:1789304466.282885:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765530624:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304466.282967:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765530624:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 92us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304466.282975:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1000 00000100:00100000:2.0:1789304466.282992:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1001 00000100:00100000:2.0:1789304466.282998:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765530496:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304466.283021:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765530496:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304466.283027:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1001 00000100:00080000:0.0:1789304466.283573:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304466.283577:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304466.770329:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304467.219482:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785615872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304467.219556:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304467.220572:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785615872 00000100:00100000:0.0:1789304467.220583:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785615872 00000100:00100000:0.0:1789304467.220672:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1789304467.220683:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785615872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304467.220719:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304467.220797:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785615872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304467.220805:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1789304467.220972:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785615872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304467.221200:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304467.474194:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304467.474320:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765530752 00000100:00100000:3.0:1789304467.474331:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765530752 00000100:00100000:3.0:1789304467.474396:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 780 00000100:00100000:3.0:1789304467.474407:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46849:x1876219765530752:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304467.474512:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46849:x1876219765530752:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 106us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304467.474519:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 780 00000100:00100000:2.0:1789304467.487237:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304467.489178:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765530880 00000100:00100000:0.0:1789304467.489203:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765530880 00000100:00100000:0.0:1789304467.489391:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 421 00000100:00100000:0.0:1789304467.489405:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:46849:x1876219765530880:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304467.489929:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:46849:x1876219765530880:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 526us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304467.489938:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 421 00000100:00100000:1.0:1789304467.494450:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304467.494848:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765531008 00000100:00100000:2.0:1789304467.494871:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765531008 00000100:00100000:2.0:1789304467.495145:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 422 00000100:00100000:2.0:1789304467.495167:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:46849:x1876219765531008:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304467.495614:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:46849:x1876219765531008:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 459us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304467.495623:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 422 00000100:00100000:2.0:1789304467.502343:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304467.502473:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765531136 00000100:00100000:0.0:1789304467.502489:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765531136 00000100:00100000:0.0:1789304467.502576:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 781 00000100:00100000:0.0:1789304467.502590:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:46849:x1876219765531136:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304467.503391:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:46849:x1876219765531136:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 801us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304467.503402:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 781 00000100:00100000:3.0:1789304467.511786:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304467.512166:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765531264 00000100:00100000:1.0:1789304467.512181:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765531264 00000100:00100000:1.0:1789304467.512261:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 782 00000100:00100000:1.0:1789304467.512274:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46849:x1876219765531264:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304467.512385:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46849:x1876219765531264:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 114us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304467.512397:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 782 00000100:00100000:3.0:1789304467.514129:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304467.514430:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765531392 00000100:00100000:2.0:1789304467.514443:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765531392 00000100:00100000:2.0:1789304467.514566:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 423 00000100:00100000:2.0:1789304467.514579:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:46849:x1876219765531392:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304467.515070:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:46849:x1876219765531392:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 493us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304467.515079:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 423 00000100:00100000:1.0:1789304467.517373:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304467.517468:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765531520 00000100:00100000:0.0:1789304467.517482:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765531520 00000100:00100000:0.0:1789304467.517582:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 424 00000100:00100000:0.0:1789304467.517595:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:46849:x1876219765531520:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304467.518278:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:46849:x1876219765531520:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 683us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304467.518288:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 424 00000100:00100000:3.0:1789304467.520443:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304467.520552:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765531648 00000100:00100000:0.0:1789304467.520564:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765531648 00000100:00100000:0.0:1789304467.520638:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 783 00000100:00100000:0.0:1789304467.520650:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:46849:x1876219765531648:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304467.521445:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:46849:x1876219765531648:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 794us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304467.521455:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 783 00010000:00010000:0.0:1789304467.800027:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304468.755645:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785616128:0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.755744:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304468.755806:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785616640:0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.755833:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304468.755874:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789304468.755881:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785616000:0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.755911:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304468.755936:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785616512:0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.755958:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304468.755989:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785616256:0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.756014:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304468.756032:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304468.756038:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785616384:0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.756058:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304468.756121:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785616128 00000100:00100000:0.0:1789304468.756131:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785616128 00000100:00100000:0.0:1789304468.756188:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785616512 00000100:00100000:0.0:1789304468.756191:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785616512 00000100:00100000:0.0:1789304468.756220:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785616384 00000100:00100000:0.0:1789304468.756223:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785616384 00000100:00100000:0.0:1789304468.756241:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1789304468.756250:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785616128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.756310:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785616128:12345-0@lo:400:kworker.0 Request processed in 61us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304468.756319:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:0.0:1789304468.756548:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:0.0:1789304468.756557:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785616512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.756590:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785616512:12345-0@lo:400:kworker.0 Request processed in 34us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304468.756597:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:0.0:1789304468.756609:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:0.0:1789304468.756617:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785616384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.756693:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785616384:12345-0@lo:400:kworker.0 Request processed in 76us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304468.756699:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:0.0:1789304468.756720:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785616640 00000100:00100000:0.0:1789304468.756724:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785616640 00000100:00100000:0.0:1789304468.756759:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785616256 00000100:00100000:0.0:1789304468.756762:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785616256 00000100:00100000:0.0:1789304468.756787:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1789304468.756793:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785616640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.756823:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785616640:12345-0@lo:400:kworker.0 Request processed in 31us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304468.756829:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1789304468.756839:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1789304468.756844:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785616256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.756881:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785616256:12345-0@lo:400:kworker.0 Request processed in 37us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304468.756886:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1789304468.756906:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785616000 00000100:00100000:0.0:1789304468.756910:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785616000 00000100:00100000:0.0:1789304468.756937:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1789304468.756943:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785616000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.756971:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785616000:12345-0@lo:400:kworker.0 Request processed in 29us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304468.756977:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00080000:0.0:1789304468.757023:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304468.757028:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304468.757070:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785616000:0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.757084:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785616512:0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.757123:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785616128:0@lo:400:kworker.0 00000100:00100000:0.0:1789304468.757133:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785616640:0@lo:400:kworker.0 00000100:00100000:3.0:1789304468.760454:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785616384:0@lo:400:kworker.0 00000100:00100000:3.0:1789304468.760480:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785616256:0@lo:400:kworker.0 00010000:00010000:2.0:1789304468.818576:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304469.454602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304469.454695:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765531776 00000100:00100000:0.0:1789304469.454713:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765531776 00000100:00100000:0.0:1789304469.454841:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 784 00000100:00100000:0.0:1789304469.454863:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:46863:x1876219765531776:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304469.454889:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304469.454916:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003e2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.455000:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb723129612d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.455018:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb723129612d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.455034:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb723129612d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304469.455080:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:0.0:1789304469.455085:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304469.455172:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb723129612d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.455204:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003e2 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.455234:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb723129612d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003e2 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.455245:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:0.0:1789304469.455249:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304469.455255:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304469.455359:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:46863:x1876219765531776:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 498us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304469.455367:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 784 00000100:00080000:1.0:1789304469.455581:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304469.462291:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304469.462407:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765532032 00000100:00100000:3.0:1789304469.462437:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765532032 00000100:00100000:3.0:1789304469.462694:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 785 00000100:00100000:3.0:1789304469.462708:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:46863:x1876219765532032:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304469.462779:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304469.462897:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb723129612d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003e2 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.462928:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312960cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003cd expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.462947:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:3.0:1789304469.462962:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304469.463003:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.463022:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.463035:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789304469.546546:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967596 is committed 00000004:00010000:1.0:1789304469.546616:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec83e167 reply state 000000009c480b87 transno 4294967596 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304469.546631:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304469.546649:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00080000:1.0:1789304469.546794:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789304469.546860:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46863:x1876219765532032:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 84142us (84569us total) trans 4294967596 rc 0/0 00000100:00100000:1.0:1789304469.546872:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 785 00010000:00010000:2.0:1789304469.547285:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304469.547293:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304469.547298:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304469.547302:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304469.547305:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304469.547310:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304469.547323:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:2.0:1789304469.547325:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789304469.547329:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304469.547333:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296134 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304469.675937:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304469.676043:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765532160 00000100:00100000:0.0:1789304469.676054:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765532160 00000100:00100000:0.0:1789304469.676157:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 786 00000100:00100000:0.0:1789304469.676168:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:46867:x1876219765532160:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:0.0:1789304469.676195:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304469.676216:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129613b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003e9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.676281:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296142 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.676297:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.676308:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.676325:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296149 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.676333:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.676339:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.676660:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296150 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.676669:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.676676:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304469.676701:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:0.0:1789304469.676705:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304469.676992:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677005:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677011:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296142 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677018:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296142 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677023:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304469.677027:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296142 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677036:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296142 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677046:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304469.677049:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304469.677055:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677061:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677073:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677078:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677084:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296149 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677286:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304469.677290:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296149 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677297:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296149 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677305:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c0558d700) 00010000:00010000:0.0:1789304469.677308:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304469.677311:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296149 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677321:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296149 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677354:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129613b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003e9 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677368:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003e9 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.677375:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304469.677377:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304469.677380:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304469.677447:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:46867:x1876219765532160:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 1280us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304469.677455:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 786 00000100:00100000:3.0:1789304469.682509:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304469.682835:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765532416 00000100:00100000:0.0:1789304469.682855:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765532416 00000100:00100000:0.0:1789304469.682915:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 787 00000100:00100000:0.0:1789304469.682925:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:46867:x1876219765532416:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:0.0:1789304469.682945:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304469.682965:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296157 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003f0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.683238:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129615e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.683254:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129615e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.683266:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129615e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.683279:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.683286:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.683293:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789304469.684417:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19:0x0], index 0: 0 00010000:00010000:0.0:1789304469.685017:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129616c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685031:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129616c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685041:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129616c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685071:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129615e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685078:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129615e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685086:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129615e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685135:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304469.685140:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129615e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685148:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129615e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685159:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304469.685162:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304469.685166:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129615e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685173:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129615e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304469.685184:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006eb7b4b2 reply state 00000000cc04c987 transno 4294967597 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304469.685193:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789304469.685223:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296157 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003f0 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685237:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129616c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003f0 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.685244:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9e2c0558d500) 00010000:00010000:0.0:1789304469.685247:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304469.685249:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afaa00, rc 0) 00000100:00100000:0.0:1789304469.685320:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:46867:x1876219765532416:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 2395us (2820us total) trans 4294967597 rc 0/0 00000100:00100000:0.0:1789304469.685328:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 787 00000100:00100000:3.0:1789304469.691035:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304469.691308:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765532672 00000100:00100000:0.0:1789304469.691319:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765532672 00000100:00100000:0.0:1789304469.691390:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 788 00000100:00100000:0.0:1789304469.691401:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:46867:x1876219765532672:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:0.0:1789304469.691455:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304469.691482:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129616c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003f0 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.691499:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9e2c0558d500) 00010000:00010000:0.0:1789304469.691509:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304469.691553:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.691565:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.691575:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304469.691722:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070c7526f reply state 00000000874bce20 transno 4294967598 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304469.691732:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304469.691818:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:46867:x1876219765532672:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 419us (794us total) trans 4294967598 rc 0/0 00000100:00100000:0.0:1789304469.691826:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 788 00000100:00100000:2.0:1789304469.695489:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304469.695788:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765532800 00000100:00100000:0.0:1789304469.695798:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765532800 00000100:00100000:0.0:1789304469.695860:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 789 00000100:00100000:0.0:1789304469.695870:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:46867:x1876219765532800:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:0.0:1789304469.695903:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304469.695923:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003f7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.695981:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003f7 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.695996:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003f7 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.696016:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:0.0:1789304469.696019:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789304469.696023:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789304469.696075:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:46867:x1876219765532800:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 207us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304469.696083:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 789 00010000:00010000:3.0:1789304469.696688:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.696700:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.696708:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.696723:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304469.696728:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.696736:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.696748:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:3.0:1789304469.696751:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304469.696755:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.696761:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb723129617a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.697421:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.697433:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.697439:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.697445:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304469.697448:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.697455:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.697474:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c0558de00) 00010000:00010000:1.0:1789304469.697478:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304469.697482:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.697488:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296165 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304469.699873:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304469.699966:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765532928 00000100:00100000:2.0:1789304469.699976:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765532928 00000100:00100000:2.0:1789304469.700052:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 425 00000100:00100000:2.0:1789304469.700063:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765532928:12345-192.168.202.29@tcp:2:touch.60003 00000100:00100000:2.0:1789304469.700435:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765532928:12345-192.168.202.29@tcp:2:touch.60003 Request processed in 375us (597us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789304469.700444:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 425 00000100:00080000:1.0:1789304469.700637:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304469.704726:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304469.705078:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765533184 00000100:00100000:3.0:1789304469.705086:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765533184 00000100:00100000:3.0:1789304469.705149:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:3.0:1789304469.705156:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:46867:x1876219765533184:12345-192.168.202.29@tcp:35:touch.60003 00000100:00100000:3.0:1789304469.705412:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:46867:x1876219765533184:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 256us (693us total) trans 4294967599 rc 0/0 00000100:00100000:3.0:1789304469.705418:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:3.0:1789304469.742647:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304469.742758:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765533312 00000100:00100000:0.0:1789304469.742770:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765533312 00000100:00100000:0.0:1789304469.742836:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 790 00000100:00100000:0.0:1789304469.742855:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:46871:x1876219765533312:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:0.0:1789304469.742882:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304469.743569:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861003fe expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.743639:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb723129618f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.743653:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb723129618f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.743665:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb723129618f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.743681:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.743688:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.743695:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.743797:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129619d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.743806:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129619d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.743814:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129619d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304469.743857:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x41:0x0]: returning size 0 00000004:00200000:1.0:1789304469.743862:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304469.743883:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129619d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744358:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129619d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744369:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb723129618f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744376:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb723129618f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744383:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb723129618f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744389:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304469.744393:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb723129618f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744400:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb723129618f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744412:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:1.0:1789304469.744415:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304469.744420:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb723129618f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744430:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb723129618f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744443:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744450:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296196 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744455:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744460:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304469.744463:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744469:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296196 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744475:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c14addb00) 00010000:00010000:1.0:1789304469.744478:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304469.744481:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296196 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744487:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744518:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003fe expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744538:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129619d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003fe expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.744546:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:1.0:1789304469.744548:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304469.744550:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371400, rc 0) 00000100:00100000:1.0:1789304469.744623:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:46871:x1876219765533312:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 1769us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304469.744631:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 790 00000100:00100000:0.0:1789304469.747836:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304469.748082:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765533440 00000100:00100000:1.0:1789304469.748619:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765533440 00000100:00100000:1.0:1789304469.748725:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 426 00000100:00100000:1.0:1789304469.748737:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765533440:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:1.0:1789304469.748763:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304469.748784:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c947932d/0xefc0bb72312961a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100405 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789304469.748811:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x6aa69e95, atime: 0x6aa69e95, ctime: 0x6aa69e95, blocks: 0x1 00010000:00010000:1.0:1789304469.748831:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=1919s v=(0 0) 00010000:00010000:1.0:1789304469.748835:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304469.748853:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c947932d/0xefc0bb72312961a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100405 expref: 7 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.748872:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c947932d/0xefc0bb72312961a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100405 expref: 7 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.748901:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370000, rc 0) 00000100:00100000:1.0:1789304469.749220:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765533440:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 484us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304469.749228:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 426 00000100:00100000:0.0:1789304469.756662:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304469.756757:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765533696 00000100:00100000:3.0:1789304469.756769:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765533696 00000100:00100000:3.0:1789304469.756825:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 791 00000100:00100000:3.0:1789304469.756834:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:46871:x1876219765533696:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:3.0:1789304469.756912:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304469.756942:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129619d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003fe expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.756974:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003f7 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.756985:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:3.0:1789304469.756998:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304469.757022:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.757034:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.757042:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.757055:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.757061:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.757067:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.757483:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.757493:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.757500:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304469.758334:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].25, 64 off9792 00000004:00080000:3.0:1789304469.758344:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1919436253378ns, next at 1920436251262ns, rc = 0 00010000:00010000:3.0:1789304469.758403:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758415:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758424:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758433:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758439:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758446:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758459:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304469.758481:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758488:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758494:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758500:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304469.758505:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758512:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758522:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304469.758525:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304469.758530:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758536:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758554:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758560:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758566:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758571:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304469.758574:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758580:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758587:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:3.0:1789304469.758589:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304469.758592:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304469.758598:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304469.758608:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5435ba1 reply state 00000000bbb84496 transno 4294967600 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304469.758622:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789304469.758856:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304469.758864:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.758871:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304469.758874:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.758881:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.758904:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:0.0:1789304469.758907:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789304469.758910:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.758916:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312961c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.758932:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304469.758933:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304469.758935:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304469.759717:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:46871:x1876219765533696:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 2878us (3058us total) trans 4294967600 rc 0/0 00000100:00100000:3.0:1789304469.759727:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 791 00010000:00010000:1.0:1789304469.768532:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.768550:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.768558:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.768564:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304469.768569:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.768577:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.768594:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c2ea19a00) 00010000:00010000:1.0:1789304469.768598:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304469.768603:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304469.768609:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312961b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304469.842328:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304470.553772:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304470.554725:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765533824 00000100:00100000:2.0:1789304470.554736:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765533824 00000100:00100000:2.0:1789304470.554805:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 792 00000100:00100000:2.0:1789304470.554817:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:46886:x1876219765533824:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304470.554849:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304470.554871:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312961c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610040c expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.554935:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312961ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.554949:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312961ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.554962:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312961ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304470.554998:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:2.0:1789304470.555002:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304470.555020:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312961ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.555044:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312961c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610040c expref: 13 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.555061:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312961ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610040c expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.555069:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:2.0:1789304470.555072:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304470.555076:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecce00, rc 0) 00000100:00100000:2.0:1789304470.555161:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:46886:x1876219765533824:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 347us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304470.555168:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 792 00000100:00100000:3.0:1789304470.559866:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304470.559938:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765534080 00000100:00100000:2.0:1789304470.559948:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765534080 00000100:00100000:2.0:1789304470.560009:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 793 00000100:00100000:2.0:1789304470.560020:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:46886:x1876219765534080:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:2.0:1789304470.560071:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304470.560133:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312961ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610040c expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.560154:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296150 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861003e9 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.560164:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:2.0:1789304470.560176:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304470.560201:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.560214:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.560223:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304470.614186:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007522a829 reply state 00000000b5682f04 transno 4294967601 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304470.614204:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304470.614221:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000100:00100000:1.0:1789304470.614339:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:46886:x1876219765534080:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 54317us (54477us total) trans 4294967601 rc 0/0 00000100:00100000:1.0:1789304470.614349:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 793 00000001:00080000:1.0:1789304470.614386:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967598 is committed 00000001:00080000:1.0:1789304470.614406:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967601 is committed 00000004:00080000:1.0:1789304470.614415:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 64 committed 00010000:00010000:1.0:1789304470.614453:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.614472:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.614482:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.614488:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304470.614494:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.614501:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.614517:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:1.0:1789304470.614520:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304470.614525:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.614531:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312961d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304470.615019:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785616768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789304470.615158:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304470.615313:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785616768 00000100:00100000:2.0:1789304470.615322:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785616768 00000100:00100000:2.0:1789304470.615377:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1789304470.615387:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785616768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789304470.615416:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:25 count 1 00010000:00010000:2.0:1789304470.615439:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.615459:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c947932d/0xefc0bb72312961a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100405 expref: 6 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.615468:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789304470.615472:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304470.615477:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.615505:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c947932d/0xefc0bb72312961a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100405 expref: 6 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304470.615526:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c947932d/0xefc0bb72312961a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100405 expref: 6 pid: 17212 timeout: 2020 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304470.615538:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785616896:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789304470.615601:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0619d0c0 going to sleep for 11 seconds 00000100:00080000:1.0:1789304470.615774:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304470.619240:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785616896:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789304470.619243:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:0.0:1789304470.619279:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304470.621688:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765534208 00000100:00100000:1.0:1789304470.621706:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765534208 00010000:00010000:1.0:1789304470.621754:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c947932d/0xefc0bb72312961a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100405 expref: 7 pid: 17212 timeout: 2020 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304470.621796:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 365 00000100:00100000:1.0:1789304470.621805:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765534208:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304470.621823:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304470.621829:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c947932d/0xefc0bb72312961a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100405 expref: 7 pid: 17212 timeout: 2020 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.621854:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c947932d/0xefc0bb72312961a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100405 expref: 7 pid: 17212 timeout: 2020 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.621882:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c947932d/0xefc0bb72312961a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100405 expref: 7 pid: 17212 timeout: 2020 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.621908:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304470.621912:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304470.621918:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.621934:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.621961:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304470.622022:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765534208:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 217us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304470.622029:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 365 00010000:00010000:1.0:1789304470.622060:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.622069:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.622080:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.622108:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.622128:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789304470.622679:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785616768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7292us (7520us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1789304470.622687:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00010000:00010000:1.0:1789304470.622805:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304470.622812:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.622822:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304470.622827:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.622845:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.622861:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.622869:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000318c411a/0xefc0bb72312961dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304470.622888:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304470.622890:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304470.622891:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304470.622929:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c0651c700/2, rc 0, transno 4294967347 00000100:00100000:1.0:1789304470.622936:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785616768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304470.692546:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304470.692623:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765534336 00000100:00100000:3.0:1789304470.692636:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765534336 00000100:00100000:3.0:1789304470.692699:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 794 00000100:00100000:3.0:1789304470.692709:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:46890:x1876219765534336:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304470.692734:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304470.692754:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100413 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.692807:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.692817:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.692826:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.692848:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312961f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.692856:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312961f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.692867:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312961f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693283:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312961f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693294:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312961f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693301:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312961f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304470.693321:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:3.0:1789304470.693324:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304470.693344:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312961f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693355:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693362:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693369:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693375:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304470.693379:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693386:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693398:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:3.0:1789304470.693401:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304470.693406:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693413:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312961ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693423:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312961f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693429:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312961f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693435:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312961f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693440:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304470.693443:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312961f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693449:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312961f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693456:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304470.693459:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304470.693462:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312961f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693468:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312961f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693498:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100413 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693516:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312961f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100413 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304470.693523:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789304470.693525:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304470.693527:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304470.693599:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46890:x1876219765534336:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 891us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304470.693608:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 794 00010000:00010000:0.0:1789304470.869544:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304470.870070:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00000001:00080000:1.0:1789304470.870087:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00000100:00100000:3.0:1789304471.314603:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785617024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304471.314677:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304471.314752:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785617024 00000100:00100000:3.0:1789304471.314759:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785617024 00000100:00100000:3.0:1789304471.314802:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1789304471.314808:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785617024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304471.314851:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789304471.315208:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304471.315411:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785617024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 602us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304471.315417:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1789304471.316559:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785617024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304471.410660:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304471.410741:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304471.410779:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304471.410814:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304471.411310:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765534848 00000100:00100000:2.0:1789304471.411324:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765534848 00000100:00100000:2.0:1789304471.411401:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765534720 00000100:00100000:2.0:1789304471.411405:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765534720 00000100:00100000:2.0:1789304471.411434:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1004 00000100:00100000:2.0:1789304471.411457:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765534848:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304471.411532:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765534848:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 88us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304471.411540:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1004 00000100:00100000:2.0:1789304471.411560:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1005 00000100:00100000:2.0:1789304471.411567:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765534720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304471.411590:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765534720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304471.411596:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1005 00000100:00080000:2.0:1789304471.411612:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304471.411615:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304471.415391:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765534464 00000100:00100000:2.0:1789304471.415411:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765534464 00000100:00100000:2.0:1789304471.415503:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1116 00000100:00100000:2.0:1789304471.415514:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765534464:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304471.415603:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765534464:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 91us (4822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304471.415611:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1116 00000100:00100000:0.0:1789304471.419583:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765534592 00000100:00100000:0.0:1789304471.419603:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765534592 00000100:00100000:0.0:1789304471.419786:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1354 00000100:00100000:0.0:1789304471.419800:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765534592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304471.419933:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765534592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 136us (9285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304471.419942:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1354 00000100:00080000:2.0:1789304471.430802:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304471.484957:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304471.485045:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765534976 00000100:00100000:3.0:1789304471.485057:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765534976 00000100:00100000:3.0:1789304471.485142:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 795 00000100:00100000:3.0:1789304471.485154:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:46904:x1876219765534976:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304471.485177:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304471.485200:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610041a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.485270:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296206 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.485285:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.485310:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304471.485348:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:3.0:1789304471.485353:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304471.485488:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296206 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.485518:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312961ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610041a expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.485538:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296206 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610041a expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.485547:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789304471.485549:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304471.485553:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304471.485617:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:46904:x1876219765534976:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 465us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304471.485625:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 795 00000100:00100000:1.0:1789304471.493197:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304471.493276:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765535232 00000100:00100000:3.0:1789304471.493287:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765535232 00000100:00100000:3.0:1789304471.493358:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 796 00000100:00100000:3.0:1789304471.493378:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:46904:x1876219765535232:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304471.493447:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304471.493483:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296206 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610041a expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.493506:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312961f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100413 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.493516:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789304471.493528:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304471.493560:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.493573:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.493583:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304471.493954:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b14cf247 reply state 0000000036e7a639 transno 4294967602 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304471.493964:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304471.493973:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000100:00100000:3.0:1789304471.494065:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:46904:x1876219765535232:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 689us (878us total) trans 4294967602 rc 0/0 00000100:00100000:3.0:1789304471.494072:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 796 00010000:00010000:3.0:1789304471.499444:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.499461:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.499470:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.499476:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304471.499482:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.499491:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.499508:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304471.499511:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304471.499516:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.499522:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129620d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304471.615272:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304471.615362:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765535360 00000100:00100000:0.0:1789304471.615373:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765535360 00000100:00100000:0.0:1789304471.615434:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 797 00000100:00100000:0.0:1789304471.615445:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46916:x1876219765535360:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304471.615543:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46916:x1876219765535360:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304471.615553:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 797 00000100:00100000:1.0:1789304471.616992:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304471.617054:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765535488 00000100:00100000:2.0:1789304471.617061:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765535488 00000100:00100000:2.0:1789304471.617146:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 428 00000100:00100000:2.0:1789304471.617168:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:46916:x1876219765535488:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304471.617528:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:46916:x1876219765535488:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 373us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304471.617536:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 428 00000100:00100000:3.0:1789304471.618753:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304471.618889:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765535616 00000100:00100000:2.0:1789304471.618897:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765535616 00000100:00100000:2.0:1789304471.618939:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 429 00000100:00100000:2.0:1789304471.618949:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:46916:x1876219765535616:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304471.619293:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:46916:x1876219765535616:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 345us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304471.619301:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 429 00000100:00100000:1.0:1789304471.621779:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304471.621874:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765535744 00000100:00100000:0.0:1789304471.621886:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765535744 00000100:00100000:0.0:1789304471.621960:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 798 00000100:00100000:0.0:1789304471.621971:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46916:x1876219765535744:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304471.622459:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:46916:x1876219765535744:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 488us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304471.622468:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 798 00000100:00100000:1.0:1789304471.626815:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304471.626930:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765535872 00000100:00100000:3.0:1789304471.626941:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765535872 00000100:00100000:3.0:1789304471.627002:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 799 00000100:00100000:3.0:1789304471.627013:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:46916:x1876219765535872:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304471.627149:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:46916:x1876219765535872:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 139us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304471.627157:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 799 00000100:00100000:1.0:1789304471.629118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304471.629253:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765536000 00000100:00100000:0.0:1789304471.629263:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765536000 00000100:00100000:0.0:1789304471.629324:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 430 00000100:00100000:0.0:1789304471.629334:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:46916:x1876219765536000:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304471.629730:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:46916:x1876219765536000:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 396us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304471.629742:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 430 00000100:00100000:0.0:1789304471.632086:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304471.637416:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765536128 00000100:00100000:1.0:1789304471.637433:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765536128 00000100:00100000:2.0:1789304471.637612:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 431 00000100:00100000:2.0:1789304471.637623:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:46916:x1876219765536128:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304471.638192:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:46916:x1876219765536128:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 569us (6113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304471.638205:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 431 00000100:00100000:1.0:1789304471.639966:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304471.640121:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765536256 00000100:00100000:0.0:1789304471.640131:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765536256 00000100:00100000:0.0:1789304471.640188:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 800 00000100:00100000:0.0:1789304471.640199:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46916:x1876219765536256:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304471.640684:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:46916:x1876219765536256:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 485us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304471.640693:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 800 00000100:00100000:1.0:1789304471.708601:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304471.708691:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765536384 00000100:00100000:3.0:1789304471.708702:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765536384 00000100:00100000:3.0:1789304471.708774:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 801 00000100:00100000:3.0:1789304471.708785:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:46920:x1876219765536384:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:3.0:1789304471.708805:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304471.708840:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296214 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100421 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709303:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129621b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709319:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129621b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709332:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129621b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709348:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296222 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709355:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296222 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709362:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296222 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709667:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296229 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709674:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709682:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304471.709704:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:3.0:1789304471.709708:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304471.709727:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709752:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129621b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709759:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129621b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709766:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129621b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709773:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304471.709777:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129621b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709784:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129621b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709795:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:3.0:1789304471.709798:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304471.709803:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129621b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.709808:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129621b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.710010:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296222 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.710018:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296222 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.710025:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296222 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.710031:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304471.710034:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296222 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.710040:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296222 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.710049:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304471.710051:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304471.710054:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296222 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.710060:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296222 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.710216:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296214 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100421 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.710233:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100421 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304471.710245:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789304471.710248:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304471.710251:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304471.710453:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:46920:x1876219765536384:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1668us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304471.710462:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 801 00000100:00100000:2.0:1789304471.715200:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304471.716806:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765536640 00000100:00100000:1.0:1789304471.716831:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765536640 00000100:00100000:1.0:1789304471.717033:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 802 00000100:00100000:1.0:1789304471.717045:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:46920:x1876219765536640:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:1.0:1789304471.717066:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304471.717086:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296230 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100428 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.717408:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296237 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.717423:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296237 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.718063:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296237 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.718113:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.718127:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.718135:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789304471.722852:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19:0x0], index 1: 0 00010000:00010000:1.0:1789304471.723844:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.723861:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.723874:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.723927:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296237 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.723936:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296237 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.723943:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296237 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.723950:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304471.723955:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296237 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.723962:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296237 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.723978:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:1.0:1789304471.723981:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304471.723985:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296237 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.723991:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296237 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304471.724005:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b34ca69 reply state 00000000203a5368 transno 4294967603 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304471.724014:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789304471.724049:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296230 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100428 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.724064:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100428 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.724071:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9e2c14add400) 00010000:00010000:1.0:1789304471.724074:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304471.724076:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371c00, rc 0) 00000100:00100000:1.0:1789304471.724186:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:46920:x1876219765536640:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 7143us (8995us total) trans 4294967603 rc 0/0 00000100:00100000:1.0:1789304471.724196:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 802 00010000:00010000:1.0:1789304471.726083:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.726124:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.726132:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.726139:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304471.726144:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.726152:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.726166:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c14add000) 00010000:00010000:1.0:1789304471.726169:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304471.726173:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304471.726179:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129623e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304471.730529:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304471.730686:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765536768 00000100:00100000:0.0:1789304471.730697:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765536768 00000100:00100000:0.0:1789304471.730755:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 432 00000100:00100000:0.0:1789304471.730766:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:46920:x1876219765536768:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304471.730784:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304471.730806:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d7c584c/0xefc0bb7231296253 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610042f expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304471.730844:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789304471.730869:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=1921s v=(0 0) 00010000:00010000:0.0:1789304471.730874:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304471.730884:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d7c584c/0xefc0bb7231296253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610042f expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304471.730900:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d7c584c/0xefc0bb7231296253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610042f expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304471.730917:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbc00, rc 0) 00000100:00100000:0.0:1789304471.730983:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:46920:x1876219765536768:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 218us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304471.730991:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 432 00000100:00100000:2.0:1789304471.758971:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304471.759115:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765536896 00000100:00100000:1.0:1789304471.759126:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765536896 00002000:00100000:1.0:1789304471.759184:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x19:0x0] (0->1048575) req@ffff9e2b011f5500 x1876219765536896/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:537/0 lens 488/0 e 0 to 0 dl 1789304482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304471.759196:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b011f5500 with x1876219765536896 ext(0->1048575) 00002000:00010000:1.0:1789304471.759203:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b011f5500 00000100:00100000:1.0:1789304471.759245:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:1.0:1789304471.759254:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765536896:12345-192.168.202.29@tcp:4:dd.60003 00000100:00100000:1.0:1789304471.783216:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2357:x1876219765536896:12345-192.168.202.29@tcp:4:dd.60003 Request processed in 23951us (24244us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789304471.783233:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00002000:00100000:1.0:1789304471.783247:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x19:0x0] (0->1048575) req@ffff9e2b011f5500 x1876219765536896/t4294967346(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:537/0 lens 488/448 e 0 to 0 dl 1789304482 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304471.783258:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b011f5500 with x1876219765536896 ext(0->1048575) 00002000:00010000:1.0:1789304471.783264:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b011f5500 00000100:00100000:3.0:1789304471.787421:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304471.787534:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765537024 00000100:00100000:0.0:1789304471.787546:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765537024 00000100:00100000:0.0:1789304471.787609:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 803 00000100:00100000:0.0:1789304471.787619:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:46920:x1876219765537024:12345-192.168.202.29@tcp:44:dd.60003 00000100:00100000:0.0:1789304471.818004:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:46920:x1876219765537024:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 30375us (30582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304471.818018:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 803 00000001:00080000:1.0:1789304471.818205:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967603 is committed 00000100:00100000:2.0:1789304471.821966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304471.822067:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765537152 00000100:00100000:1.0:1789304471.822079:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765537152 00000100:00100000:1.0:1789304471.822249:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 433 00000100:00100000:1.0:1789304471.822258:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765537152:12345-192.168.202.29@tcp:16:dd.60003 00000001:00080000:0.0:1789304471.857919:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00000100:00100000:3.0:1789304471.858150:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765537152:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 35886us (36188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304471.858162:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 433 00000100:00100000:0.0:1789304471.862534:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304471.862638:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765537408 00000100:00100000:2.0:1789304471.862650:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765537408 00000100:00100000:2.0:1789304471.862716:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 83 00000100:00100000:2.0:1789304471.862726:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:46920:x1876219765537408:12345-192.168.202.29@tcp:35:dd.60003 00000001:00080000:2.0:1789304471.863222:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967604 00000100:00100000:2.0:1789304471.863345:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:46920:x1876219765537408:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 619us (820us total) trans 4294967605 rc 0/0 00000100:00100000:2.0:1789304471.863354:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 83 00000020:00080000:2.0:1789304471.863359:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789304471.890222:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304472.340038:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304472.340067:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785617152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304472.340159:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304472.340226:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785617152 00000100:00100000:1.0:1789304472.340234:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785617152 00000100:00100000:1.0:1789304472.340305:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1789304472.340315:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785617152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304472.340352:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304472.340401:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785617152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304472.340409:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1789304472.340447:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:1.0:1789304472.340454:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c0651c700, transno 4294967347 00000100:00100000:1.0:1789304472.340470:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785617152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304472.340687:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789304472.887420:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967605 is committed 00010000:00010000:3.0:1789304472.922807:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304473.848538:0:80421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1923526444583ns, next at 1920436251262ns, rc = 0 00000004:00080000:1.0:1789304473.848693:0:80421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1923526601711ns, next at 1900933967697ns, rc = 0 00000004:00080000:3.0:1789304473.854720:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 71 committed 00000004:00080000:3.0:1789304473.854782:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 65 committed 00000100:00100000:1.0:1789304473.875351:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785617664:0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.875425:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304473.875491:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789304473.875498:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785617280:0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.875528:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304473.875555:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785617792:0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.875594:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304473.875625:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785617408:0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.875651:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304473.875667:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785617920:0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.875686:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304473.875706:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304473.875711:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785617536:0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.875731:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304473.875766:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785617664 00000100:00100000:1.0:1789304473.875773:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785617664 00000100:00100000:1.0:1789304473.875836:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785617792 00000100:00100000:1.0:1789304473.875840:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785617792 00000100:00100000:1.0:1789304473.875982:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785617408 00000100:00100000:1.0:1789304473.875987:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785617408 00000100:00100000:1.0:1789304473.876010:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1789304473.876018:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785617664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.876215:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785617664:12345-0@lo:400:kworker.0 Request processed in 196us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304473.876226:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1789304473.876245:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1789304473.876251:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785617792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.876281:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785617792:12345-0@lo:400:kworker.0 Request processed in 31us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304473.876286:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1789304473.876297:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1789304473.876302:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785617408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.876330:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785617408:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304473.876336:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1789304473.876353:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785617280 00000100:00100000:1.0:1789304473.876357:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785617280 00000100:00100000:1.0:1789304473.876381:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1789304473.876387:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785617280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.876413:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785617280:12345-0@lo:400:kworker.0 Request processed in 27us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304473.876419:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1789304473.876453:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785617920 00000100:00100000:1.0:1789304473.876456:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785617920 00000100:00100000:1.0:1789304473.876480:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785617536 00000100:00100000:1.0:1789304473.876483:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785617536 00000100:00100000:1.0:1789304473.876502:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1789304473.876507:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785617920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.876534:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785617920:12345-0@lo:400:kworker.0 Request processed in 28us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304473.876543:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1789304473.876554:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:1.0:1789304473.876560:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785617536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.876587:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785617536:12345-0@lo:400:kworker.0 Request processed in 28us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304473.876591:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00080000:1.0:1789304473.876609:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304473.876612:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304473.876653:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785617536:0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.876663:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785617408:0@lo:400:kworker.0 00000100:00100000:1.0:1789304473.876672:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785617920:0@lo:400:kworker.0 00000100:00100000:0.0:1789304473.882019:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785617664:0@lo:400:kworker.0 00000100:00100000:3.0:1789304473.882290:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785617280:0@lo:400:kworker.0 00000100:00100000:3.0:1789304473.882305:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785617792:0@lo:400:kworker.0 00010000:00010000:0.0:1789304473.939203:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304474.963723:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304475.463932:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304475.464016:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765537536 00000100:00100000:2.0:1789304475.464027:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765537536 00000100:00100000:2.0:1789304475.464115:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 804 00000100:00100000:2.0:1789304475.464127:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:47113:x1876219765537536:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304475.464227:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:47113:x1876219765537536:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 103us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304475.464235:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 804 00000100:00080000:0.0:1789304475.464324:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304475.468944:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304475.469234:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765537664 00000100:00100000:1.0:1789304475.469244:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765537664 00000100:00100000:1.0:1789304475.469406:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 434 00000100:00100000:1.0:1789304475.469417:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:47113:x1876219765537664:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304475.469774:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:47113:x1876219765537664:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 359us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304475.469782:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 434 00000100:00080000:0.0:1789304475.469931:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304475.478520:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304475.478596:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765537792 00000100:00100000:2.0:1789304475.478608:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765537792 00000100:00100000:2.0:1789304475.478678:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 435 00000100:00100000:2.0:1789304475.478690:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:47113:x1876219765537792:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304475.479069:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:47113:x1876219765537792:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 382us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304475.479078:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 435 00000100:00080000:1.0:1789304475.479216:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304475.490011:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304475.491475:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765537920 00000100:00100000:2.0:1789304475.491491:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765537920 00000100:00100000:2.0:1789304475.491559:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 805 00000100:00100000:2.0:1789304475.491569:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:47113:x1876219765537920:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304475.494434:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:47113:x1876219765537920:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 2854us (4421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304475.494448:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 805 00000100:00100000:1.0:1789304475.504034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304475.504084:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765538048 00000100:00100000:1.0:1789304475.504109:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765538048 00000100:00100000:1.0:1789304475.504164:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 806 00000100:00100000:1.0:1789304475.504176:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:47113:x1876219765538048:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304475.504281:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:47113:x1876219765538048:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 107us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304475.504289:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 806 00000100:00100000:0.0:1789304475.513952:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304475.515138:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765538176 00000100:00100000:2.0:1789304475.515153:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765538176 00000100:00100000:2.0:1789304475.515214:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 436 00000100:00100000:2.0:1789304475.515223:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:47113:x1876219765538176:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304475.515578:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:47113:x1876219765538176:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 355us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304475.515586:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 436 00000100:00100000:1.0:1789304475.518513:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304475.518582:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765538304 00000100:00100000:2.0:1789304475.518591:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765538304 00000100:00100000:2.0:1789304475.518661:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 437 00000100:00100000:2.0:1789304475.518672:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:47113:x1876219765538304:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304475.519494:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:47113:x1876219765538304:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 821us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304475.519504:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 437 00000100:00100000:2.0:1789304475.524085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304475.524271:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765538432 00000100:00100000:1.0:1789304475.524284:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765538432 00000100:00100000:1.0:1789304475.524347:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 807 00000100:00100000:1.0:1789304475.524359:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:47113:x1876219765538432:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304475.524843:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:47113:x1876219765538432:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 486us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304475.524851:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 807 00000100:00100000:0.0:1789304475.596997:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304475.597068:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765538688 00000100:00100000:2.0:1789304475.597078:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765538688 00000100:00100000:2.0:1789304475.597180:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 808 00000100:00100000:2.0:1789304475.597190:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:47117:x1876219765538688:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:2.0:1789304475.597247:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304475.597274:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296245 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100428 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.597295:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9e2c14add400) 00010000:00010000:2.0:1789304475.597400:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304475.597424:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129625a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.597438:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129625a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.597447:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129625a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.597460:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.597467:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.597473:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.597976:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296268 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.597991:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296268 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.597998:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296268 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304475.598975:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].25, 64 off9792 00000004:00080000:2.0:1789304475.598986:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1925276894440ns, next at 1926276891747ns, rc = 0 00010000:00010000:2.0:1789304475.599069:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599081:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599130:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599139:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599146:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599152:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599446:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304475.599472:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296268 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599479:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296268 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599487:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296268 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599493:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304475.599498:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296268 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599506:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296268 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599517:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304475.599519:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304475.599523:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296268 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599530:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231296268 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599550:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129625a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599557:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129625a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599563:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129625a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599567:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304475.599570:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129625a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599580:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129625a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599587:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:2.0:1789304475.599589:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304475.599592:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129625a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304475.599598:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb723129625a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304475.599607:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c408ae4a reply state 0000000094ef9094 transno 4294967606 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304475.599615:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304475.599703:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:47117:x1876219765538688:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 2510us (2713us total) trans 4294967606 rc 0/0 00000100:00100000:2.0:1789304475.599710:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 808 00010000:00010000:3.0:1789304475.599838:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304475.599845:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.599851:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304475.599854:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.599860:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.599873:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:3.0:1789304475.599875:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304475.599878:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.599884:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb723129626f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.599900:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304475.599902:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304475.599904:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304475.601855:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.601872:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.601879:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.601886:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304475.601890:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.601898:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.601911:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff9e2c421d2900) 00010000:00010000:3.0:1789304475.601914:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304475.601919:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304475.601927:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296261 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304475.986650:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304476.437649:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785618048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304476.437723:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304476.437841:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785618048 00000100:00100000:3.0:1789304476.437851:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785618048 00000100:00100000:3.0:1789304476.437919:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1789304476.437930:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785618048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304476.437967:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789304476.438027:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785618048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304476.438033:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1789304476.438119:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785618048:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304476.438240:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304476.522849:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304476.522882:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304476.522913:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304476.522942:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304476.522972:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765539200 00000100:00100000:0.0:1789304476.522982:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765539200 00000100:00100000:0.0:1789304476.523032:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765539072 00000100:00100000:0.0:1789304476.523036:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765539072 00000100:00100000:0.0:1789304476.523058:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1008 00000100:00100000:0.0:1789304476.523074:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765539200:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304476.523190:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765539200:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 118us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304476.523198:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1008 00000100:00100000:0.0:1789304476.523215:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1009 00000100:00100000:0.0:1789304476.523221:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765539072:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304476.523250:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765539072:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304476.523256:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1009 00000100:00100000:1.0:1789304476.523444:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765538944 00000100:00100000:1.0:1789304476.523449:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765538944 00000100:00100000:1.0:1789304476.523491:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1358 00000100:00100000:1.0:1789304476.523499:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:2357:x1876219765538944:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304476.523546:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:2357:x1876219765538944:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 48us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304476.523552:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1358 00000100:00100000:3.0:1789304476.524348:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765538816 00000100:00100000:3.0:1789304476.524356:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765538816 00000100:00100000:3.0:1789304476.524674:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1118 00000100:00100000:3.0:1789304476.524684:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765538816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304476.524740:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765538816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 58us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304476.525296:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1118 00010000:00010000:1.0:1789304477.010514:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304477.331220:0:80566:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1927009126491ns, next at 1920436251262ns, rc = 0 00000004:00080000:0.0:1789304477.331334:0:80566:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1927009242931ns, next at 1926276891747ns, rc = 0 00000004:00080000:3.0:1789304477.366626:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 73 committed 00000004:00080000:3.0:1789304477.366651:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 66 committed 00000001:00080000:3.0:1789304477.366668:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967606 is committed 00000004:00080000:3.0:1789304477.366673:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 72 committed 00000100:00100000:0.0:1789304477.366843:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304477.366864:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785618176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789304477.366932:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304477.367011:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785618176 00000100:00100000:0.0:1789304477.367019:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785618176 00000100:00100000:0.0:1789304477.367063:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1789304477.367073:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785618176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789304477.367117:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:25 count 1 00010000:00010000:0.0:1789304477.367143:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304477.367165:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d7c584c/0xefc0bb7231296253 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610042f expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304477.367174:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x19:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1789304477.367178:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304477.367183:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304477.367210:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d7c584c/0xefc0bb7231296253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610042f expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304477.367224:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d7c584c/0xefc0bb7231296253 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610042f expref: 5 pid: 6691 timeout: 2027 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304477.367235:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785618304:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304477.367294:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c01377480 going to sleep for 11 seconds 00000100:00100000:0.0:1789304477.369196:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785618304:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789304477.369224:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304477.369788:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304477.369870:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765539328 00000100:00100000:2.0:1789304477.369878:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765539328 00010000:00010000:2.0:1789304477.369966:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d7c584c/0xefc0bb7231296253 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610042f expref: 6 pid: 6691 timeout: 2027 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304477.370001:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 366 00000100:00100000:2.0:1789304477.370012:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765539328:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304477.370028:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304477.370033:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d7c584c/0xefc0bb7231296253 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610042f expref: 6 pid: 6691 timeout: 2027 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304477.370051:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d7c584c/0xefc0bb7231296253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610042f expref: 6 pid: 6691 timeout: 2027 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304477.370077:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d7c584c/0xefc0bb7231296253 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610042f expref: 6 pid: 6691 timeout: 2027 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304477.370130:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304477.370135:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304477.370140:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304477.370150:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304477.370174:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304477.370224:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765539328:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 215us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304477.370232:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 366 00010000:00010000:3.0:1789304477.370877:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304477.370895:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304477.370907:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304477.370915:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304477.370945:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789304477.371627:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785618176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4553us (4693us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789304477.371636:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00010000:00010000:1.0:1789304477.371764:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304477.371780:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304477.371790:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304477.371795:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304477.371806:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304477.371824:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304477.371830:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296276 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304477.371852:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304477.371853:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304477.371855:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304477.371970:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b036e8e00/2, rc 0, transno 4294967347 00000100:00100000:2.0:1789304477.371983:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785618176:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1789304477.374048:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304477.458568:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304477.458596:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785618432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304477.458664:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304477.458731:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785618432 00000100:00100000:2.0:1789304477.458750:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785618432 00000100:00100000:2.0:1789304477.458836:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1789304477.458845:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785618432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304477.458882:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304477.458924:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785618432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304477.458931:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00080000:2.0:1789304477.458950:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304477.458985:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785618432:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304478.034256:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304478.995337:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785618944:0@lo:400:kworker.0 00000100:00100000:1.0:1789304478.995503:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785618560:0@lo:400:kworker.0 00000100:00100000:1.0:1789304478.995571:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304478.995628:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785619072:0@lo:400:kworker.0 00000100:00100000:1.0:1789304478.995673:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304478.995703:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789304478.995709:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785618688:0@lo:400:kworker.0 00000100:00100000:1.0:1789304478.995733:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304478.995750:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785619200:0@lo:400:kworker.0 00000100:00100000:1.0:1789304478.995783:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304478.995816:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785618560 00000100:00100000:1.0:1789304478.995824:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785618560 00000100:00100000:3.0:1789304478.996010:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785619072 00000100:00100000:3.0:1789304478.996015:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785619072 00000100:00100000:3.0:1789304478.996059:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785618688 00000100:00100000:1.0:1789304478.996062:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:3.0:1789304478.996063:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785618688 00000100:00100000:1.0:1789304478.996072:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785618560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304478.996081:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1789304478.996114:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785619072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304478.996161:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785619072:12345-0@lo:400:kworker.0 Request processed in 74us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304478.996169:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1789304478.996187:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1789304478.996193:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785618688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304478.996195:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785618816:0@lo:400:kworker.0 00000100:00100000:0.0:1789304478.996236:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304478.996277:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789304478.996314:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304478.996335:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785618944 00000100:00100000:2.0:1789304478.996340:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785618944 00000100:00100000:2.0:1789304478.996366:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:2.0:1789304478.996373:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785618944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304478.996426:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785618944:12345-0@lo:400:kworker.0 Request processed in 53us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304478.996432:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00080000:2.0:1789304478.996452:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304478.996484:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785618944:0@lo:400:kworker.0 00000100:00100000:0.0:1789304478.996575:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785619200 00000100:00100000:0.0:1789304478.996579:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785619200 00000100:00100000:0.0:1789304478.996612:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785618816 00000100:00100000:0.0:1789304478.996614:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785618816 00000100:00100000:0.0:1789304478.996632:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1789304478.996639:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785619200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304479.002609:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785618560:12345-0@lo:400:kworker.0 Request processed in 6524us (7024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304479.002629:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1789304479.002857:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1789304479.002951:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785618816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304479.003204:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785618816:12345-0@lo:400:kworker.0 Request processed in 338us (6966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304479.003212:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00080000:1.0:1789304479.003272:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304479.003276:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304479.003325:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785618816:0@lo:400:kworker.0 00000100:00100000:3.0:1789304479.005311:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785618688:12345-0@lo:400:kworker.0 Request processed in 9108us (9567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304479.005325:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1789304479.010767:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785619200:12345-0@lo:400:kworker.0 Request processed in 14110us (14964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304479.010786:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1789304479.011049:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785618688:0@lo:400:kworker.0 00000100:00100000:2.0:1789304479.011068:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785619200:0@lo:400:kworker.0 00000100:00100000:2.0:1789304479.011079:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785618560:0@lo:400:kworker.0 00000100:00100000:2.0:1789304479.011108:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785619072:0@lo:400:kworker.0 00010000:00010000:1.0:1789304479.059585:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304480.082356:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304480.628704:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967347 is committed 00010000:00010000:0.0:1789304481.106306:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304481.559257:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304481.559284:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785619328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304481.559372:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304481.559747:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785619328 00000100:00100000:3.0:1789304481.559758:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785619328 00000100:00100000:3.0:1789304481.559835:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1789304481.559846:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c4112b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785619328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304481.559882:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304481.559942:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c4112b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785619328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304481.559960:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1789304481.560211:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:3.0:1789304481.560219:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b036e8e00, transno 4294967347 00000100:00100000:3.0:1789304481.560236:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785619328:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304481.560657:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304481.646083:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304481.646141:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304481.646175:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304481.646202:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304481.646239:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765539840 00000100:00100000:1.0:1789304481.646249:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765539840 00000100:00100000:1.0:1789304481.646302:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765539712 00000100:00100000:1.0:1789304481.646304:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765539712 00000100:00100000:1.0:1789304481.646323:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1012 00000100:00100000:1.0:1789304481.646332:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765539840:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304481.646396:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765539840:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 65us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304481.646403:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1012 00000100:00100000:1.0:1789304481.646420:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1013 00000100:00100000:1.0:1789304481.646425:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765539712:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304481.646443:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765539712:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 19us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304481.646448:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1013 00000100:00080000:1.0:1789304481.646588:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304481.646593:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304481.648437:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765539584 00000100:00100000:2.0:1789304481.648455:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765539584 00000100:00100000:2.0:1789304481.648558:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1362 00000100:00100000:2.0:1789304481.648569:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765539584:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304481.648654:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765539584:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 88us (2583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304481.648661:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1362 00000100:00080000:1.0:1789304481.649663:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304481.649978:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765539456 00000100:00100000:3.0:1789304481.649990:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765539456 00000100:00100000:3.0:1789304481.650053:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1120 00000100:00100000:3.0:1789304481.650063:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765539456:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304481.650194:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765539456:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 133us (4017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304481.650201:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1120 00010000:00010000:1.0:1789304482.131017:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304482.580062:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785619456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304482.580167:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304482.580341:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785619456 00000100:00100000:0.0:1789304482.580363:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785619456 00000100:00100000:0.0:1789304482.580487:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1789304482.580498:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785619456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304482.580579:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304482.580654:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785619456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304482.580662:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00080000:2.0:1789304482.580890:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304482.580933:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785619456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304483.154391:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304484.116624:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785619584:0@lo:400:kworker.0 00000100:00100000:3.0:1789304484.116753:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304484.116806:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785620096:0@lo:400:kworker.0 00000100:00100000:3.0:1789304484.116833:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304484.116860:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789304484.116865:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785619712:0@lo:400:kworker.0 00000100:00100000:3.0:1789304484.116884:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304484.116898:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785620224:0@lo:400:kworker.0 00000100:00100000:3.0:1789304484.116918:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304484.116942:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785619968:0@lo:400:kworker.0 00000100:00100000:3.0:1789304484.116961:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304484.116977:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304484.116981:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785619840:0@lo:400:kworker.0 00000100:00100000:3.0:1789304484.117000:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304484.117022:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785620096 00000100:00100000:3.0:1789304484.117030:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785620096 00000100:00100000:3.0:1789304484.117079:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785619712 00000100:00100000:3.0:1789304484.117082:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785619712 00000100:00100000:3.0:1789304484.117140:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785619968 00000100:00100000:3.0:1789304484.117143:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785619968 00000100:00100000:3.0:1789304484.117159:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1789304484.117167:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785620096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304484.117219:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785620096:12345-0@lo:400:kworker.0 Request processed in 52us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304484.117438:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:1.0:1789304484.118491:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785619584 00000100:00100000:1.0:1789304484.118501:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785619584 00000100:00100000:1.0:1789304484.118539:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1789304484.118547:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785619584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304484.118606:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785619584:12345-0@lo:400:kworker.0 Request processed in 61us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304484.118612:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1789304484.129535:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1789304484.129565:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785619712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304484.129666:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785619712:12345-0@lo:400:kworker.0 Request processed in 118us (12780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304484.129675:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1789304484.129720:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1789304484.129729:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785619968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304484.129782:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785619968:12345-0@lo:400:kworker.0 Request processed in 55us (12819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304484.129788:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1789304484.129886:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785619712:0@lo:400:kworker.0 00000100:00100000:2.0:1789304484.129900:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785619584:0@lo:400:kworker.0 00000100:00100000:2.0:1789304484.129913:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785620096:0@lo:400:kworker.0 00000100:00100000:2.0:1789304484.130173:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785619968:0@lo:400:kworker.0 00000100:00100000:2.0:1789304484.130209:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785620224 00000100:00100000:2.0:1789304484.130216:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785620224 00000100:00100000:2.0:1789304484.130258:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785619840 00000100:00100000:2.0:1789304484.130261:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785619840 00000100:00100000:2.0:1789304484.130282:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1789304484.130288:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785620224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304484.130331:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785620224:12345-0@lo:400:kworker.0 Request processed in 42us (13411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304484.130337:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1789304484.130349:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1789304484.130355:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785619840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304484.130385:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785619840:12345-0@lo:400:kworker.0 Request processed in 30us (13383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304484.130391:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1789304484.130423:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785619840:0@lo:400:kworker.0 00000100:00100000:2.0:1789304484.130443:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785620224:0@lo:400:kworker.0 00000100:00080000:2.0:1789304484.130482:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304484.130486:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304484.130489:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304484.178754:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304485.202304:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304486.226294:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304486.676205:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785620352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304486.676294:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304486.676464:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785620352 00000100:00100000:0.0:1789304486.676474:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785620352 00000100:00100000:0.0:1789304486.676554:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1789304486.676566:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785620352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304486.676604:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304486.676654:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785620352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304486.676660:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00080000:3.0:1789304486.676905:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304486.678364:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785620352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304486.754206:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304486.754262:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304486.754308:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304486.754357:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304486.754376:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765540352 00000100:00100000:3.0:1789304486.754396:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765540352 00000100:00100000:2.0:1789304486.754538:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765540224 00000100:00100000:2.0:1789304486.754550:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765540224 00000100:00100000:3.0:1789304486.754678:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1016 00000100:00100000:3.0:1789304486.754702:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765540352:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304486.754863:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765539968 00000100:00100000:0.0:1789304486.754870:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765539968 00000100:00100000:0.0:1789304486.754930:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1122 00000100:00100000:0.0:1789304486.754941:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765539968:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304486.755018:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765540352:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 317us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304486.755030:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765539968:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304486.755037:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1016 00000100:00100000:0.0:1789304486.755052:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1122 00000100:00100000:0.0:1789304486.755207:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765540096 00000100:00100000:0.0:1789304486.755212:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765540096 00000100:00100000:2.0:1789304486.757193:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1017 00000100:00100000:2.0:1789304486.757221:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765540224:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304486.757319:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765540224:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 113us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304486.757326:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1017 00000100:00100000:0.0:1789304486.758378:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1366 00000100:00100000:0.0:1789304486.758397:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765540096:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304486.758465:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765540096:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (4272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304486.758472:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1366 00000100:00080000:1.0:1789304486.759053:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304486.760374:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304486.760383:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304487.252498:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304487.699351:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304487.699389:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785620480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304487.699498:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304487.699666:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785620480 00000100:00100000:3.0:1789304487.699687:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785620480 00000100:00100000:3.0:1789304487.699768:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1789304487.699781:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785620480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304487.699830:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304487.699903:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785620480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304487.699911:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1789304487.699974:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785620480:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304487.700389:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304488.278523:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304489.235324:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304489.239213:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785620736:0@lo:400:kworker.0 00000100:00100000:3.0:1789304489.245968:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304489.246210:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785620608:0@lo:400:kworker.0 00000100:00100000:0.0:1789304489.246606:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785620736 00000100:00100000:0.0:1789304489.246621:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785620736 00000100:00100000:0.0:1789304489.247838:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1789304489.247861:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785620736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304489.252835:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785620736:12345-0@lo:400:kworker.0 Request processed in 4958us (6859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304489.252858:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:1.0:1789304489.256742:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785620864:0@lo:400:kworker.0 00000100:00100000:1.0:1789304489.256853:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304489.256941:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304489.256949:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785620992:0@lo:400:kworker.0 00000100:00100000:1.0:1789304489.256981:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304489.257024:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785620992 00000100:00100000:0.0:1789304489.257162:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785621120:0@lo:400:kworker.0 00000100:00100000:0.0:1789304489.257201:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304489.257231:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304489.257237:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785621248:0@lo:400:kworker.0 00000100:00100000:0.0:1789304489.257261:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304489.258066:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785620864 00000100:00100000:2.0:1789304489.258078:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785620864 00000100:00100000:0.0:1789304489.258149:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785621120 00000100:00100000:0.0:1789304489.258156:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785621120 00000100:00100000:2.0:1789304489.258197:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785621248 00000100:00100000:2.0:1789304489.258202:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785621248 00000100:00100000:0.0:1789304489.258214:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:0.0:1789304489.258228:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785621120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304489.258235:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1789304489.258259:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785620864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304489.258344:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785620864:12345-0@lo:400:kworker.0 Request processed in 100us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304489.258351:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1789304489.258369:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1789304489.258385:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785621248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304489.258413:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785621248:12345-0@lo:400:kworker.0 Request processed in 40us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304489.258425:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1789304489.258611:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785620864:0@lo:400:kworker.0 00000100:00080000:2.0:1789304489.258649:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304489.258657:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304489.258674:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304489.258681:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304489.258732:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785620608 00000100:00100000:2.0:1789304489.258737:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785620608 00000100:00100000:3.0:1789304489.258771:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785620736:0@lo:400:kworker.0 00000100:00100000:2.0:1789304489.258775:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1789304489.258785:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785620608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304489.258828:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785621248:0@lo:400:kworker.0 00000100:00100000:1.0:1789304489.258940:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785620992 00000100:00080000:1.0:1789304489.258965:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304489.258998:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1789304489.259007:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785620992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304489.259746:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785620608:0@lo:400:kworker.0 00000100:00100000:1.0:1789304489.259786:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785620992:12345-0@lo:400:kworker.0 Request processed in 778us (2801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304489.259796:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1789304489.259851:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785620992:0@lo:400:kworker.0 00000100:00100000:0.0:1789304489.260817:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785621120:12345-0@lo:400:kworker.0 Request processed in 2585us (3607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304489.260829:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1789304489.260944:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785621120:0@lo:400:kworker.0 00000100:00100000:2.0:1789304489.261781:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785620608:12345-0@lo:400:kworker.0 Request processed in 2992us (3098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304489.261791:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00010000:00010000:1.0:1789304489.308634:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304490.324189:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304491.346315:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304491.796537:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304491.796563:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785621376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304491.796655:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304491.797204:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785621376 00000100:00100000:0.0:1789304491.797213:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785621376 00000100:00080000:1.0:1789304491.797334:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304491.798221:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1789304491.798234:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785621376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304491.798270:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304491.798336:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785621376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304491.798340:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1789304491.798420:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785621376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304491.873576:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304491.873662:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304491.873714:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304491.873774:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765540736 00000100:00100000:3.0:1789304491.873785:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765540736 00000100:00100000:2.0:1789304491.873837:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765540480 00000100:00100000:2.0:1789304491.873843:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765540480 00000100:00100000:3.0:1789304491.873866:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1020 00000100:00100000:2.0:1789304491.873869:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1124 00000100:00100000:3.0:1789304491.873876:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765540736:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304491.873876:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765540480:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304491.873947:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765540736:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304491.873958:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1020 00000100:00100000:0.0:1789304491.873962:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765540608 00000100:00100000:0.0:1789304491.873966:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765540608 00000100:00100000:0.0:1789304491.874013:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1370 00000100:00100000:0.0:1789304491.874020:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765540608:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:1.0:1789304491.874078:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304491.874084:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304491.883587:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765540480:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 9695us (9909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304491.883604:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1124 00000100:00100000:0.0:1789304491.884585:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765540608:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 10559us (11013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304491.884597:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1370 00000100:00100000:1.0:1789304491.886000:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304491.886263:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765540864 00000100:00100000:2.0:1789304491.886274:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765540864 00000100:00100000:2.0:1789304491.886380:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1021 00000100:00100000:2.0:1789304491.886390:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765540864:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304491.886475:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765540864:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 85us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304491.886482:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1021 00000100:00080000:1.0:1789304491.886976:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789304492.370427:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304492.818876:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304492.818901:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785621504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304492.818989:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304492.819181:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785621504 00000100:00100000:0.0:1789304492.819190:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785621504 00000100:00100000:0.0:1789304492.819256:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1789304492.819265:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785621504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304492.819301:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304492.819351:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785621504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304492.819358:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00080000:1.0:1789304492.819451:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304492.819488:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785621504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304492.984178:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304492.984455:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765540992 00000100:00100000:1.0:1789304492.984466:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765540992 00000100:00100000:1.0:1789304492.984530:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 809 00000100:00100000:1.0:1789304492.984541:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:47335:x1876219765540992:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304492.984657:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:47335:x1876219765540992:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 117us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304492.984664:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 809 00000100:00100000:0.0:1789304492.996442:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304492.996531:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765541120 00000100:00100000:3.0:1789304492.996541:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765541120 00000100:00100000:3.0:1789304492.996602:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 439 00000100:00100000:3.0:1789304492.996613:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:47335:x1876219765541120:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304492.997016:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:47335:x1876219765541120:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 404us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304492.997024:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 439 00000100:00100000:3.0:1789304492.998665:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304493.000938:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765541248 00000100:00100000:0.0:1789304493.000955:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765541248 00000100:00100000:0.0:1789304493.001050:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 440 00000100:00100000:0.0:1789304493.001064:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:47335:x1876219765541248:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304493.001483:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:47335:x1876219765541248:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 422us (2824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304493.001491:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 440 00000100:00080000:1.0:1789304493.001645:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304493.004832:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304493.004947:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765541376 00000100:00100000:2.0:1789304493.004957:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765541376 00000100:00100000:2.0:1789304493.005032:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 810 00000100:00100000:2.0:1789304493.005041:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:47335:x1876219765541376:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304493.005508:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:47335:x1876219765541376:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 466us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304493.005517:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 810 00000100:00080000:1.0:1789304493.005591:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304493.007608:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304493.009865:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765541504 00000100:00100000:0.0:1789304493.009884:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765541504 00000100:00100000:0.0:1789304493.009964:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 811 00000100:00100000:0.0:1789304493.009975:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:47335:x1876219765541504:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304493.010124:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:47335:x1876219765541504:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 150us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304493.010132:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 811 00000100:00100000:3.0:1789304493.011758:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304493.012380:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765541632 00000100:00100000:2.0:1789304493.012391:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765541632 00000100:00100000:2.0:1789304493.012519:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 441 00000100:00100000:2.0:1789304493.012527:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:47335:x1876219765541632:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:1.0:1789304493.012758:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304493.013175:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:47335:x1876219765541632:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 646us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304493.013183:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 441 00000100:00100000:3.0:1789304493.014857:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304493.015076:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765541760 00000100:00100000:0.0:1789304493.015085:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765541760 00000100:00100000:0.0:1789304493.015147:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 442 00000100:00100000:0.0:1789304493.015157:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:47335:x1876219765541760:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304493.015472:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:47335:x1876219765541760:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 312us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304493.015481:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 442 00000100:00100000:3.0:1789304493.017450:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304493.017502:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765541888 00000100:00100000:2.0:1789304493.017512:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765541888 00000100:00100000:2.0:1789304493.017566:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 812 00000100:00100000:2.0:1789304493.017576:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:47335:x1876219765541888:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304493.018195:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:47335:x1876219765541888:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 619us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304493.018204:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 812 00000100:00100000:3.0:1789304493.040300:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304493.040466:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765542016 00000100:00100000:2.0:1789304493.040475:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765542016 00000100:00100000:2.0:1789304493.040565:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 813 00000100:00100000:2.0:1789304493.040573:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:47336:x1876219765542016:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304493.040592:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304493.040612:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129627d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100436 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.040714:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296284 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.040730:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.040740:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304493.040776:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:2.0:1789304493.040779:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304493.040799:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.040824:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129627d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100436 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.040843:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296284 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100436 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.040864:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:2.0:1789304493.040867:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304493.040870:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789304493.040952:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:47336:x1876219765542016:12345-192.168.202.29@tcp:101:rm.0 Request processed in 378us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304493.040959:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 813 00000100:00100000:3.0:1789304493.048035:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304493.057057:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765542272 00000100:00100000:0.0:1789304493.057077:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765542272 00000100:00100000:0.0:1789304493.057162:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 814 00000100:00100000:0.0:1789304493.057169:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:47336:x1876219765542272:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304493.057190:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304493.057211:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129628b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610043d expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304493.057319:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00010000:0.0:1789304493.059051:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129628b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610043d expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304493.059072:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304493.059075:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789304493.059080:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129628b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610043d expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304493.061079:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789304493.061534:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:47336:x1876219765542272:12345-192.168.202.29@tcp:101:rm.0 Request processed in 4361us (13503us total) trans 4294967607 rc 301/301 00000100:00100000:0.0:1789304493.061758:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 814 00000100:00100000:3.0:1789304493.066458:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304493.066671:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765542400 00000100:00100000:0.0:1789304493.066683:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765542400 00000100:00100000:0.0:1789304493.066749:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 84 00000100:00100000:0.0:1789304493.066761:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:47336:x1876219765542400:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:0.0:1789304493.071204:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:47336:x1876219765542400:12345-192.168.202.29@tcp:37:rm.0 Request processed in 4432us (4746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304493.071218:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 84 00000100:00100000:0.0:1789304493.078078:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304493.078125:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765542656 00000100:00100000:3.0:1789304493.078137:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765542656 00000100:00100000:3.0:1789304493.078198:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 85 00000100:00100000:3.0:1789304493.078207:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:47336:x1876219765542656:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:3.0:1789304493.078488:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:47336:x1876219765542656:12345-192.168.202.29@tcp:35:rm.0 Request processed in 281us (419us total) trans 4294967608 rc 0/0 00000100:00100000:3.0:1789304493.078496:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 85 00000100:00100000:3.0:1789304493.081336:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304493.082902:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765542912 00000100:00100000:2.0:1789304493.082915:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765542912 00000100:00100000:2.0:1789304493.082986:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 815 00000100:00100000:2.0:1789304493.082997:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:47336:x1876219765542912:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304493.083055:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789304493.083081:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296284 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100436 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083111:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100421 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083121:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:2.0:1789304493.083133:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231295f43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610036b expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083140:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:2.0:1789304493.083144:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304493.083167:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296299 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083181:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296299 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083191:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296299 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083203:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083211:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083221:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083490:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312962a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083496:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312962a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.083501:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312962a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304493.084129:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00010000:2.0:1789304493.084144:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312962a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084149:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312962a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084154:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312962a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084159:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304493.084163:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312962a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084171:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312962a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084181:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789304493.084184:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304493.084189:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312962a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084195:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312962a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084215:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296299 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084222:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296299 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084227:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296299 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084232:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304493.084235:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296299 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084241:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296299 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084248:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:2.0:1789304493.084250:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304493.084253:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296299 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304493.084259:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296299 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304493.084271:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c81dc30 reply state 000000002ddd3b3f transno 4294967609 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304493.084283:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304493.084367:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:47336:x1876219765542912:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1370us (3039us total) trans 4294967609 rc 0/0 00000100:00100000:2.0:1789304493.084373:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 815 00010000:00010000:1.0:1789304493.087858:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304493.087877:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304493.087884:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304493.087890:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304493.087896:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304493.087904:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304493.087920:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9e2c421d2600) 00010000:00010000:1.0:1789304493.087923:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304493.087928:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304493.087934:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb72312962a0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304493.399372:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304494.360826:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785621760:0@lo:400:kworker.0 00000100:00100000:2.0:1789304494.360901:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785622016:0@lo:400:kworker.0 00000100:00100000:1.0:1789304494.360932:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304494.360981:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785621632:0@lo:400:kworker.0 00000100:00100000:0.0:1789304494.361017:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304494.361021:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785622272:0@lo:400:kworker.0 00000100:00100000:0.0:1789304494.361049:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785622144:0@lo:400:kworker.0 00000100:00100000:1.0:1789304494.361056:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304494.361073:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304494.361118:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785621888:0@lo:400:kworker.0 00000100:00100000:0.0:1789304494.361139:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785621632 00000100:00100000:1.0:1789304494.361145:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304494.361149:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785621632 00000100:00100000:1.0:1789304494.361183:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785622272 00000100:00100000:1.0:1789304494.361188:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785622272 00000100:00100000:0.0:1789304494.361198:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:0.0:1789304494.361208:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785621632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304494.361243:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785621888 00000100:00100000:1.0:1789304494.361247:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785621888 00000100:00100000:0.0:1789304494.361253:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785621632:12345-0@lo:400:kworker.0 Request processed in 46us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304494.361261:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1789304494.361275:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1789304494.361284:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785622272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304494.361307:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785621632:0@lo:400:kworker.0 00000100:00100000:1.0:1789304494.361330:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785622272:12345-0@lo:400:kworker.0 Request processed in 47us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304494.361338:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1789304494.361356:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1789304494.361401:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785621760 00000100:00100000:2.0:1789304494.361405:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785621760 00000100:00100000:2.0:1789304494.361433:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785622144 00000100:00100000:2.0:1789304494.361436:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785622144 00000100:00100000:2.0:1789304494.361461:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1789304494.361467:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785621760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304494.361498:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785621760:12345-0@lo:400:kworker.0 Request processed in 32us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304494.361502:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1789304494.361517:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1789304494.361530:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785622144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304494.361535:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785621888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304494.361585:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785622144:12345-0@lo:400:kworker.0 Request processed in 58us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304494.361586:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785621888:12345-0@lo:400:kworker.0 Request processed in 224us (442us total) trans 0 rc 0/0 00000100:00080000:1.0:1789304494.361589:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304494.361595:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304494.361599:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304494.361600:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1789304494.361646:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785621888:0@lo:400:kworker.0 00000100:00100000:0.0:1789304494.361652:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304494.361682:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785622272:0@lo:400:kworker.0 00000100:00100000:1.0:1789304494.361697:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785621760:0@lo:400:kworker.0 00000100:00100000:0.0:1789304494.361699:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785622016 00000100:00100000:0.0:1789304494.361704:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785622016 00000100:00080000:1.0:1789304494.361722:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304494.363241:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785622144:0@lo:400:kworker.0 00000100:00100000:3.0:1789304494.367323:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1789304494.369990:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:0.0:1789304494.370010:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785622016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304494.370126:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785622016:12345-0@lo:400:kworker.0 Request processed in 124us (8475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304494.370134:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:3.0:1789304494.372443:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785622016:0@lo:400:kworker.0 00010000:00010000:1.0:1789304494.419747:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304494.438823:0:80783:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea2fa8ad0 20000000:00000080:2.0:1789304494.438841:0:80783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02ec4c00 uarg=0000000000000000 00010000:00010000:2.0:1789304494.442023:0:80783:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304494.442044:0:80783:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304494.442085:0:80783:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304494.442254:0:80783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304494.442271:0:80783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231295f35 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231295f2e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304494.442279:0:80783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304494.442322:0:80783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231295f35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231295f2e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304494.442336:0:80783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231295f35 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231295f2e expref: 18 pid: 5845 timeout: 2094 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304494.442350:0:80783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80783:1876219785622400:0@lo:104: 00000100:00100000:2.0:1789304494.442413:0:80783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304494.442502:0:80783:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0172e480 going to sleep for 11 seconds 00000100:00100000:3.0:1789304494.442544:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785622400 00000100:00100000:3.0:1789304494.442552:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785622400 00000100:00100000:3.0:1789304494.442638:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789304494.442649:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:80783:x1876219785622400:12345-0@lo:104: 00010000:00010000:3.0:1789304494.442671:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304494.442805:0:80783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80783:1876219785622400:0@lo:104: 00010000:00010000:2.0:1789304494.442825:0:80783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304494.442918:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304494.442924:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:80783:x1876219785622400:12345-0@lo:104: Request processed in 277us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304494.442931:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:0.0:1789304494.442982:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304494.442991:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.442998:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8e000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304494.443002:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443011:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304494.443019:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304494.443030:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304494.443070:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443076:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304494.443128:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443135:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8e000/0xefc0bb7231295f2e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231295f35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443151:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304494.443152:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304494.443154:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304494.443161:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304494.443172:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785622528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304494.443204:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304494.443234:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785622528 00000100:00100000:0.0:1789304494.443237:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785622528 00010000:00010000:0.0:1789304494.443256:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231295f35 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295f2e expref: 19 pid: 5845 timeout: 2094 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304494.443278:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789304494.443285:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785622528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304494.443295:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304494.443300:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231295f35 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231295f2e expref: 19 pid: 5845 timeout: 2094 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443314:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231295f35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231295f2e expref: 19 pid: 5845 timeout: 2094 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443328:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231295f35 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231295f2e expref: 19 pid: 5845 timeout: 2094 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443338:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443346:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443359:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443367:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443374:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443381:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443386:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304494.443390:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443397:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443413:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304494.443422:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304494.443449:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785622528:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304494.443455:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789304494.443481:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785622528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304494.443570:0:80783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304494.443578:0:80783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304494.443585:0:80783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312962ae lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789304495.297867:0:80831:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe59a1a8a0 20000000:00000080:1.0:1789304495.297890:0:80831:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c371f3800 uarg=0000000000000000 00010000:00010000:1.0:1789304495.298587:0:80831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304495.298815:0:80831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304495.298971:0:80831:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304495.298995:0:80831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304495.299012:0:80831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304495.299023:0:80831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304495.299030:0:80831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304495.299037:0:80831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304495.299049:0:80831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304495.299056:0:80831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304495.299060:0:80831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304495.299068:0:80831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304495.299082:0:80831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304495.299229:0:80831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304495.299237:0:80831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370400/0xefc0bb72312962b5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304495.444875:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304495.510234:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304495.510241:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304495.510246:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304495.510295:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304495.510307:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304495.510319:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304495.510342:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785622656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304495.510407:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304495.510507:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f709c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789304495.518367:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785622656 00000100:00100000:0.0:1789304495.518382:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785622656 00000100:00100000:0.0:1789304495.518566:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1789304495.518576:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785622656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304495.518595:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304495.518628:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312962c3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312962bc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304495.518674:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312962c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312962bc expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304495.518686:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312962c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312962bc expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304495.518696:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789304495.518784:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785622656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (8376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304495.518791:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1789304495.518838:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785622656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304495.518862:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304495.518874:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304495.518902:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304495.518908:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304495.518916:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789304496.173826:0:80879:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdca3c0ac0 20000000:00000080:0.0:1789304496.173847:0:80879:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412a8800 uarg=0000000000000000 00010000:00010000:0.0:1789304496.174382:0:80879:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304496.174404:0:80879:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304496.174425:0:80879:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304496.174445:0:80879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304496.174462:0:80879:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312962c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312962bc expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304496.174581:0:80879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304496.174634:0:80879:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312962c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312962bc expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304496.174653:0:80879:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312962c3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312962bc expref: 18 pid: 5845 timeout: 2095 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304496.174669:0:80879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80879:1876219785622784:0@lo:104: 00000100:00100000:0.0:1789304496.174739:0:80879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304496.174859:0:80879:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16840 going to sleep for 11 seconds 00000100:00100000:2.0:1789304496.174954:0:52683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789304496.174968:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785622784 00000100:00100000:2.0:1789304496.174976:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785622784 00000100:00100000:2.0:1789304496.175061:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789304496.175071:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02010450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:80879:x1876219785622784:12345-0@lo:104: 00010000:00010000:2.0:1789304496.175083:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304496.175184:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304496.175191:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02010450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:80879:x1876219785622784:12345-0@lo:104: Request processed in 121us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304496.175198:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789304496.175305:0:80879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80879:1876219785622784:0@lo:104: 00010000:00010000:0.0:1789304496.175325:0:80879:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304496.175450:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304496.175458:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304496.175465:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304496.175479:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304496.175495:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304496.175507:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304496.175512:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304496.175550:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304496.175556:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304496.175578:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304496.175585:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb72312962bc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312962c3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304496.175611:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304496.175613:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304496.175615:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304496.175627:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785622912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304496.175661:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304496.175902:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785622912 00000100:00100000:1.0:1789304496.175907:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785622912 00010000:00010000:1.0:1789304496.175933:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312962c3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312962bc expref: 19 pid: 5845 timeout: 2095 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304496.175995:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789304496.176004:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785622912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304496.176017:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304496.176022:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312962c3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312962bc expref: 19 pid: 5845 timeout: 2095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.176038:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312962c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312962bc expref: 19 pid: 5845 timeout: 2095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.176052:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbe00/0xefc0bb72312962c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312962bc expref: 19 pid: 5845 timeout: 2095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.176065:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.176074:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.176219:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.176229:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.176237:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.176244:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.176250:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304496.176254:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.176262:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304496.176807:0:80879:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304496.176817:0:80879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.181160:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.181183:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312962ca lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304496.181204:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304496.181293:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785622912:12345-0@lo:103:ldlm_bl.0 Request processed in 5286us (5627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304496.181304:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789304496.183713:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785622912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304496.466241:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304496.916424:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785623040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304496.916496:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304496.926894:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785623040 00000100:00100000:0.0:1789304496.926914:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785623040 00000100:00080000:2.0:1789304496.926983:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304496.927016:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1789304496.927029:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785623040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304496.927070:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304496.927197:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785623040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (10685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304496.927206:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1789304496.927225:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785623040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304496.999861:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304497.000015:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765543040 00000100:00100000:0.0:1789304497.000027:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765543040 00000100:00100000:0.0:1789304497.000173:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1127 00000100:00100000:0.0:1789304497.000184:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765543040:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304497.000269:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765543040:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304497.000276:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1127 00000100:00100000:0.0:1789304497.009582:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304497.009648:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304497.009683:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304497.009707:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765543424 00000100:00100000:2.0:1789304497.009718:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765543424 00000100:00100000:2.0:1789304497.009785:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765543296 00000100:00100000:2.0:1789304497.009788:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765543296 00000100:00100000:1.0:1789304497.009816:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765543168 00000100:00100000:1.0:1789304497.009821:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765543168 00000100:00100000:2.0:1789304497.009823:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1024 00000100:00100000:2.0:1789304497.009832:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765543424:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304497.009854:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1374 00000100:00100000:1.0:1789304497.009859:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765543168:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304497.009901:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765543424:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 70us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304497.009901:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765543168:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304497.009910:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1024 00000100:00100000:1.0:1789304497.009910:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1374 00000100:00100000:2.0:1789304497.009928:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1025 00000100:00100000:2.0:1789304497.009933:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765543296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304497.009954:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765543296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304497.009960:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1025 00000100:00080000:0.0:1789304497.010317:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304497.010321:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304497.010323:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304497.490323:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304497.684836:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304497.684846:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304497.684851:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304497.684902:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304497.684915:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304497.684926:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304497.684952:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785623168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304497.685027:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304497.685087:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789304497.685729:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785623168 00000100:00100000:0.0:1789304497.685738:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785623168 00000100:00100000:0.0:1789304497.685797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:0.0:1789304497.685808:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785623168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304497.685822:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304497.685840:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb800/0xefc0bb72312962d8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312962d1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304497.685865:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb800/0xefc0bb72312962d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312962d1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304497.685883:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb800/0xefc0bb72312962d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312962d1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304497.685891:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb800, rc 0) 00000100:00100000:0.0:1789304497.685941:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785623168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304497.685951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1789304497.686964:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785623168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304497.686989:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304497.687000:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304497.687023:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304497.687029:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304497.687037:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304497.938346:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785623296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304497.938418:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304497.938708:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785623296 00000100:00100000:2.0:1789304497.938717:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785623296 00000100:00100000:2.0:1789304497.938791:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1789304497.938800:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785623296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304497.938837:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304497.940253:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304497.946173:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785623296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7361us (7742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304497.946189:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1789304497.958827:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785623296:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789304498.016279:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967607 is committed 00000001:00080000:0.0:1789304498.016318:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967609 is committed 00010000:00010000:0.0:1789304498.514199:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304499.478717:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785623424:0@lo:400:kworker.0 00000100:00100000:3.0:1789304499.478808:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304499.478905:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785623424 00000100:00100000:0.0:1789304499.478914:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785623424 00000100:00100000:0.0:1789304499.478964:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:0.0:1789304499.478973:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785623424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304499.481742:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785623424:12345-0@lo:400:kworker.0 Request processed in 2755us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304499.481760:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1789304499.482322:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785623552:0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.482388:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304499.482418:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785624064:0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.482457:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304499.482479:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304499.482485:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785623936:0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.482506:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304499.482537:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785623552 00000100:00100000:1.0:1789304499.482545:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785623552 00000100:00100000:1.0:1789304499.482593:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785623936 00000100:00100000:1.0:1789304499.482597:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785623936 00000100:00100000:1.0:1789304499.482624:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1789304499.482633:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785623552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.482680:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785623552:12345-0@lo:400:kworker.0 Request processed in 48us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304499.482686:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1789304499.482702:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1789304499.482708:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785623936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.482734:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785623936:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304499.482740:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:1.0:1789304499.482758:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785624064 00000100:00100000:1.0:1789304499.482762:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785624064 00000100:00100000:1.0:1789304499.482791:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1789304499.482797:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785624064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.482826:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785624064:12345-0@lo:400:kworker.0 Request processed in 29us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304499.482832:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00080000:1.0:1789304499.482867:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304499.482871:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304499.482905:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785623936:0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.482915:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785623552:0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.482923:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785624064:0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.482969:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785623808:0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.482993:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304499.483011:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304499.483017:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785623680:0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.483036:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304499.483062:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785623808 00000100:00100000:1.0:1789304499.483067:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785623808 00000100:00100000:1.0:1789304499.483134:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1789304499.483141:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785623808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.483176:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785623808:12345-0@lo:400:kworker.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304499.483181:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1789304499.483199:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785623680 00000100:00100000:1.0:1789304499.483202:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785623680 00000100:00100000:1.0:1789304499.483226:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1789304499.483231:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785623680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.483261:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785623680:12345-0@lo:400:kworker.0 Request processed in 29us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304499.483267:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00080000:1.0:1789304499.483283:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304499.483285:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304499.483301:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785623680:0@lo:400:kworker.0 00000100:00100000:1.0:1789304499.483311:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785623808:0@lo:400:kworker.0 00000100:00100000:3.0:1789304499.484838:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785623424:0@lo:400:kworker.0 00010000:00010000:0.0:1789304499.538278:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304500.101280:0:81076:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1f126e40 20000000:00000080:1.0:1789304500.101299:0:81076:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c371f2800 uarg=0000000000000000 00010000:00010000:1.0:1789304500.101839:0:81076:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304500.101856:0:81076:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304500.101873:0:81076:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304500.101892:0:81076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.101909:0:81076:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb800/0xefc0bb72312962d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312962d1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.101918:0:81076:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.101955:0:81076:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb800/0xefc0bb72312962d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312962d1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.101970:0:81076:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afb800/0xefc0bb72312962d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312962d1 expref: 18 pid: 5846 timeout: 2099 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304500.101983:0:81076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81076:1876219785624192:0@lo:104: 00000100:00100000:1.0:1789304500.102049:0:81076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304500.102350:0:81076:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c14858540 going to sleep for 11 seconds 00000100:00100000:3.0:1789304500.102423:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785624192 00000100:00100000:3.0:1789304500.102438:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785624192 00000100:00100000:3.0:1789304500.102492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789304500.102502:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:81076:x1876219785624192:12345-0@lo:104: 00010000:00010000:3.0:1789304500.102515:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304500.102651:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304500.102658:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:81076:x1876219785624192:12345-0@lo:104: Request processed in 157us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304500.102665:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:3.0:1789304500.102697:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304500.102704:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304500.102711:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304500.102715:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304500.102723:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304500.102730:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304500.102735:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304500.102765:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304500.102775:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304500.102797:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304500.102805:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecde00/0xefc0bb72312962d1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312962d8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304500.102821:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304500.102823:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304500.102825:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304500.102838:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304500.102848:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785624320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304500.102878:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304500.103071:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785624320 00000100:00100000:1.0:1789304500.103076:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785624320 00010000:00010000:1.0:1789304500.103134:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb800/0xefc0bb72312962d8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312962d1 expref: 19 pid: 5846 timeout: 2099 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304500.103165:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789304500.103172:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785624320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304500.103183:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304500.103188:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb800/0xefc0bb72312962d8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312962d1 expref: 19 pid: 5846 timeout: 2099 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103202:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb800/0xefc0bb72312962d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312962d1 expref: 19 pid: 5846 timeout: 2099 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103217:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103226:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103239:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103247:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103254:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103260:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103266:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304500.103270:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103276:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103285:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304500.103298:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304500.103331:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785624320:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304500.103338:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789304500.103373:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785624320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304500.103995:0:81076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb800/0xefc0bb72312962d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312962d1 expref: 18 pid: 5846 timeout: 2099 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304500.104008:0:81076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81076:1876219785624192:0@lo:104: 00010000:00010000:2.0:1789304500.104022:0:81076:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304500.104034:0:81076:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304500.104041:0:81076:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304500.104047:0:81076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371000/0xefc0bb72312962df lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304500.562376:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304501.522303:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304501.522313:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304501.522320:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304501.522370:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304501.522383:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304501.522393:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304501.522420:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785624448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304501.522494:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304501.522645:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8000 going to sleep for 11 seconds 00000100:00100000:1.0:1789304501.523769:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785624448 00000100:00100000:1.0:1789304501.523781:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785624448 00000100:00100000:1.0:1789304501.523935:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1789304501.523946:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785624448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304501.523960:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304501.523980:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370800/0xefc0bb72312962ed lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312962e6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304501.524005:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370800/0xefc0bb72312962ed lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312962e6 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304501.524017:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370800/0xefc0bb72312962ed lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312962e6 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304501.524036:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370800, rc 0) 00000100:00100000:1.0:1789304501.524121:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785624448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304501.524137:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1789304501.524299:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785624448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304501.524320:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304501.524331:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304501.524365:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304501.524370:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304501.524378:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304501.586283:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304502.035029:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785624576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304502.035135:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304502.035400:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785624576 00000100:00100000:2.0:1789304502.035409:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785624576 00000100:00100000:2.0:1789304502.035474:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1789304502.035485:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785624576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304502.035519:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789304502.038215:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304502.039498:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785624576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4008us (4355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304502.039512:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:3.0:1789304502.039726:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785624576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304502.113571:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304502.113633:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304502.113668:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304502.113691:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304502.113717:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765543680 00000100:00100000:3.0:1789304502.113728:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765543680 00000100:00100000:3.0:1789304502.113786:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1378 00000100:00100000:3.0:1789304502.113796:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765543680:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304502.113869:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765543680:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304502.113876:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1378 00000100:00100000:3.0:1789304502.113897:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765543808 00000100:00100000:3.0:1789304502.113900:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765543808 00000100:00100000:1.0:1789304502.114042:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765543552 00000100:00100000:1.0:1789304502.114046:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765543552 00000100:00100000:1.0:1789304502.114073:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1131 00000100:00100000:1.0:1789304502.114079:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765543552:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304502.114125:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765543552:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 46us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304502.114131:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1131 00000100:00100000:3.0:1789304502.114261:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765543936 00000100:00100000:3.0:1789304502.114265:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765543936 00000100:00080000:0.0:1789304502.116183:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304502.116194:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304502.116198:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304502.116277:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1028 00000100:00100000:2.0:1789304502.116297:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765543808:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304502.116369:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765543808:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304502.116376:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1028 00000100:00100000:2.0:1789304502.116398:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1029 00000100:00100000:2.0:1789304502.116405:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765543936:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304502.116429:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765543936:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304502.116435:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1029 00010000:00010000:3.0:1789304502.611340:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304503.058603:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785624704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304503.058683:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304503.058835:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785624704 00000100:00100000:1.0:1789304503.058844:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785624704 00000100:00100000:1.0:1789304503.058914:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1789304503.058923:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785624704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304503.058961:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304503.059014:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785624704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304503.059022:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1789304503.059073:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785624704:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304503.059269:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304503.634253:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304504.594647:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785625216:0@lo:400:kworker.0 00000100:00100000:1.0:1789304504.594726:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304504.594804:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789304504.594810:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785624832:0@lo:400:kworker.0 00000100:00100000:1.0:1789304504.594854:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304504.594890:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785625344:0@lo:400:kworker.0 00000100:00100000:1.0:1789304504.594918:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304504.594952:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785624832 00000100:00100000:1.0:1789304504.594961:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785624832 00000100:00100000:1.0:1789304504.595009:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1789304504.595020:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785624832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304504.595071:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785624832:12345-0@lo:400:kworker.0 Request processed in 53us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304504.595082:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1789304504.595137:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785625216 00000100:00100000:1.0:1789304504.595142:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785625216 00000100:00100000:1.0:1789304504.595175:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785625344 00000100:00100000:1.0:1789304504.595178:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785625344 00000100:00100000:1.0:1789304504.595195:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1789304504.595201:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785625216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304504.595233:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785625216:12345-0@lo:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304504.595239:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1789304504.595252:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1789304504.595258:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785625344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304504.595285:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785625344:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304504.595290:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1789304504.595328:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785624832:0@lo:400:kworker.0 00000100:00100000:1.0:1789304504.595341:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785625344:0@lo:400:kworker.0 00000100:00100000:1.0:1789304504.595349:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785625216:0@lo:400:kworker.0 00000100:00100000:3.0:1789304504.595370:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785624960:0@lo:400:kworker.0 00000100:00080000:1.0:1789304504.595385:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304504.595395:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785625088:0@lo:400:kworker.0 00000100:00100000:3.0:1789304504.595399:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304504.595423:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785625472:0@lo:400:kworker.0 00000100:00100000:0.0:1789304504.595470:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785624960 00000100:00100000:0.0:1789304504.595475:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785624960 00000100:00100000:0.0:1789304504.595503:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:0.0:1789304504.595510:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785624960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304504.595562:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304504.595802:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785625088 00000100:00100000:2.0:1789304504.595808:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785625088 00000100:00100000:2.0:1789304504.595859:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1789304504.595867:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785625088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304504.595919:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785625088:12345-0@lo:400:kworker.0 Request processed in 52us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304504.595925:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1789304504.595953:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785625088:0@lo:400:kworker.0 00000100:00100000:3.0:1789304504.603742:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304504.603838:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785625472 00000100:00100000:2.0:1789304504.603848:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785625472 00000100:00100000:2.0:1789304504.603999:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1789304504.604012:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785625472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304504.604079:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785625472:12345-0@lo:400:kworker.0 Request processed in 72us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304504.604087:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00080000:1.0:1789304504.604238:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304504.604539:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785624960:12345-0@lo:400:kworker.0 Request processed in 9028us (9137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304504.604550:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1789304504.605017:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785624960:0@lo:400:kworker.0 00000100:00100000:3.0:1789304504.605031:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785625472:0@lo:400:kworker.0 00010000:00010000:0.0:1789304504.658333:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304505.684071:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304506.709716:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304507.157365:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304507.157392:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785625600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304507.157461:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304507.158170:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785625600 00000100:00100000:0.0:1789304507.158180:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785625600 00000100:00100000:0.0:1789304507.158334:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1789304507.158345:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785625600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304507.158382:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789304507.158602:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304507.159327:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785625600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 982us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304507.159337:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1789304507.161459:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785625600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304507.236695:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304507.236722:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304507.236738:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304507.236761:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304507.236783:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765544192 00000100:00100000:2.0:1789304507.236793:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765544192 00000100:00100000:2.0:1789304507.236846:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1382 00000100:00100000:2.0:1789304507.236854:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765544192:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304507.236916:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765544192:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 63us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304507.236921:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1382 00000100:00100000:2.0:1789304507.236939:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765544320 00000100:00100000:2.0:1789304507.236941:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765544320 00000100:00100000:2.0:1789304507.236957:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765544448 00000100:00100000:2.0:1789304507.236959:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765544448 00000100:00100000:2.0:1789304507.236973:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1032 00000100:00100000:2.0:1789304507.236976:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765544320:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304507.236993:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765544320:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 16us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304507.236997:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1032 00000100:00100000:2.0:1789304507.237004:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1033 00000100:00100000:2.0:1789304507.237008:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765544448:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304507.237021:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765544448:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 13us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304507.237025:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1033 00000100:00080000:2.0:1789304507.237037:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304507.237041:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304507.237042:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304507.237178:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765544064 00000100:00100000:3.0:1789304507.237182:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765544064 00000100:00100000:3.0:1789304507.237217:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1133 00000100:00100000:3.0:1789304507.237226:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765544064:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304507.237269:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765544064:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304507.237275:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1133 00010000:00010000:0.0:1789304507.730338:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304508.178461:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304508.178498:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785625728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304508.178598:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304508.178834:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785625728 00000100:00100000:1.0:1789304508.178844:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785625728 00000100:00100000:1.0:1789304508.178922:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1789304508.178932:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785625728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304508.178972:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304508.179026:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785625728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304508.179032:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1789304508.179086:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785625728:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304508.179816:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1789304508.575042:0:81420:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 20: test nodemap mapped_admin fileops ========================================================== 09:01:47 (1789304507) 00010000:00010000:3.0:1789304508.756421:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304509.714283:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785625856:0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.714363:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304509.714432:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785625856 00000100:00100000:1.0:1789304509.714439:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785625856 00000100:00100000:1.0:1789304509.714498:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1789304509.714507:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785625856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.714563:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785625856:12345-0@lo:400:kworker.0 Request processed in 57us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304509.714571:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1789304509.714622:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785625856:0@lo:400:kworker.0 00000100:00100000:2.0:1789304509.719832:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785625984:0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.719961:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785626112:0@lo:400:kworker.0 00000100:00100000:2.0:1789304509.720405:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304509.720463:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785626496:0@lo:400:kworker.0 00000100:00100000:2.0:1789304509.720499:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304509.720608:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785626496 00000100:00100000:2.0:1789304509.720750:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785626496 00000100:00100000:2.0:1789304509.720813:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:2.0:1789304509.720823:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785626496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304509.721391:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785626496:12345-0@lo:400:kworker.0 Request processed in 56us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304509.721400:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:2.0:1789304509.721463:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785626496:0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.723537:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304509.723616:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785626112 00000100:00100000:1.0:1789304509.723626:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785626112 00000100:00100000:1.0:1789304509.723669:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1789304509.723677:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785626112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.723743:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785626112:12345-0@lo:400:kworker.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304509.723753:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1789304509.723796:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785626112:0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.723821:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785626368:0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.723853:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304509.723874:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304509.723880:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785626240:0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.723901:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304509.723925:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785625984 00000100:00100000:1.0:1789304509.723929:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785625984 00000100:00100000:1.0:1789304509.723957:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785626368 00000100:00100000:1.0:1789304509.723960:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785626368 00000100:00100000:1.0:1789304509.723978:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785626240 00000100:00100000:1.0:1789304509.723980:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785626240 00000100:00100000:1.0:1789304509.723995:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1789304509.724000:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785625984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.724040:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785625984:12345-0@lo:400:kworker.0 Request processed in 39us (3636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304509.724046:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1789304509.724059:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1789304509.724065:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785626368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.724110:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785626368:12345-0@lo:400:kworker.0 Request processed in 46us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304509.724115:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1789304509.724127:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1789304509.724132:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785626240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.724161:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785626240:12345-0@lo:400:kworker.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304509.724166:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1789304509.724203:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785625984:0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.724224:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785626240:0@lo:400:kworker.0 00000100:00100000:1.0:1789304509.724232:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785626368:0@lo:400:kworker.0 00000100:00080000:3.0:1789304509.724663:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789304509.724669:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000400:0.0:1789304509.767817:0:81468:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:0.0:1789304509.780838:0:81468:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:3.0:1789304509.784197:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304510.621655:0:81517:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa22011d0 20000000:00000080:2.0:1789304510.621672:0:81517:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c03603000 uarg=0000000000000000 10000000:01000000:2.0:1789304510.622512:0:81517:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304510.622535:0:81517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304510.622556:0:81517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370800/0xefc0bb72312962ed lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312962e6 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304510.622568:0:81517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304510.622608:0:81517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370800/0xefc0bb72312962ed lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312962e6 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304510.622622:0:81517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41370800/0xefc0bb72312962ed lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312962e6 expref: 18 pid: 5845 timeout: 2110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304510.622889:0:81517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81517:1876219785626624:0@lo:104: 00000100:00100000:2.0:1789304510.622956:0:81517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304510.623172:0:81517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1789304510.623422:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785626624 00000100:00100000:3.0:1789304510.623431:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785626624 00000100:00100000:3.0:1789304510.623529:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789304510.623539:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:81517:x1876219785626624:12345-0@lo:104: 00010000:00010000:3.0:1789304510.623552:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304510.623626:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304510.623632:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:81517:x1876219785626624:12345-0@lo:104: Request processed in 96us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304510.623640:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789304510.623701:0:81517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81517:1876219785626624:0@lo:104: 00010000:00010000:2.0:1789304510.623721:0:81517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624165:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304510.624173:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624181:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304510.624185:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624192:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304510.624199:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304510.624204:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304510.624239:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624248:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304510.624268:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624273:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb72312962e6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312962ed expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624289:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304510.624290:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304510.624292:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304510.624302:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785626752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304510.624333:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304510.624371:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785626752 00000100:00100000:0.0:1789304510.624377:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785626752 00010000:00010000:0.0:1789304510.624397:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370800/0xefc0bb72312962ed lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312962e6 expref: 19 pid: 5845 timeout: 2110 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304510.624421:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789304510.624427:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785626752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304510.624437:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304510.624442:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370800/0xefc0bb72312962ed lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312962e6 expref: 19 pid: 5845 timeout: 2110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624452:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370800/0xefc0bb72312962ed lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312962e6 expref: 19 pid: 5845 timeout: 2110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624501:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370800/0xefc0bb72312962ed lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312962e6 expref: 19 pid: 5845 timeout: 2110 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624519:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624528:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624542:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624548:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624554:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624560:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624565:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304510.624569:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624576:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624588:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304510.624596:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304510.624625:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785626752:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304510.624632:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789304510.624662:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785626752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304510.625708:0:81517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304510.625721:0:81517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304510.625728:0:81517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312962f4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304510.802308:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304511.244187:0:81565:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffecb90f5a0 20000000:00000080:1.0:1789304511.244205:0:81565:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c05396400 uarg=0000000000000000 10000000:01000000:1.0:1789304511.244932:0:81565:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304511.244957:0:81565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.244976:0:81565:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.244987:0:81565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.244995:0:81565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.245002:0:81565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.245010:0:81565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.245017:0:81565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304511.245023:0:81565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.245031:0:81565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.245046:0:81565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.245055:0:81565:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.245062:0:81565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371400/0xefc0bb72312962fb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81565 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304511.766762:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304511.766769:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304511.766774:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304511.766823:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304511.766836:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304511.766848:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304511.766874:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785626880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304511.766946:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304511.767113:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110ea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304511.770165:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785626880 00000100:00100000:0.0:1789304511.770178:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785626880 00000100:00100000:0.0:1789304511.770229:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1789304511.770239:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785626880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304511.770254:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304511.770274:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231296309 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296302 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.770301:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231296309 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296302 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.770313:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231296309 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296302 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.770322:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789304511.770493:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785626880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (3546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304511.770507:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1789304511.773024:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785626880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304511.773052:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304511.773065:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304511.773625:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304511.773634:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304511.773642:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789304511.820961:0:81613:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe420d4e90 20000000:00000080:1.0:1789304511.820977:0:81613:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c05395c00 uarg=0000000000000000 10000000:01000000:1.0:1789304511.821274:0:81613:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304511.821295:0:81613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.821378:0:81613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231296309 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296302 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.821387:0:81613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.821425:0:81613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231296309 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296302 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.821438:0:81613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231296309 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296302 expref: 18 pid: 5845 timeout: 2111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304511.821618:0:81613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81613:1876219785627008:0@lo:104: 00000100:00100000:1.0:1789304511.821679:0:81613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304511.821771:0:81613:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c411e9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789304511.821810:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785627008 00000100:00100000:2.0:1789304511.821817:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785627008 00000100:00100000:2.0:1789304511.821890:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789304511.821900:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:81613:x1876219785627008:12345-0@lo:104: 00010000:00010000:2.0:1789304511.821913:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304511.821981:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304511.821987:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:81613:x1876219785627008:12345-0@lo:104: Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304511.821994:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789304511.822067:0:81613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81613:1876219785627008:0@lo:104: 00010000:00010000:3.0:1789304511.822083:0:81613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822159:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304511.822166:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822174:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304511.822179:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822192:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304511.822200:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304511.822205:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304511.822235:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822242:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304511.822264:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822271:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296302 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296309 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822287:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304511.822289:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304511.822290:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304511.822312:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785627136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304511.822343:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304511.822379:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785627136 00000100:00100000:0.0:1789304511.822382:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785627136 00010000:00010000:0.0:1789304511.822399:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231296309 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296302 expref: 19 pid: 5845 timeout: 2111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304511.822418:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789304511.822424:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785627136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304511.822434:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304511.822438:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231296309 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296302 expref: 19 pid: 5845 timeout: 2111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822459:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231296309 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296302 expref: 19 pid: 5845 timeout: 2111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822478:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbe00/0xefc0bb7231296309 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296302 expref: 19 pid: 5845 timeout: 2111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822489:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822510:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822524:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822532:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822539:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822545:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822550:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304511.822554:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822566:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822577:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304511.822585:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304511.822608:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785627136:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304511.822614:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789304511.822659:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785627136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304511.822825:0:81613:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304511.822833:0:81613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304511.822844:0:81613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296310 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304511.830084:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304512.274294:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304512.274317:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785627264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304512.274386:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304512.274462:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785627264 00000100:00100000:1.0:1789304512.274472:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785627264 00000100:00100000:1.0:1789304512.274623:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1789304512.274632:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785627264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304512.274661:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304512.274698:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785627264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304512.274704:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1789304512.274778:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785627264:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304512.274852:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1789304512.317785:0:81661:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3e8961d0 20000000:00000080:0.0:1789304512.317798:0:81661:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c2e909c00 uarg=0000000000000000 10000000:01000000:0.0:1789304512.317974:0:81661:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304512.317993:0:81661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.318005:0:81661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.318013:0:81661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.318017:0:81661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.318023:0:81661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.318028:0:81661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.318031:0:81661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304512.318035:0:81661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.318040:0:81661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.318048:0:81661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.318053:0:81661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.318057:0:81661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296317 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304512.373992:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304512.374029:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304512.374073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304512.374129:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304512.374160:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765544576 00000100:00100000:2.0:1789304512.374169:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765544576 00000100:00100000:2.0:1789304512.374220:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1136 00000100:00100000:2.0:1789304512.374229:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765544576:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304512.374758:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765544704 00000100:00100000:1.0:1789304512.374765:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765544704 00000100:00100000:1.0:1789304512.374818:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1386 00000100:00100000:1.0:1789304512.374841:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765544704:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304512.374909:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765544704:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304512.374917:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1386 00000100:00100000:0.0:1789304512.375123:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765544960 00000100:00100000:0.0:1789304512.375129:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765544960 00000100:00100000:0.0:1789304512.375159:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765544832 00000100:00100000:0.0:1789304512.375162:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765544832 00000100:00100000:0.0:1789304512.375189:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1036 00000100:00100000:0.0:1789304512.375199:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765544960:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304512.375206:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1037 00000100:00100000:1.0:1789304512.375218:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765544832:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304512.375239:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765544960:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304512.375248:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1036 00000100:00100000:1.0:1789304512.375257:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765544832:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304512.375265:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1037 00000100:00100000:2.0:1789304512.376002:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765544576:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1771us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304512.376012:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1136 00000100:00080000:2.0:1789304512.376054:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304512.376059:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304512.376062:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304512.850267:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304512.920008:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304512.920015:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304512.920020:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304512.920117:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.920130:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.920141:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304512.920169:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785627392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304512.920237:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304512.920300:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789304512.920375:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785627392 00000100:00100000:0.0:1789304512.920382:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785627392 00000100:00100000:0.0:1789304512.920430:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1789304512.920452:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785627392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304512.920467:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304512.920483:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296325 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129631e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.920507:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296325 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129631e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.920518:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296325 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129631e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.920531:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:0.0:1789304512.920569:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785627392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304512.920576:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1789304512.920648:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785627392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304512.920664:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.920674:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304512.920693:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304512.920698:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304512.920706:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789304513.073716:0:81710:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffffdd77cb0 20000000:00000080:1.0:1789304513.073734:0:81710:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f763c00 uarg=0000000000000000 10000000:01000000:1.0:1789304513.073935:0:81710:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304513.073956:0:81710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304513.073974:0:81710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296325 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129631e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304513.073984:0:81710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304513.074021:0:81710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296325 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129631e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304513.074034:0:81710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296325 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129631e expref: 18 pid: 5845 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304513.074049:0:81710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81710:1876219785627520:0@lo:104: 00000100:00100000:1.0:1789304513.074140:0:81710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304513.074184:0:81710:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c411e9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789304513.074476:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785627520 00000100:00100000:3.0:1789304513.074483:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785627520 00000100:00100000:3.0:1789304513.074530:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789304513.074538:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:81710:x1876219785627520:12345-0@lo:104: 00010000:00010000:3.0:1789304513.074550:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074611:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304513.074617:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:81710:x1876219785627520:12345-0@lo:104: Request processed in 80us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304513.074624:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00010000:3.0:1789304513.074645:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304513.074651:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074658:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304513.074662:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074670:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304513.074677:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304513.074687:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304513.074716:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074724:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304513.074743:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074750:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb723129631e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296325 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074763:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304513.074765:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304513.074767:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304513.074784:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785627648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304513.074813:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304513.074848:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785627648 00000100:00100000:3.0:1789304513.074852:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785627648 00010000:00010000:3.0:1789304513.074870:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296325 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129631e expref: 19 pid: 5845 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304513.074890:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789304513.074896:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785627648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304513.074906:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304513.074910:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296325 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129631e expref: 19 pid: 5845 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074920:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296325 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129631e expref: 19 pid: 5845 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074934:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074942:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074953:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074959:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074966:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074973:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074978:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370c00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304513.074983:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074990:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.074998:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.075006:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304513.075029:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785627648:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304513.075038:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789304513.075069:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785627648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304513.075201:0:81710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296325 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129631e expref: 18 pid: 5845 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304513.075362:0:81710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81710:1876219785627520:0@lo:104: 00010000:00010000:1.0:1789304513.075376:0:81710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304513.075385:0:81710:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304513.075396:0:81710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304513.075402:0:81710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129632c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304513.298416:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304513.298457:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785627776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304513.298526:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304513.298597:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785627776 00000100:00100000:1.0:1789304513.298605:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785627776 00000100:00100000:1.0:1789304513.298666:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1789304513.298675:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785627776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304513.298712:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304513.298757:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785627776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304513.298764:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00080000:1.0:1789304513.298786:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304513.298821:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785627776:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1789304513.819403:0:81759:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd5f759ec0 20000000:00000080:3.0:1789304513.819420:0:81759:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c38744000 uarg=0000000000000000 10000000:01000000:3.0:1789304513.819844:0:81759:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304513.819868:0:81759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.819884:0:81759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.819895:0:81759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.819902:0:81759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.819910:0:81759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.819918:0:81759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.819925:0:81759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304513.819930:0:81759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.819939:0:81759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.819957:0:81759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.819966:0:81759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304513.819973:0:81759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231296333 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304513.876195:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304514.836690:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785627904:0@lo:400:kworker.0 00000100:00100000:1.0:1789304514.836690:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785628160:0@lo:400:kworker.0 00000100:00100000:2.0:1789304514.836775:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304514.836826:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785628416:0@lo:400:kworker.0 00000100:00100000:2.0:1789304514.836853:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304514.836853:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304514.836896:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789304514.836903:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785628032:0@lo:400:kworker.0 00000100:00100000:3.0:1789304514.836923:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785628288:0@lo:400:kworker.0 00000100:00100000:0.0:1789304514.838467:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785628416 00000100:00100000:0.0:1789304514.838479:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785628416 00000100:00100000:0.0:1789304514.838524:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:0.0:1789304514.838531:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785628416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304514.839945:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785628160 00000100:00100000:1.0:1789304514.839953:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785628160 00000100:00100000:1.0:1789304514.839993:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1789304514.840002:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785628160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304514.840070:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785628160:12345-0@lo:400:kworker.0 Request processed in 70us (3216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304514.840077:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00080000:1.0:1789304514.840112:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304514.840150:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785628160:0@lo:400:kworker.0 00000100:00100000:1.0:1789304514.840192:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785627904 00000100:00100000:2.0:1789304514.840195:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304514.840196:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785627904 00000100:00100000:1.0:1789304514.840218:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1789304514.840221:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785628544:0@lo:400:kworker.0 00000100:00100000:1.0:1789304514.840224:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785627904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304514.840249:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304514.840254:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785627904:12345-0@lo:400:kworker.0 Request processed in 30us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304514.840260:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1789304514.840269:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785627904:0@lo:400:kworker.0 00000100:00100000:2.0:1789304514.840293:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785628032 00000100:00100000:2.0:1789304514.840297:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785628032 00000100:00100000:2.0:1789304514.840323:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1789304514.840330:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785628032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304514.840343:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785628416:12345-0@lo:400:kworker.0 Request processed in 1810us (3486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304514.840344:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304514.840353:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:2.0:1789304514.840369:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785628032:12345-0@lo:400:kworker.0 Request processed in 38us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304514.840371:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785628288 00000100:00100000:0.0:1789304514.840376:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785628288 00000100:00100000:2.0:1789304514.840385:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1789304514.840410:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:3.0:1789304514.840411:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785628544 00000100:00100000:2.0:1789304514.840417:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785628288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304514.840483:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785628288:12345-0@lo:400:kworker.0 Request processed in 59us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304514.840490:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00080000:0.0:1789304514.840495:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304514.840529:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785628032:0@lo:400:kworker.0 00000100:00100000:2.0:1789304514.840541:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02090380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785628416:0@lo:400:kworker.0 00000100:00100000:2.0:1789304514.840635:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785628288:0@lo:400:kworker.0 00000100:00100000:3.0:1789304514.840776:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785628544 00000100:00080000:0.0:1789304514.841598:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304514.841705:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:2.0:1789304514.841832:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785628544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304514.841899:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785628544:12345-0@lo:400:kworker.0 Request processed in 123us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304514.841956:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785628544:0@lo:400:kworker.0 00000100:00100000:2.0:1789304514.845189:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00010000:00010000:2.0:1789304514.898529:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304514.965026:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304514.965034:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304514.965039:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304514.965085:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304514.965111:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304514.965122:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304514.965148:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785628672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304514.965232:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304514.965294:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789304514.967270:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785628672 00000100:00100000:0.0:1789304514.967282:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785628672 00000100:00100000:0.0:1789304514.967342:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:0.0:1789304514.967351:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785628672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304514.967366:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304514.967383:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296341 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129633a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304514.967407:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296341 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129633a expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304514.967447:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296341 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129633a expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304514.967457:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afae00, rc 0) 00000100:00100000:0.0:1789304514.967520:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785628672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (2300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304514.967527:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1789304514.968931:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785628672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304514.968955:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304514.968968:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304514.968992:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304514.968998:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304514.969006:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304515.922298:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304515.978066:0:81906:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe1762eaa0 20000000:00000080:0.0:1789304515.978083:0:81906:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412ab000 uarg=0000000000000000 10000000:01000000:0.0:1789304515.978988:0:81906:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304515.979011:0:81906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304515.979029:0:81906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296341 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129633a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304515.979042:0:81906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304515.979079:0:81906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296341 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129633a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304515.979129:0:81906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296341 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129633a expref: 18 pid: 5847 timeout: 2115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304515.979144:0:81906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81906:1876219785628800:0@lo:104: 00000100:00100000:0.0:1789304515.979208:0:81906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304515.979264:0:81906:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c012549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304515.979345:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785628800 00000100:00100000:2.0:1789304515.979353:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785628800 00000100:00100000:2.0:1789304515.979403:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789304515.979426:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:81906:x1876219785628800:12345-0@lo:104: 00010000:00010000:2.0:1789304515.979439:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304515.979499:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304515.979504:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:81906:x1876219785628800:12345-0@lo:104: Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304515.979511:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00010000:1.0:1789304515.979592:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304515.979599:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979606:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304515.979610:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979617:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304515.979625:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304515.979631:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304515.979661:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979668:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304515.979689:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979695:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb723129633a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296341 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979712:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304515.979714:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304515.979715:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304515.979727:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785628928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304515.979756:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304515.979800:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785628928 00000100:00100000:1.0:1789304515.979804:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785628928 00010000:00010000:1.0:1789304515.979822:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296341 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129633a expref: 19 pid: 5847 timeout: 2115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304515.979843:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789304515.979849:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02092300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785628928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304515.979859:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304515.979864:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296341 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129633a expref: 19 pid: 5847 timeout: 2115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979874:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296341 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129633a expref: 19 pid: 5847 timeout: 2115 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979889:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979902:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979916:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979922:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979929:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979935:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979940:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304515.979944:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979950:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979958:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304515.979966:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304515.979993:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02092300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785628928:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304515.979999:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789304515.980035:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785628928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304515.980405:0:81906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296341 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129633a expref: 18 pid: 5847 timeout: 2115 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304515.980430:0:81906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81906:1876219785628800:0@lo:104: 00010000:00010000:0.0:1789304515.980444:0:81906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304515.980452:0:81906:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304515.980458:0:81906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304515.980463:0:81906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296348 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789304516.579529:0:81954:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe164498c0 20000000:00000080:1.0:1789304516.579547:0:81954:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c388d4000 uarg=0000000000000000 10000000:01000000:1.0:1789304516.580693:0:81954:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304516.580723:0:81954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.580740:0:81954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.580763:0:81954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.580770:0:81954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.580776:0:81954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.580783:0:81954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.580789:0:81954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304516.580793:0:81954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.580800:0:81954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.580812:0:81954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.580819:0:81954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.580825:0:81954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371800/0xefc0bb723129634f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304516.953001:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304517.014945:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304517.014955:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304517.014961:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304517.015006:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304517.015019:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304517.015030:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304517.015056:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785629056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304517.015669:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304517.015739:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c11b8b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789304517.016007:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785629056 00000100:00100000:2.0:1789304517.016016:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785629056 00000100:00100000:2.0:1789304517.016077:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1789304517.016087:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785629056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304517.016133:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304517.016157:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129635d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296356 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304517.016188:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129635d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296356 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304517.016199:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129635d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296356 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304517.016210:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd200, rc 0) 00000100:00100000:2.0:1789304517.016257:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785629056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304517.016263:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1789304517.016499:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785629056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304517.016518:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304517.016527:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304517.016546:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304517.016551:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304517.016558:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304517.396435:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785629184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304517.396524:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304517.396618:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785629184 00000100:00100000:0.0:1789304517.396626:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785629184 00000100:00100000:0.0:1789304517.396683:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1789304517.396693:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785629184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304517.396727:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304517.396771:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785629184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304517.396779:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00080000:0.0:1789304517.396801:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304517.396840:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785629184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304517.482044:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304517.482136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304517.482166:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304517.482196:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765545216 00000100:00100000:3.0:1789304517.482206:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765545216 00000100:00100000:3.0:1789304517.482273:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1390 00000100:00100000:3.0:1789304517.482284:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765545216:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304517.482353:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765545216:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304517.482360:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1390 00000100:00100000:0.0:1789304517.482441:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765545344 00000100:00100000:0.0:1789304517.482446:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765545344 00000100:00100000:0.0:1789304517.482485:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 443 00000100:00100000:0.0:1789304517.482492:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765545344:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:0.0:1789304517.482512:0:17212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231295ba0 00000100:00080000:0.0:1789304517.482521:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2c3f69c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789304517.482556:0:17212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967347 00000100:00100000:0.0:1789304517.482810:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765545344:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 318us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304517.482818:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 443 00000100:00080000:0.0:1789304517.482836:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304517.482841:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304517.482968:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765545088 00000100:00100000:2.0:1789304517.482973:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765545088 00000100:00100000:2.0:1789304517.483013:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1141 00000100:00100000:2.0:1789304517.483022:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765545088:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304517.483051:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765545088:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304517.483056:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1141 00010000:00010000:2.0:1789304517.483250:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304517.483918:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304517.484050:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765545472 00000100:00100000:0.0:1789304517.484057:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765545472 00000100:00100000:0.0:1789304517.484390:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 444 00000100:00100000:0.0:1789304517.484407:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765545472:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:0.0:1789304517.484430:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231295c4f 00000100:00080000:0.0:1789304517.484438:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2c384bc000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789304517.484472:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967347 00000100:00080000:2.0:1789304517.484555:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304517.484756:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765545472:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 358us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304517.484764:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 444 00010000:00010000:0.0:1789304517.484784:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304517.970350:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304518.430311:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785629312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304518.430381:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304518.434681:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785629312 00000100:00100000:1.0:1789304518.434694:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785629312 00000100:00100000:1.0:1789304518.434759:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1789304518.434770:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785629312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304518.434809:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304518.434895:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785629312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (4513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304518.434903:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00080000:1.0:1789304518.434990:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304518.435042:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785629312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304519.002576:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304519.955608:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785629440:0@lo:400:kworker.0 00000100:00100000:0.0:1789304519.955683:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304519.955743:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785629952:0@lo:400:kworker.0 00000100:00100000:0.0:1789304519.955771:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304519.955798:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304519.955804:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785629824:0@lo:400:kworker.0 00000100:00100000:0.0:1789304519.955825:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304519.956022:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785629440 00000100:00100000:3.0:1789304519.956030:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785629440 00000100:00100000:3.0:1789304519.956069:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1789304519.956077:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785629440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.958924:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785629696:0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.958984:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304519.959018:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789304519.959024:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785629568:0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.959045:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304519.959061:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785630080:0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.959077:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304519.959134:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785629952 00000100:00100000:1.0:1789304519.959140:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785629952 00000100:00100000:1.0:1789304519.959180:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785629824 00000100:00100000:1.0:1789304519.959182:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785629824 00000100:00100000:1.0:1789304519.959202:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785629568 00000100:00100000:1.0:1789304519.959205:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785629568 00000100:00100000:1.0:1789304519.959216:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:1.0:1789304519.959222:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785629952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.959266:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785629952:12345-0@lo:400:kworker.0 Request processed in 44us (3494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304519.959273:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:1.0:1789304519.959290:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1789304519.959295:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785629824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.959319:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785629824:12345-0@lo:400:kworker.0 Request processed in 24us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304519.959324:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1789304519.959333:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1789304519.959337:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785629568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.959359:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785629568:12345-0@lo:400:kworker.0 Request processed in 21us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304519.959365:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00080000:1.0:1789304519.959523:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304519.959552:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785629568:0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.959579:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785629696 00000100:00100000:1.0:1789304519.959582:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785629696 00000100:00100000:1.0:1789304519.959603:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785630080 00000100:00100000:1.0:1789304519.959605:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785630080 00000100:00100000:1.0:1789304519.959623:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1789304519.959629:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785629696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.959661:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785629696:12345-0@lo:400:kworker.0 Request processed in 33us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304519.959667:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1789304519.959678:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1789304519.959683:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785630080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.959710:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785630080:12345-0@lo:400:kworker.0 Request processed in 27us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304519.959716:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00080000:1.0:1789304519.959731:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304519.959745:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785630080:0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.959754:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785629696:0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.960344:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785629824:0@lo:400:kworker.0 00000100:00100000:1.0:1789304519.960355:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785629952:0@lo:400:kworker.0 00000100:00100000:3.0:1789304519.960529:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785629440:12345-0@lo:400:kworker.0 Request processed in 4451us (4845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304519.960538:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:1.0:1789304519.961182:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785629440:0@lo:400:kworker.0 00010000:00010000:0.0:1789304520.018238:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304520.296716:0:82151:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce519f530 20000000:00000080:2.0:1789304520.296739:0:82151:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c411efc00 uarg=0000000000000000 00010000:00010000:2.0:1789304520.297624:0:82151:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304520.297921:0:82151:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304520.297940:0:82151:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304520.297959:0:82151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304520.297978:0:82151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129635d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296356 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304520.297987:0:82151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304520.298035:0:82151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129635d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296356 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304520.298055:0:82151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129635d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296356 expref: 18 pid: 5846 timeout: 2119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304520.298071:0:82151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82151:1876219785630208:0@lo:104: 00000100:00100000:2.0:1789304520.298294:0:82151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304520.298409:0:82151:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c42163b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789304520.298485:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785630208 00000100:00100000:0.0:1789304520.298495:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785630208 00000100:00100000:0.0:1789304520.298589:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789304520.298600:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:82151:x1876219785630208:12345-0@lo:104: 00010000:00010000:0.0:1789304520.298616:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304520.298694:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304520.298701:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:82151:x1876219785630208:12345-0@lo:104: Request processed in 103us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304520.298708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00010000:1.0:1789304520.298738:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304520.298746:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304520.298755:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304520.298759:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304520.298768:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304520.298777:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304520.298784:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304520.298819:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304520.298823:0:82151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82151:1876219785630208:0@lo:104: 00010000:00010000:1.0:1789304520.298838:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304520.298844:0:82151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304520.298860:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304520.298869:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fe00/0xefc0bb7231296356 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129635d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304520.298887:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304520.298889:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304520.298890:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304520.298917:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785630336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304520.298949:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304520.299005:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785630336 00000100:00100000:3.0:1789304520.299010:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785630336 00010000:00010000:3.0:1789304520.299030:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129635d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296356 expref: 19 pid: 5846 timeout: 2119 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304520.299063:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789304520.299071:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785630336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304520.299081:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304520.299087:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129635d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296356 expref: 19 pid: 5846 timeout: 2119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299121:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129635d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296356 expref: 19 pid: 5846 timeout: 2119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299133:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129635d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296356 expref: 19 pid: 5846 timeout: 2119 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299147:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299156:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299168:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299175:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299182:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299190:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299264:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304520.299268:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299276:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299295:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304520.299304:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304520.299339:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785630336:12345-0@lo:103:ldlm_bl.0 Request processed in 269us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304520.299348:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789304520.299355:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785630336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304520.299408:0:82151:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304520.299417:0:82151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304520.299430:0:82151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb7231296364 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304521.042659:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789304521.551557:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789304521.551566:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2c3f69e000/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789304521.551596:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c3f69e000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:0.0:1789304521.551641:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c384bc000 for lustre-OST0001 00000001:00100000:3.0:1789304521.553347:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304521.553366:0:6723:0:(genops.c:885:class_export_put()) final put ffff9e2c3f698800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304521.553393:0:490:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c3f698800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0000 00000020:00000080:3.0:1789304521.553442:0:490:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c3f69c000 for lustre-OST0000 00010000:00010000:2.0:1789304522.075251:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304522.322347:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304522.322367:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304522.322371:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304522.322416:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304522.322425:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304522.322433:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304522.322452:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785630464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304522.322510:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304522.322563:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789304522.322610:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785630464 00000100:00100000:0.0:1789304522.322617:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785630464 00000100:00100000:0.0:1789304522.322665:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1789304522.322677:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785630464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304522.322693:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304522.322708:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296372 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129636b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304522.322730:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296372 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129636b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304522.322740:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296372 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129636b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304522.322749:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa800, rc 0) 00000100:00100000:0.0:1789304522.322793:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785630464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304522.322800:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1789304522.322814:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785630464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304522.322828:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304522.322838:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304522.322858:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304522.322863:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304522.322870:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304522.514313:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304522.514395:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785630592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304522.514476:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304522.514520:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785630592 00000100:00100000:0.0:1789304522.514529:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785630592 00000100:00080000:2.0:1789304522.514561:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304522.514583:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1789304522.514593:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785630592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304522.514788:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304522.514851:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785630592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 259us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304522.514859:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1789304522.514919:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785630592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304522.596761:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304522.596892:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304522.596953:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765545728 00000100:00100000:1.0:1789304522.596964:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765545728 00000100:00100000:1.0:1789304522.597080:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1394 00000100:00100000:1.0:1789304522.597145:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765545728:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304522.597237:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765545728:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 148us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304522.597244:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1394 00000100:00100000:3.0:1789304522.597768:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765545600 00000100:00100000:3.0:1789304522.597774:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765545600 00000100:00100000:3.0:1789304522.597815:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1144 00000100:00100000:3.0:1789304522.597823:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765545600:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304522.597883:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765545600:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 62us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304522.597890:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1144 00000100:00080000:0.0:1789304522.603238:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304523.092254:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304523.542203:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304523.542231:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785630720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304523.542349:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304523.548242:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785630720 00000100:00100000:2.0:1789304523.548256:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785630720 00000100:00100000:2.0:1789304523.548541:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1789304523.548550:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785630720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304523.548587:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304523.548733:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785630720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (6397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304523.548738:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00080000:0.0:1789304523.549026:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304523.549118:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785630720:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1789304523.615078:0:82350:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe80af8db0 20000000:00000080:2.0:1789304523.615322:0:82350:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c411ec400 uarg=0000000000000000 00010000:00010000:2.0:1789304523.615944:0:82350:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304523.615959:0:82350:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304523.615973:0:82350:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304523.615996:0:82350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304523.616014:0:82350:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296372 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129636b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304523.616022:0:82350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304523.616063:0:82350:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296372 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129636b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304523.616078:0:82350:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296372 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129636b expref: 18 pid: 5846 timeout: 2123 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304523.616301:0:82350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e0bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82350:1876219785630848:0@lo:104: 00000100:00100000:2.0:1789304523.616374:0:82350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304523.616484:0:82350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789304523.621562:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789304523.621600:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785630848 00000100:00100000:2.0:1789304523.621613:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785630848 00000100:00100000:2.0:1789304523.621691:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789304523.621703:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36f25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:82350:x1876219785630848:12345-0@lo:104: 00010000:00010000:2.0:1789304523.621723:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304523.621841:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304523.621848:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36f25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:82350:x1876219785630848:12345-0@lo:104: Request processed in 150us (5474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304523.621855:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789304523.621993:0:82350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e0bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82350:1876219785630848:0@lo:104: 00010000:00010000:1.0:1789304523.622020:0:82350:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622281:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304523.622289:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622296:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304523.622300:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622308:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304523.622315:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304523.622320:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304523.622371:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622378:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304523.622403:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622410:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb723129636b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296372 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622428:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304523.622430:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304523.622432:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304523.622439:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304523.622454:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785630976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304523.622496:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304523.622544:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785630976 00000100:00100000:3.0:1789304523.622549:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785630976 00010000:00010000:3.0:1789304523.622572:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296372 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129636b expref: 19 pid: 5846 timeout: 2123 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304523.622595:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789304523.622602:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785630976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304523.622614:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304523.622619:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296372 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129636b expref: 19 pid: 5846 timeout: 2123 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622630:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296372 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129636b expref: 19 pid: 5846 timeout: 2123 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622644:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296372 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129636b expref: 19 pid: 5846 timeout: 2123 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622657:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622666:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622682:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622689:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622696:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622708:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622712:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304523.622716:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622724:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622746:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304523.622755:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304523.622788:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785630976:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304523.622795:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1789304523.622839:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785630976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304523.622910:0:82350:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304523.622919:0:82350:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304523.622929:0:82350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296379 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304524.114343:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304524.549354:0:82398:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeafdafd50 20000000:00000080:0.0:1789304524.549372:0:82398:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c37032800 uarg=0000000000000000 10000000:01000000:0.0:1789304524.549421:0:82398:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304524.549443:0:82398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304524.549461:0:82398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304524.549474:0:82398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304524.549482:0:82398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304524.549488:0:82398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304524.549496:0:82398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304524.549507:0:82398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304524.549511:0:82398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304524.549520:0:82398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304524.549533:0:82398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304524.549541:0:82398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304524.549547:0:82398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296380 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304525.074697:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304525.074839:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785631232:0@lo:400:kworker.0 00000100:00100000:3.0:1789304525.074912:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304525.074972:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304525.074978:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785631360:0@lo:400:kworker.0 00000100:00100000:3.0:1789304525.075063:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304525.075113:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785631232 00000100:00100000:3.0:1789304525.075121:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785631232 00000100:00100000:3.0:1789304525.075177:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:3.0:1789304525.075186:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785631232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304525.075240:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785631232:12345-0@lo:400:kworker.0 Request processed in 55us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304525.075247:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:3.0:1789304525.075270:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785631360 00000100:00100000:3.0:1789304525.075274:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785631360 00000100:00100000:3.0:1789304525.075312:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1789304525.075318:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785631360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304525.075363:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785631360:12345-0@lo:400:kworker.0 Request processed in 45us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304525.075368:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00080000:3.0:1789304525.075403:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304525.075439:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785631360:0@lo:400:kworker.0 00000100:00100000:3.0:1789304525.075450:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785631232:0@lo:400:kworker.0 00000100:00100000:1.0:1789304525.076523:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785631488:0@lo:400:kworker.0 00000100:00100000:1.0:1789304525.076568:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304525.076604:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785631104:0@lo:400:kworker.0 00000100:00100000:1.0:1789304525.076633:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304525.077111:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785631488 00000100:00100000:3.0:1789304525.077119:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785631488 00000100:00100000:3.0:1789304525.077173:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:3.0:1789304525.077181:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785631488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304525.077237:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785631488:12345-0@lo:400:kworker.0 Request processed in 58us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304525.077243:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:3.0:1789304525.077262:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785631104 00000100:00100000:3.0:1789304525.077265:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785631104 00000100:00100000:3.0:1789304525.077288:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1789304525.077294:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785631104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304525.077334:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785631104:12345-0@lo:400:kworker.0 Request processed in 30us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304525.077341:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1789304525.077502:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785631488:0@lo:400:kworker.0 00000100:00100000:3.0:1789304525.077511:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785631104:0@lo:400:kworker.0 00000100:00080000:1.0:1789304525.077589:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304525.082778:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785631616:0@lo:400:kworker.0 00000100:00100000:0.0:1789304525.082851:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304525.082909:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785631616 00000100:00100000:0.0:1789304525.082917:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785631616 00000100:00100000:0.0:1789304525.082973:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1789304525.082982:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785631616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304525.083045:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785631616:12345-0@lo:400:kworker.0 Request processed in 64us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304525.083053:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00080000:0.0:1789304525.083073:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304525.083120:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785631616:0@lo:400:kworker.0 00000100:00100000:0.0:1789304525.083147:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785631744:0@lo:400:kworker.0 00000100:00100000:0.0:1789304525.083174:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304525.083204:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785631744 00000100:00100000:0.0:1789304525.083208:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785631744 00000100:00100000:0.0:1789304525.083236:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1789304525.083242:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785631744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304525.083277:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785631744:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304525.083284:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:0.0:1789304525.083297:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304525.083312:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785631744:0@lo:400:kworker.0 00010000:00010000:1.0:1789304525.145234:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304525.266298:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304525.266307:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304525.266314:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304525.266440:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304525.266453:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304525.266463:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304525.266484:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02093b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785631872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304525.266544:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304525.266653:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c18b97780 going to sleep for 11 seconds 00000100:00100000:0.0:1789304525.267755:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785631872 00000100:00100000:0.0:1789304525.267766:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785631872 00000100:00100000:0.0:1789304525.267874:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1789304525.267886:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785631872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304525.267901:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304525.267928:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa000/0xefc0bb723129638e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296387 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304525.267952:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa000/0xefc0bb723129638e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296387 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304525.267963:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa000/0xefc0bb723129638e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296387 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304525.267971:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304525.268036:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785631872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304525.268045:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1789304525.268218:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02093b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785631872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304525.268236:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304525.268246:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304525.268265:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304525.268270:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304525.268277:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304526.162263:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304527.186662:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304527.652885:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304527.652918:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785632000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304527.652984:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304527.653125:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785632000 00000100:00100000:0.0:1789304527.653134:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785632000 00000100:00100000:0.0:1789304527.653200:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1789304527.653210:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785632000:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304527.653218:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1789304527.653255:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304527.653321:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785632000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304527.653327:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1789304527.653359:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785632000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304527.713898:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304527.713991:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304527.714023:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765545984 00000100:00100000:3.0:1789304527.714034:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765545984 00000100:00080000:1.0:1789304527.714085:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304527.714137:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1398 00000100:00100000:3.0:1789304527.714149:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765545984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304527.714246:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765545984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 100us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304527.714255:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1398 00000100:00100000:3.0:1789304527.714286:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765545856 00000100:00100000:3.0:1789304527.714290:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765545856 00000100:00100000:3.0:1789304527.714330:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1147 00000100:00100000:3.0:1789304527.714340:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765545856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304527.714830:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765545856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 491us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304527.714838:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1147 00010000:00010000:1.0:1789304528.217810:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304528.658194:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304528.658217:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785632128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304528.658301:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304528.658372:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785632128 00000100:00100000:0.0:1789304528.658380:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785632128 00000100:00100000:0.0:1789304528.658431:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1789304528.658439:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785632128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304528.658475:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304528.658519:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785632128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304528.658526:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00080000:0.0:1789304528.658545:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304528.658596:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785632128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304529.236373:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304529.841842:0:82694:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd26f51b50 20000000:00000080:0.0:1789304529.841862:0:82694:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f5fa800 uarg=0000000000000000 10000000:01000000:0.0:1789304529.841910:0:82694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304529.841929:0:82694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304529.841948:0:82694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa000/0xefc0bb723129638e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296387 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304529.841957:0:82694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304529.841995:0:82694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa000/0xefc0bb723129638e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296387 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304529.842010:0:82694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa000/0xefc0bb723129638e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296387 expref: 18 pid: 5846 timeout: 2129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304529.842026:0:82694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82694:1876219785632256:0@lo:104: 00000100:00100000:0.0:1789304529.842122:0:82694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304529.842171:0:82694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789304529.842853:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785632256 00000100:00100000:2.0:1789304529.842864:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785632256 00000100:00100000:2.0:1789304529.844173:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789304529.844201:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:82694:x1876219785632256:12345-0@lo:104: 00010000:00010000:2.0:1789304529.844218:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844310:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304529.844320:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:82694:x1876219785632256:12345-0@lo:104: Request processed in 127us (2199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304529.844327:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789304529.844385:0:82694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82694:1876219785632256:0@lo:104: 00010000:00010000:0.0:1789304529.844414:0:82694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844442:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304529.844448:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844456:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304529.844464:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844474:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304529.844481:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304529.844487:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304529.844567:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844574:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304529.844606:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844613:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41371000/0xefc0bb7231296387 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129638e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844629:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304529.844631:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304529.844633:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304529.844640:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304529.844653:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785632384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304529.844691:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304529.844734:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785632384 00000100:00100000:2.0:1789304529.844740:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785632384 00010000:00010000:2.0:1789304529.844762:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa000/0xefc0bb723129638e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296387 expref: 19 pid: 5846 timeout: 2129 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304529.844786:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789304529.844793:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785632384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304529.844803:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304529.844809:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa000/0xefc0bb723129638e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296387 expref: 19 pid: 5846 timeout: 2129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844820:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa000/0xefc0bb723129638e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296387 expref: 19 pid: 5846 timeout: 2129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844832:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa000/0xefc0bb723129638e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296387 expref: 19 pid: 5846 timeout: 2129 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844845:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844854:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844870:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844877:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844883:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844894:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844898:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304529.844902:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844909:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844919:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304529.844928:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304529.844954:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785632384:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304529.844960:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789304529.844986:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785632384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304529.845189:0:82694:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304529.845197:0:82694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304529.845204:0:82694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231296395 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304530.194500:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304530.195030:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785632640:0@lo:400:kworker.0 00000100:00100000:3.0:1789304530.195130:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304530.195216:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785632512:0@lo:400:kworker.0 00000100:00100000:3.0:1789304530.195236:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304530.195368:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785632512 00000100:00100000:2.0:1789304530.195378:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785632512 00000100:00100000:2.0:1789304530.195448:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1789304530.195458:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785632512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304530.195525:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785632512:12345-0@lo:400:kworker.0 Request processed in 69us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304530.195533:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1789304530.195625:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785632512:0@lo:400:kworker.0 00000100:00100000:2.0:1789304530.195931:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785632768:0@lo:400:kworker.0 00000100:00100000:2.0:1789304530.195961:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304530.196032:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304530.196039:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785632896:0@lo:400:kworker.0 00000100:00100000:3.0:1789304530.196047:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785632768 00000100:00100000:3.0:1789304530.196052:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785632768 00000100:00100000:2.0:1789304530.196075:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304530.196109:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785632896 00000100:00100000:3.0:1789304530.196113:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785632896 00000100:00100000:3.0:1789304530.196138:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1789304530.196147:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785632768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304530.196154:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:2.0:1789304530.196160:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785632896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304530.196191:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785632768:12345-0@lo:400:kworker.0 Request processed in 46us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304530.196198:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1789304530.196243:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785633024:0@lo:400:kworker.0 00000100:00100000:1.0:1789304530.196273:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304530.196811:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785632896:12345-0@lo:400:kworker.0 Request processed in 650us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304530.196819:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00080000:1.0:1789304530.197699:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304530.197791:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785632640 00000100:00100000:2.0:1789304530.197801:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785632640 00000100:00100000:2.0:1789304530.197890:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785633024 00000100:00100000:2.0:1789304530.197895:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785633024 00000100:00080000:1.0:1789304530.197919:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304530.197922:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304530.197946:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1789304530.197956:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785632640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304530.198020:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785632640:12345-0@lo:400:kworker.0 Request processed in 67us (2889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304530.198027:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1789304530.198293:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1789304530.198302:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785633024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304530.198353:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785633024:12345-0@lo:400:kworker.0 Request processed in 53us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304530.198360:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1789304530.198425:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785633024:0@lo:400:kworker.0 00000100:00100000:3.0:1789304530.198615:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785632896:0@lo:400:kworker.0 00000100:00100000:3.0:1789304530.198630:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785632768:0@lo:400:kworker.0 00000100:00100000:3.0:1789304530.198667:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785632640:0@lo:400:kworker.0 00010000:00010000:1.0:1789304530.269385:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304530.630949:0:82742:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd6daa760 20000000:00000080:0.0:1789304530.630968:0:82742:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b0208d400 uarg=0000000000000000 00010000:00010000:0.0:1789304530.631560:0:82742:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304530.631575:0:82742:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304530.631589:0:82742:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304530.631608:0:82742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304530.631624:0:82742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304530.631634:0:82742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304530.631641:0:82742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304530.631647:0:82742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304530.631653:0:82742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304530.631658:0:82742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304530.631662:0:82742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304530.631670:0:82742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304530.631752:0:82742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304530.631762:0:82742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304530.631768:0:82742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa400/0xefc0bb723129639c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304531.095275:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304531.095282:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304531.095286:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304531.095329:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304531.095341:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304531.095353:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304531.095383:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02090000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785633152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304531.095447:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304531.095485:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f7096c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304531.095545:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785633152 00000100:00100000:0.0:1789304531.095553:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785633152 00000100:00100000:0.0:1789304531.095603:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1789304531.095612:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785633152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304531.095625:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304531.095639:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312963aa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312963a3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304531.095662:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312963aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312963a3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304531.095674:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312963aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312963a3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304531.095683:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afae00, rc 0) 00000100:00100000:0.0:1789304531.095725:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785633152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304531.095731:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1789304531.096299:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02090000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785633152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304531.096316:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304531.096326:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304531.096345:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304531.096350:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304531.096358:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304531.288020:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304532.306576:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304532.755750:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785633280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304532.755821:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304532.756295:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785633280 00000100:00100000:3.0:1789304532.756629:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785633280 00000100:00100000:3.0:1789304532.756708:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1789304532.756720:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785633280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304532.756758:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304532.757321:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304532.757422:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785633280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 704us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304532.757431:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1789304532.762869:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785633280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304532.841923:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304532.841972:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304532.842006:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765546112 00000100:00100000:2.0:1789304532.842006:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765546240 00000100:00100000:2.0:1789304532.842018:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765546240 00000100:00100000:3.0:1789304532.842019:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765546112 00000100:00100000:2.0:1789304532.842082:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1402 00000100:00100000:3.0:1789304532.842085:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1149 00000100:00100000:2.0:1789304532.842111:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765546240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304532.842117:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765546112:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304532.842180:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765546112:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304532.842188:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1149 00000100:00080000:0.0:1789304532.842383:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304532.844165:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765546240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 2062us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304532.844182:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1402 00010000:00010000:1.0:1789304533.330330:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304533.719487:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304533.719592:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765546368 00000100:00100000:3.0:1789304533.719604:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765546368 00000100:00100000:3.0:1789304533.719669:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 816 00000100:00100000:3.0:1789304533.719680:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:48566:x1876219765546368:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304533.719720:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304533.719750:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312963b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100444 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.719813:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312963b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.719824:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312963b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.719834:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312963b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304533.719866:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789304533.719869:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304533.719887:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312963b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.719906:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312963b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100444 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.719919:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312963b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100444 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.719925:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:2.0:1789304533.719927:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304533.719930:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40eccc00, rc 0) 00000100:00100000:2.0:1789304533.720005:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:48566:x1876219765546368:12345-192.168.202.29@tcp:101:rm.0 Request processed in 326us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304533.720019:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 816 00000100:00100000:2.0:1789304533.724432:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304533.726322:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765546496 00000100:00100000:1.0:1789304533.726339:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765546496 00000100:00100000:1.0:1789304533.726414:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 817 00000100:00100000:1.0:1789304533.726425:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:48566:x1876219765546496:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304533.726447:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304533.726468:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb72312963bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610044b expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726532:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb72312963c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726546:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb72312963c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726555:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb72312963c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726566:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312963cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726570:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312963cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726574:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312963cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726775:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb72312963c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726784:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb72312963c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726790:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb72312963c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726796:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304533.726800:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb72312963c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726807:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb72312963c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726818:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:1.0:1789304533.726821:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304533.726827:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb72312963c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726833:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb72312963c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726846:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312963cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726852:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312963cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726858:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312963cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726861:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304533.726864:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312963cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726868:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312963cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726872:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c14add400) 00010000:00010000:1.0:1789304533.726874:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304533.726876:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312963cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726879:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312963cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726906:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb72312963bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610044b expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726914:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:1.0:1789304533.726915:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304533.726917:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb72312963bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610044b expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304533.726923:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371400, rc 0) 00000100:00100000:1.0:1789304533.727003:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:48566:x1876219765546496:12345-192.168.202.29@tcp:101:rm.0 Request processed in 579us (2582us total) trans 0 rc 301/301 00000100:00100000:1.0:1789304533.727008:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 817 00000100:00100000:0.0:1789304533.772141:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304533.772229:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765546624 00000100:00100000:2.0:1789304533.772253:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765546624 00000100:00100000:1.0:1789304533.772448:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304533.772494:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765546880 00000100:00100000:3.0:1789304533.772500:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765546880 00000100:00100000:0.0:1789304533.773445:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 818 00000100:00100000:0.0:1789304533.773467:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765546624:12345-192.168.202.29@tcp:41:mkdir.0 00000100:00100000:3.0:1789304533.773519:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 819 00000004:00000024:0.0:1789304533.773522:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789304533.773529:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:48570:x1876219765546880:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:3.0:1789304533.773569:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304533.773599:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312963b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100444 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304533.773619:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765546624:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 158us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304533.773628:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 818 00010000:00010000:3.0:1789304533.773637:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:3.0:1789304533.773649:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304533.773896:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312963d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.773910:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312963d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.773922:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312963d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.773936:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.773943:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.773949:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304533.775255:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00010000:3.0:1789304533.775271:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312963d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.775281:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312963d4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.775289:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312963d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.775295:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304533.775300:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312963d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.775310:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312963d4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.776484:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789304533.776493:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304533.776500:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312963d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.776513:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312963d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304533.776541:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9ccd08d reply state 00000000244eb988 transno 4294967610 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304533.776553:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304533.776833:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:48570:x1876219765546880:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 3300us (4380us total) trans 4294967610 rc 0/0 00000100:00100000:3.0:1789304533.776843:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 819 00000100:00100000:1.0:1789304533.781532:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304533.781563:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785633408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304533.781666:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304533.781778:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785633408 00000100:00100000:1.0:1789304533.781790:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785633408 00000100:00100000:1.0:1789304533.781870:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1789304533.781879:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785633408:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304533.781894:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.781908:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.781917:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.781922:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304533.781929:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:1.0:1789304533.781930:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00010000:00010000:3.0:1789304533.781939:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.781959:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304533.781963:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304533.781969:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304533.781981:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312963db lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789304533.788513:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304533.789109:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785633408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7209us (7421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304533.789123:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1789304533.789189:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785633408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304533.855062:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304533.855253:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765547008 00000100:00100000:0.0:1789304533.855424:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765547008 00000100:00100000:0.0:1789304533.855531:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 820 00000100:00100000:0.0:1789304533.855544:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:48573:x1876219765547008:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:0.0:1789304533.855576:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304533.855601:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312963e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100452 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.855691:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312963e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.855707:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312963e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.855723:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312963e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304533.855772:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789304533.855778:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304533.855805:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312963e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.855833:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312963e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100452 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.855857:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312963e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100452 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.855866:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304533.855869:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304533.855873:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789304533.855957:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:48573:x1876219765547008:12345-192.168.202.29@tcp:101:chown.0 Request processed in 415us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304533.855964:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 820 00000100:00100000:2.0:1789304533.864980:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304533.865054:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765547136 00000100:00100000:0.0:1789304533.865066:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765547136 00000100:00100000:0.0:1789304533.865165:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 821 00000100:00100000:0.0:1789304533.865176:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:48573:x1876219765547136:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:0.0:1789304533.865199:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304533.865221:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb72312963f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100459 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865476:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312963f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865494:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312963f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865513:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312963f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865529:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312963fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865536:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312963fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865543:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312963fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865899:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865907:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865914:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304533.865949:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:0.0:1789304533.865952:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304533.865972:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865985:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312963f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.865992:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312963f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866002:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312963f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866007:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304533.866012:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312963f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866020:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312963f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866033:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304533.866035:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304533.866041:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312963f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866048:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312963f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866060:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312963fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866066:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312963fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866072:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312963fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866077:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304533.866080:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312963fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866545:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312963fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866557:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c0558dc00) 00010000:00010000:0.0:1789304533.866560:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304533.866563:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312963fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866569:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312963fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866609:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb72312963f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100459 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866635:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100459 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304533.866643:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:0.0:1789304533.866646:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304533.866648:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304533.866740:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:48573:x1876219765547136:12345-192.168.202.29@tcp:101:chown.0 Request processed in 1565us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304533.866750:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 821 00000100:00100000:3.0:1789304533.870629:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304533.870768:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765547392 00000100:00100000:2.0:1789304533.870779:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765547392 00000100:00100000:2.0:1789304533.870843:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 822 00000100:00100000:2.0:1789304533.870853:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:48573:x1876219765547392:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:2.0:1789304533.870908:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304533.870936:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231296405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100459 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.870956:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:2.0:1789304533.870968:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304533.870996:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.871009:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.871020:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304533.871454:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a3fefdb reply state 000000002a3c491d transno 4294967611 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304533.871465:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789304533.871477:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000100:00100000:2.0:1789304533.871562:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:48573:x1876219765547392:12345-192.168.202.29@tcp:36:chown.0 Request processed in 709us (953us total) trans 4294967611 rc 0/0 00000100:00100000:2.0:1789304533.871570:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 822 00010000:00010000:2.0:1789304533.889365:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.889384:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.889392:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.889398:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304533.889402:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.889410:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.889427:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304533.889430:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789304533.889435:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304533.889442:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb723129640c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789304533.897151:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967610 is committed 00010000:00010000:0.0:1789304534.354301:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304534.718757:0:82941:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb2cd17e0 20000000:00000080:1.0:1789304534.718778:0:82941:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c062a5c00 uarg=0000000000000000 10000000:01000000:1.0:1789304534.718831:0:82941:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304534.718853:0:82941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304534.718872:0:82941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312963aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312963a3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304534.718881:0:82941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304534.718998:0:82941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312963aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312963a3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304534.719013:0:82941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312963aa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312963a3 expref: 18 pid: 5846 timeout: 2134 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304534.719029:0:82941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02092a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82941:1876219785633536:0@lo:104: 00000100:00100000:1.0:1789304534.719702:0:82941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304534.719810:0:82941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c01377540 going to sleep for 11 seconds 00000100:00100000:0.0:1789304534.720380:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785633536 00000100:00100000:0.0:1789304534.720390:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785633536 00000100:00100000:0.0:1789304534.720470:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789304534.720481:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02091880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:82941:x1876219785633536:12345-0@lo:104: 00010000:00010000:0.0:1789304534.720496:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304534.721865:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304534.721877:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02091880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:82941:x1876219785633536:12345-0@lo:104: Request processed in 1397us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304534.721887:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00010000:00010000:2.0:1789304534.722216:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304534.722226:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304534.722593:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304534.722600:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304534.722680:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304534.722690:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304534.722696:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304534.722824:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304534.722831:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789304534.723473:0:82941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02092a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82941:1876219785633536:0@lo:104: 00000100:00100000:0.0:1789304534.723741:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785633664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304534.723804:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789304534.723894:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304534.723902:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb72312963a3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312963aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304534.724048:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785633664 00000100:00100000:3.0:1789304534.724056:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785633664 00010000:00010000:3.0:1789304534.724110:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312963aa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312963a3 expref: 19 pid: 5846 timeout: 2134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304534.724214:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304534.724217:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304534.724219:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304534.724348:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789304534.724358:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785633664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304534.724373:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304534.724379:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312963aa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312963a3 expref: 19 pid: 5846 timeout: 2134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724390:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312963aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312963a3 expref: 19 pid: 5846 timeout: 2134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724406:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312963aa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312963a3 expref: 19 pid: 5846 timeout: 2134 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724419:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724427:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724442:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724455:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724462:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724469:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724474:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304534.724479:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724488:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.724496:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304534.724738:0:82941:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304534.724767:0:82941:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304534.724773:0:82941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304534.724787:0:82941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296413 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304534.726177:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304534.726318:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785633664:12345-0@lo:103:ldlm_bl.0 Request processed in 1958us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304534.726346:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789304534.727782:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785633664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304535.314472:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304535.314534:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785633920:0@lo:400:kworker.0 00000100:00100000:3.0:1789304535.314608:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304535.314676:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785633792:0@lo:400:kworker.0 00000100:00100000:3.0:1789304535.314704:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304535.314820:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785634048:0@lo:400:kworker.0 00000100:00100000:2.0:1789304535.314850:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304535.314874:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304535.314880:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785634176:0@lo:400:kworker.0 00000100:00100000:2.0:1789304535.314904:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304535.314939:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785633792 00000100:00100000:0.0:1789304535.315059:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785633920 00000100:00100000:0.0:1789304535.315075:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785633920 00000100:00100000:3.0:1789304535.315111:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304535.315120:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785634304:0@lo:400:kworker.0 00000100:00100000:3.0:1789304535.315145:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304535.315149:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1789304535.315159:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785633920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304535.315237:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785633920:12345-0@lo:400:kworker.0 Request processed in 69us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304535.315246:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1789304535.315261:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785634304 00000100:00100000:0.0:1789304535.315264:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785634304 00000100:00100000:3.0:1789304535.315268:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785633920:0@lo:400:kworker.0 00000100:00100000:0.0:1789304535.315287:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1789304535.315293:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785634304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304535.315330:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785634304:12345-0@lo:400:kworker.0 Request processed in 37us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304535.315336:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785633792 00000100:00100000:0.0:1789304535.315336:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1789304535.315355:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785634048 00000100:00100000:0.0:1789304535.315358:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785634048 00000100:00100000:2.0:1789304535.315365:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785634176 00000100:00100000:2.0:1789304535.315367:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785634176 00000100:00100000:0.0:1789304535.315380:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:2.0:1789304535.315384:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1789304535.315386:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785633792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304535.315389:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785634048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304535.315417:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785633792:12345-0@lo:400:kworker.0 Request processed in 31us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304535.315419:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785634048:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304535.315423:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:2.0:1789304535.315425:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1789304535.315435:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1789304535.315441:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785634176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304535.315470:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785634176:12345-0@lo:400:kworker.0 Request processed in 30us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304535.315473:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785634304:0@lo:400:kworker.0 00000100:00100000:3.0:1789304535.315483:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785633792:0@lo:400:kworker.0 00000100:00100000:2.0:1789304535.315613:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785634176:0@lo:400:kworker.0 00000100:00100000:2.0:1789304535.315623:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785634048:0@lo:400:kworker.0 00000100:00100000:0.0:1789304535.317337:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00080000:0.0:1789304535.317389:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304535.317394:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304535.317398:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304535.380776:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304535.583633:0:82989:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe817c3980 20000000:00000080:0.0:1789304535.583655:0:82989:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b0208c000 uarg=0000000000000000 00010000:00010000:0.0:1789304535.584495:0:82989:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789304535.584534:0:82989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304535.584538:0:82989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304535.584552:0:82989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312963e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100452 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584575:0:82989:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789304535.584592:0:82989:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304535.584610:0:82989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584623:0:82989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584638:0:82989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584644:0:82989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584649:0:82989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584656:0:82989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584662:0:82989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304535.584666:0:82989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584673:0:82989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584683:0:82989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584691:0:82989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304535.584697:0:82989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129641a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304536.406130:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304536.663909:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304536.663917:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304536.663924:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304536.663970:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304536.663982:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304536.664002:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304536.664030:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785634432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304536.664119:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304536.664165:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388c8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789304536.664190:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785634432 00000100:00100000:1.0:1789304536.664197:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785634432 00000100:00100000:1.0:1789304536.664257:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1789304536.664265:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785634432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304536.664278:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304536.664292:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296428 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296421 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304536.664318:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296428 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296421 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304536.664329:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296428 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296421 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304536.664338:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370000, rc 0) 00000100:00100000:1.0:1789304536.664371:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785634432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304536.664377:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1789304536.664435:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785634432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304536.664449:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304536.664457:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304536.664480:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304536.664485:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304536.664497:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304537.431649:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304537.874598:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785634560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304537.874697:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304537.874899:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785634560 00000100:00100000:3.0:1789304537.874908:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785634560 00000100:00100000:3.0:1789304537.874978:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1789304537.874990:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785634560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304537.875028:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304537.875194:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785634560:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304537.875273:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304537.875386:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785634560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 398us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304537.875405:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1789304537.953227:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304537.953355:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304537.953406:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765547520 00000100:00100000:1.0:1789304537.953418:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765547520 00000100:00100000:1.0:1789304537.953481:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1151 00000100:00100000:1.0:1789304537.953493:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765547520:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304537.953616:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765547520:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 124us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304537.953625:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1151 00000100:00100000:2.0:1789304537.966109:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765547648 00000100:00100000:2.0:1789304537.966127:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765547648 00000100:00100000:3.0:1789304537.966645:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1406 00000100:00100000:3.0:1789304537.966657:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765547648:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304537.966748:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765547648:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (13544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304537.966756:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1406 00000100:00080000:2.0:1789304537.967524:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304538.450451:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304538.746245:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304538.746435:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765547776 00000100:00100000:2.0:1789304538.746447:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765547776 00000100:00100000:2.0:1789304538.746516:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:2.0:1789304538.746527:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:5594:x1876219765547776:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304538.746546:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304538.746548:0:57145:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312963e9) 00010000:00010000:2.0:1789304538.746551:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304538.746612:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:5594:x1876219765547776:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 86us (377us total) trans 0 rc 116/116 00000100:00100000:2.0:1789304538.746620:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:3.0:1789304538.899072:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304538.899136:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785634688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304538.900086:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304538.900593:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785634688 00000100:00100000:2.0:1789304538.900605:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785634688 00000100:00100000:2.0:1789304538.900686:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1789304538.900700:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785634688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304538.900746:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304538.900810:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785634688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304538.900817:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1789304538.900949:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785634688:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304538.901006:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789304538.945612:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967611 is committed 00010000:00010000:2.0:1789304539.474546:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304539.694736:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304539.694833:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765547904 00000100:00100000:2.0:1789304539.694845:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765547904 00000100:00100000:2.0:1789304539.694928:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 823 00000100:00100000:2.0:1789304539.694940:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:48679:x1876219765547904:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304539.694963:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304539.694991:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129642f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100460 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304539.695060:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296436 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304539.695075:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304539.695113:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304539.695161:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789304539.695166:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304539.695201:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296436 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304539.695227:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129642f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100460 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304539.695244:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296436 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100460 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304539.695253:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304539.695256:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304539.695259:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecde00, rc 0) 00000100:00100000:2.0:1789304539.695320:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:48679:x1876219765547904:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 383us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304539.695326:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 823 00000100:00080000:3.0:1789304539.695563:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304539.715788:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304539.715875:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765548032 00000100:00100000:3.0:1789304539.715892:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765548032 00000100:00100000:3.0:1789304539.715961:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 824 00000100:00100000:3.0:1789304539.715973:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:48679:x1876219765548032:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304539.715995:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304539.716020:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129643d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100467 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.716085:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296444 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.716130:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296444 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.716145:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296444 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.716161:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129644b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.716169:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129644b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.716176:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129644b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.718928:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231296452 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.718951:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231296452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.718963:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231296452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304539.719006:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:3.0:1789304539.719010:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304539.719031:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231296452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719044:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296444 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719051:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296444 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719058:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296444 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719064:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304539.719068:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296444 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719076:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296444 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719088:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:3.0:1789304539.719396:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304539.719403:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296444 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719414:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296444 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719429:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129644b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719436:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129644b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719442:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129644b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719447:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304539.719450:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129644b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719456:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129644b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719464:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304539.719466:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304539.719469:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129644b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719475:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129644b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719513:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129643d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100467 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719528:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231296452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100467 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.719536:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304539.719538:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304539.719540:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e000, rc 0) 00000100:00100000:3.0:1789304539.719668:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:48679:x1876219765548032:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 3696us (3892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304539.719677:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 824 00000100:00100000:3.0:1789304539.728424:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304539.728524:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765548288 00000100:00100000:0.0:1789304539.728534:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765548288 00000100:00100000:0.0:1789304539.728592:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 825 00000100:00100000:0.0:1789304539.728603:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:48679:x1876219765548288:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304539.728656:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304539.728684:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231296452 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100467 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.728703:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:0.0:1789304539.728714:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304539.728741:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.728755:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.728766:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304539.786812:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000048f4db3 reply state 0000000077fcc11d transno 4294967612 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304539.786831:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304539.786850:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000100:00100000:0.0:1789304539.786967:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:48679:x1876219765548288:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 58361us (58547us total) trans 4294967612 rc 0/0 00000100:00100000:0.0:1789304539.786975:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 825 00000001:00080000:2.0:1789304539.787603:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967612 is committed 00010000:00010000:3.0:1789304539.791346:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.791366:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.791375:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.791381:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304539.791386:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.791394:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.791410:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:3.0:1789304539.791413:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304539.791418:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.791424:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296459 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304539.901582:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304539.901905:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765548416 00000100:00100000:0.0:1789304539.901920:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765548416 00000100:00100000:0.0:1789304539.901994:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 826 00000100:00100000:0.0:1789304539.902006:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:48683:x1876219765548416:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789304539.902032:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304539.902057:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296460 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610046e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902145:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296467 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902161:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296467 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902173:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296467 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902201:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129646e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902209:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129646e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902215:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129646e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902537:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902547:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902554:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304539.902585:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:0.0:1789304539.902590:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304539.902611:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902626:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296467 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902632:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296467 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902639:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296467 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902645:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304539.902650:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296467 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902659:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296467 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902673:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:0.0:1789304539.902676:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304539.902682:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296467 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902688:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902699:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129646e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902709:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129646e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902715:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129646e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902720:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304539.902723:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129646e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902728:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129646e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902735:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c0558d600) 00010000:00010000:0.0:1789304539.902738:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304539.902741:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129646e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902746:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129646e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902779:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296460 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610046e expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902793:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610046e expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.902801:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304539.902803:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304539.902805:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa400, rc 0) 00000100:00100000:0.0:1789304539.902873:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:48683:x1876219765548416:12345-192.168.202.29@tcp:101:touch.0 Request processed in 869us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304539.902880:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 826 00000100:00100000:2.0:1789304539.910670:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304539.910755:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765548672 00000100:00100000:0.0:1789304539.910767:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765548672 00000100:00100000:0.0:1789304539.910837:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 827 00000100:00100000:0.0:1789304539.910850:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:48683:x1876219765548672:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789304539.910875:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304539.910897:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129647c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100475 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.911225:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296483 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.911253:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296483 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.911267:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296483 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.911338:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.911346:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.911353:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789304539.912122:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a:0x0], index 0: 0 00010000:00010000:0.0:1789304539.912417:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912431:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912442:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912478:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296483 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912486:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296483 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912492:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296483 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912497:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304539.912502:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296483 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912509:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296483 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912521:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304539.912524:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304539.912529:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296483 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912535:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296483 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304539.912553:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078beb7b2 reply state 000000007ae0f424 transno 4294967613 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304539.912561:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789304539.912593:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129647c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100475 expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912609:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100475 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.912617:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304539.912620:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304539.912622:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa200, rc 0) 00000100:00100000:0.0:1789304539.912710:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:48683:x1876219765548672:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1864us (2053us total) trans 4294967613 rc 0/0 00000100:00100000:0.0:1789304539.912719:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 827 00000100:00100000:2.0:1789304539.917475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304539.917852:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765548928 00000100:00100000:0.0:1789304539.917865:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765548928 00010000:00010000:3.0:1789304539.918039:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.918054:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.918061:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.918069:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304539.918073:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.918081:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.918124:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c0558d600) 00010000:00010000:3.0:1789304539.918128:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304539.918133:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.918140:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129648a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304539.918229:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 828 00000100:00100000:0.0:1789304539.918251:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:48683:x1876219765548928:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:0.0:1789304539.918313:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304539.918332:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100475 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.918343:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304539.918351:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304539.918406:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.918420:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304539.918430:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304539.918558:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6fa8c62 reply state 00000000e94b77bb transno 4294967614 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304539.918567:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304539.918656:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:48683:x1876219765548928:12345-192.168.202.29@tcp:36:touch.0 Request processed in 407us (1191us total) trans 4294967614 rc 0/0 00000100:00100000:0.0:1789304539.918664:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 828 00000100:00100000:2.0:1789304539.921278:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:3.0:1789304539.921395:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.921409:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.921416:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.921423:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304539.921428:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.921436:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.921452:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:3.0:1789304539.921455:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304539.921460:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304539.921466:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129649f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304539.930751:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765549056 00000100:00100000:1.0:1789304539.930768:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765549056 00000100:00100000:1.0:1789304539.930856:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 829 00000100:00100000:1.0:1789304539.930867:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:48683:x1876219765549056:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304539.930902:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304539.930928:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312964a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610047c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304539.930991:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312964a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610047c expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304539.931006:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312964a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610047c expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304539.931030:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9e2c14addf00) 00010000:00010000:1.0:1789304539.931034:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789304539.931038:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371000, rc 0) 00000100:00100000:1.0:1789304539.931114:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:48683:x1876219765549056:12345-192.168.202.29@tcp:101:touch.0 Request processed in 248us (9846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304539.931120:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 829 00000100:00100000:2.0:1789304539.946605:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304539.946675:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765549184 00000100:00100000:0.0:1789304539.946686:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765549184 00000100:00100000:0.0:1789304539.946743:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 445 00000100:00100000:0.0:1789304539.946751:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876219765549184:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:0.0:1789304539.946786:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1989 last 0 00000020:00000080:0.0:1789304539.946821:0:17212:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb72312964ad 00002000:00100000:0.0:1789304539.946836:0:17212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b01e98800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789304539.946847:0:17212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789304539.947073:0:17212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789304539.947133:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2b01e99000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789304539.947214:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765549184:12345-192.168.202.29@tcp:8:touch.0 Request processed in 461us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304539.947221:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 445 00000100:00100000:2.0:1789304539.952460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304539.952724:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765549312 00000100:00100000:0.0:1789304539.952749:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765549312 00000100:00100000:0.0:1789304539.952831:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 446 00000100:00100000:0.0:1789304539.952841:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765549312:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:3.0:1789304539.953857:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789304539.998044:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00000001:00100000:3.0:1789304539.998060:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:3.0:1789304540.001026:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:0:x1876219765549312:12345-192.168.202.29@tcp:2:touch.0 Request processed in 48174us (48563us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789304540.001041:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 446 00000100:00100000:3.0:1789304540.005940:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304540.007986:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765549568 00000100:00100000:1.0:1789304540.008002:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765549568 00000100:00100000:1.0:1789304540.008070:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:1.0:1789304540.008081:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:48683:x1876219765549568:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:1.0:1789304540.008483:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:48683:x1876219765549568:12345-192.168.202.29@tcp:35:touch.0 Request processed in 402us (2550us total) trans 4294967615 rc 0/0 00000100:00100000:1.0:1789304540.008491:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:2.0:1789304540.065676:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304540.066019:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765549696 00000100:00100000:3.0:1789304540.066032:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765549696 00000100:00100000:3.0:1789304540.066137:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 830 00000100:00100000:3.0:1789304540.066149:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:48687:x1876219765549696:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304540.066179:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304540.066216:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100483 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066288:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066307:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066320:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066335:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066342:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066349:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066446:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312964c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066455:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312964c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066462:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312964c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304540.066499:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00000004:00200000:3.0:1789304540.066503:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304540.066524:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312964c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066540:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312964c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066547:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066554:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066560:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066565:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304540.066569:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066577:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066587:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:3.0:1789304540.066590:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304540.066595:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066601:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066615:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066621:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066627:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066632:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304540.066634:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066640:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066648:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304540.066651:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304540.066653:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066660:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066691:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100483 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066708:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312964c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100483 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.066716:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9e2c14addf00) 00010000:00010000:3.0:1789304540.066718:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304540.066721:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304540.067049:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:48687:x1876219765549696:12345-192.168.202.29@tcp:101:rm.0 Request processed in 902us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304540.067057:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 830 00000100:00100000:2.0:1789304540.072034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304540.072134:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765549824 00000100:00100000:3.0:1789304540.072145:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765549824 00000100:00100000:3.0:1789304540.072209:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 447 00000100:00100000:3.0:1789304540.072220:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765549824:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304540.072239:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304540.072262:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4595bfe/0xefc0bb72312964d0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610048a expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789304540.072291:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x6aa69edc, atime: 0x6aa69edc, ctime: 0x6aa69edc, blocks: 0x1 00010000:00010000:3.0:1789304540.072313:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=1989s v=(0 0) 00010000:00010000:3.0:1789304540.072318:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304540.072328:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4595bfe/0xefc0bb72312964d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610048a expref: 6 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.072347:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d4595bfe/0xefc0bb72312964d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610048a expref: 6 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.072364:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e200, rc 0) 00000100:00100000:3.0:1789304540.072428:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765549824:12345-192.168.202.29@tcp:101:rm.0 Request processed in 210us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304540.072435:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 447 00000100:00100000:2.0:1789304540.080963:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304540.081048:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765550080 00000100:00100000:3.0:1789304540.081058:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765550080 00000100:00100000:3.0:1789304540.081127:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 831 00000100:00100000:3.0:1789304540.081137:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:48687:x1876219765550080:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:3.0:1789304540.081212:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304540.081241:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312964c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100483 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081266:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312964a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610047c expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081277:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9e2c14addf00) 00010000:00010000:3.0:1789304540.081289:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304540.081316:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081332:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081343:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081357:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081364:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081370:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081468:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081477:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081484:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304540.081932:0:30980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].26, 64 off9856 00000004:00080000:3.0:1789304540.081940:0:30980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1989759848891ns, next at 1990759847238ns, rc = 0 00010000:00010000:3.0:1789304540.081983:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081990:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.081996:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082001:0:30980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082005:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082008:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082030:0:30980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304540.082045:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082049:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082053:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082057:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304540.082060:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082065:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082071:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304540.082073:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304540.082075:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082078:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312964e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082127:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082134:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082140:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082145:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304540.082148:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082153:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082165:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:3.0:1789304540.082167:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304540.082171:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.082177:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304540.082199:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c52cf691 reply state 000000002f8f09c3 transno 4294967616 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304540.082208:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304540.082279:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:48687:x1876219765550080:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1140us (1324us total) trans 4294967616 rc 0/0 00000100:00100000:3.0:1789304540.082287:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 831 00010000:00010000:2.0:1789304540.083583:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304540.083595:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304540.083604:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304540.083607:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304540.083615:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304540.083629:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:2.0:1789304540.083631:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789304540.083635:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304540.083640:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312964ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304540.083660:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304540.083662:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304540.083664:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304540.087251:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.087273:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.087281:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.087287:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304540.087292:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.087300:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.087324:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304540.087328:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304540.087333:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304540.087340:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304540.434835:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785635072:0@lo:400:kworker.0 00000100:00100000:2.0:1789304540.434913:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304540.434981:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789304540.434988:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785634944:0@lo:400:kworker.0 00000100:00100000:2.0:1789304540.435014:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304540.435037:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785635456:0@lo:400:kworker.0 00000100:00100000:2.0:1789304540.435055:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304540.435082:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785635072 00000100:00100000:3.0:1789304540.435340:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785634816:0@lo:400:kworker.0 00000100:00100000:3.0:1789304540.435378:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304540.435407:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785635328:0@lo:400:kworker.0 00000100:00100000:3.0:1789304540.435429:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304540.435446:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304540.435451:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785635200:0@lo:400:kworker.0 00000100:00100000:3.0:1789304540.435472:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304540.435497:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785634816 00000100:00100000:3.0:1789304540.435503:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785634816 00000100:00100000:3.0:1789304540.435558:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1789304540.435567:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785634816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304540.435634:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785634816:12345-0@lo:400:kworker.0 Request processed in 67us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304540.435641:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1789304540.435675:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785634944 00000100:00100000:3.0:1789304540.435679:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785634944 00000100:00100000:3.0:1789304540.435710:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785635328 00000100:00100000:3.0:1789304540.435713:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785635328 00000100:00100000:3.0:1789304540.435737:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785635200 00000100:00100000:3.0:1789304540.435740:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785635200 00000100:00100000:3.0:1789304540.435754:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1789304540.435759:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785634944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304540.435796:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785634944:12345-0@lo:400:kworker.0 Request processed in 37us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304540.435802:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1789304540.435814:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1789304540.435821:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785635328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304540.435848:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785635328:12345-0@lo:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304540.435853:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1789304540.435864:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1789304540.435869:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785635200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304540.435895:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785635200:12345-0@lo:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304540.435900:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00080000:3.0:1789304540.435917:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304540.435952:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785635200:0@lo:400:kworker.0 00000100:00100000:3.0:1789304540.435961:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785634816:0@lo:400:kworker.0 00000100:00100000:3.0:1789304540.435970:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785635328:0@lo:400:kworker.0 00000100:00100000:0.0:1789304540.437107:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785634944:0@lo:400:kworker.0 00000100:00100000:2.0:1789304540.439251:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785635072 00000100:00100000:2.0:1789304540.439358:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785635456 00000100:00100000:2.0:1789304540.439364:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785635456 00000100:00100000:2.0:1789304540.439400:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1789304540.439411:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785635072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304540.439432:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1789304540.439445:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785635456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304540.439514:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785635456:12345-0@lo:400:kworker.0 Request processed in 73us (4456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304540.439523:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00080000:1.0:1789304540.439571:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304540.439576:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785635456:0@lo:400:kworker.0 00000100:00080000:1.0:1789304540.439577:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304540.439597:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785635072:0@lo:400:kworker.0 00000100:00100000:2.0:1789304540.439925:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785635072:12345-0@lo:400:kworker.0 Request processed in 516us (5011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304540.439932:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00010000:00010000:1.0:1789304540.499950:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304541.137971:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304541.141748:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765550208 00000100:00100000:3.0:1789304541.141768:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765550208 00000100:00100000:3.0:1789304541.141880:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 832 00000100:00100000:3.0:1789304541.141895:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:48702:x1876219765550208:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304541.141925:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304541.141950:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100491 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.142015:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.142029:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.142040:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304541.142074:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:3.0:1789304541.142077:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304541.142126:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.142155:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb72312964f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100491 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.142182:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100491 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.142191:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:3.0:1789304541.142194:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304541.142198:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304541.142261:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:48702:x1876219765550208:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 372us (4297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304541.142267:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 832 00000100:00080000:0.0:1789304541.142426:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304541.146598:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304541.146673:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765550464 00000100:00100000:3.0:1789304541.146684:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765550464 00000100:00100000:3.0:1789304541.146752:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 833 00000100:00100000:3.0:1789304541.146764:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:48702:x1876219765550464:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304541.146828:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304541.146859:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312964fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100491 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.146882:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610046e expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.146893:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:3.0:1789304541.146905:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304541.146932:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.146947:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.146958:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304541.212386:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6f2ade3 reply state 00000000afe4c303 transno 4294967617 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304541.212407:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789304541.212425:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000100:00100000:2.0:1789304541.212542:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:48702:x1876219765550464:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 65775us (65959us total) trans 4294967617 rc 0/0 00000100:00100000:2.0:1789304541.212552:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 833 00000001:00080000:2.0:1789304541.213843:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967614 is committed 00000001:00080000:2.0:1789304541.213865:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967615 is committed 00000001:00080000:2.0:1789304541.213885:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967617 is committed 00000004:00080000:2.0:1789304541.213893:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 67 committed 00000100:00100000:1.0:1789304541.214117:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304541.214136:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785635584:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789304541.214208:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304541.214302:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785635584 00000100:00100000:1.0:1789304541.214312:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785635584 00000100:00100000:1.0:1789304541.214358:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:1.0:1789304541.214366:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785635584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789304541.214398:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:26 count 1 00010000:00010000:1.0:1789304541.214428:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.214454:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4595bfe/0xefc0bb72312964d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610048a expref: 5 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.214463:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789304541.214467:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304541.214472:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.214500:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4595bfe/0xefc0bb72312964d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610048a expref: 5 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.214515:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4595bfe/0xefc0bb72312964d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610048a expref: 5 pid: 17212 timeout: 2090 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304541.214528:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02090700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785635712:192.168.202.29@tcp:104: 00000100:00100000:1.0:1789304541.214743:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789304541.214892:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.214902:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.214909:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.214916:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304541.214920:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.214929:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.214945:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:0.0:1789304541.214948:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304541.214953:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.214959:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296501 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304541.224976:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304541.225080:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765550592 00000100:00100000:2.0:1789304541.225130:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765550592 00010000:00010000:2.0:1789304541.225213:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4595bfe/0xefc0bb72312964d0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610048a expref: 6 pid: 17212 timeout: 2090 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304541.225255:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 378 00000100:00100000:2.0:1789304541.225266:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765550592:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304541.225283:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304541.225289:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4595bfe/0xefc0bb72312964d0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610048a expref: 6 pid: 17212 timeout: 2090 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.225303:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4595bfe/0xefc0bb72312964d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610048a expref: 6 pid: 17212 timeout: 2090 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.225329:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304541.225334:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304541.225340:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.225351:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.225374:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304541.225432:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765550592:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 168us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304541.225440:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 378 00000100:00080000:0.0:1789304541.226404:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304541.226916:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4595bfe/0xefc0bb72312964d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610048a expref: 5 pid: 17212 timeout: 2090 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304541.226935:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02090700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785635712:192.168.202.29@tcp:104: 00010000:00010000:1.0:1789304541.226959:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.226970:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.226978:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.226988:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.226996:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.227012:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304541.227678:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304541.227686:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.227696:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304541.227700:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.227716:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.227734:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.227741:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b639c1b5/0xefc0bb7231296508 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.227761:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304541.227762:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304541.227764:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304541.228060:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785635584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13692us (13849us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789304541.228069:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000004:00080000:2.0:1789304541.237678:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b02092680/2, rc 0, transno 4294967349 00000100:00100000:2.0:1789304541.237697:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785635584:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789304541.281142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304541.281312:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765550720 00000100:00100000:3.0:1789304541.281388:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765550720 00000100:00100000:3.0:1789304541.281492:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 834 00000100:00100000:3.0:1789304541.281503:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:48706:x1876219765550720:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304541.281527:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304541.281548:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129650f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100498 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.281621:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296516 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.281636:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296516 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.281647:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296516 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.281662:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129651d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.281668:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129651d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.281674:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129651d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.281963:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.281972:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.281979:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304541.282021:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:3.0:1789304541.282025:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304541.282046:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282064:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296516 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282070:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296516 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282076:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296516 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282082:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304541.282086:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296516 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282127:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296516 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282140:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:3.0:1789304541.282143:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304541.282149:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296516 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282410:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296516 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282429:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129651d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282435:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129651d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282440:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129651d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282445:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304541.282448:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129651d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282454:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129651d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282462:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789304541.282464:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304541.282467:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129651d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282472:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129651d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282503:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129650f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100498 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282518:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100498 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.282525:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304541.282528:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304541.282530:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fe00, rc 0) 00000100:00100000:3.0:1789304541.282876:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:48706:x1876219765550720:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1373us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304541.282885:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 834 00000100:00100000:2.0:1789304541.287523:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304541.287605:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765550976 00000100:00100000:3.0:1789304541.287617:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765550976 00000100:00100000:3.0:1789304541.287674:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 835 00000100:00100000:3.0:1789304541.287685:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:48706:x1876219765550976:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304541.287705:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304541.287727:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129652b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610049f expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.288191:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296532 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.288208:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.288233:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.288249:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.288256:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.288263:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304541.289748:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a:0x0], index 1: 0 00010000:00010000:3.0:1789304541.290860:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296540 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.290881:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.290898:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.290938:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.290946:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296532 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.290953:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296532 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.290959:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304541.290964:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296532 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.290972:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296532 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.290984:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304541.290987:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304541.290993:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296532 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.291000:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296532 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304541.291027:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096f1b8ef reply state 000000008f3954e0 transno 4294967618 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304541.291037:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304541.291073:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129652b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610049f expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.291117:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610049f expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.291125:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789304541.291128:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304541.291131:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f000, rc 0) 00000100:00100000:3.0:1789304541.291240:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:48706:x1876219765550976:12345-192.168.202.29@tcp:101:touch.0 Request processed in 3556us (3725us total) trans 4294967618 rc 0/0 00000100:00100000:3.0:1789304541.291250:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 835 00000100:00100000:1.0:1789304541.295945:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304541.296030:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765551232 00000100:00100000:2.0:1789304541.296041:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765551232 00000100:00100000:2.0:1789304541.296128:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 836 00000100:00100000:2.0:1789304541.296139:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:48706:x1876219765551232:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:2.0:1789304541.296213:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304541.296251:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296540 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610049f expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.296274:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:2.0:1789304541.296285:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304541.296343:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.296358:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.296368:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304541.296515:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000349e09b3 reply state 00000000c054bbaa transno 4294967619 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304541.296524:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304541.296629:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:48706:x1876219765551232:12345-192.168.202.29@tcp:36:touch.0 Request processed in 491us (691us total) trans 4294967619 rc 0/0 00000100:00100000:2.0:1789304541.296637:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 836 00010000:00010000:3.0:1789304541.299564:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.299641:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.299649:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.299656:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304541.299661:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.299669:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.299685:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304541.299688:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304541.299693:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.299700:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296539 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304541.300841:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:3.0:1789304541.300901:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.300913:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.300919:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.300925:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304541.300929:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.300935:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.300949:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9e2c421d2200) 00010000:00010000:3.0:1789304541.300951:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304541.300956:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.300961:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129654e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304541.300997:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765551360 00000100:00100000:3.0:1789304541.301069:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765551360 00000100:00100000:3.0:1789304541.301135:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 837 00000100:00100000:3.0:1789304541.301145:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:48706:x1876219765551360:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304541.301167:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304541.301193:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296555 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004a6 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.301437:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004a6 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.301453:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004a6 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.301471:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304541.301473:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789304541.301476:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fa00, rc 0) 00000100:00100000:3.0:1789304541.301712:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:48706:x1876219765551360:12345-192.168.202.29@tcp:101:touch.0 Request processed in 568us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304541.301720:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 837 00000100:00100000:2.0:1789304541.307920:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304541.308067:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765551488 00000100:00100000:3.0:1789304541.308080:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765551488 00000100:00100000:3.0:1789304541.308442:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 449 00000100:00100000:3.0:1789304541.308452:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876219765551488:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:3.0:1789304541.308492:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 1990 last 0 00000020:00000080:3.0:1789304541.308536:0:17212:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb723129655c 00002000:00100000:3.0:1789304541.308549:0:17212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b02ecf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789304541.308589:0:17212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789304541.308843:0:17212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789304541.308877:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2b02ecb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789304541.308953:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765551488:12345-192.168.202.29@tcp:8:touch.0 Request processed in 502us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304541.308961:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 449 00000100:00100000:0.0:1789304541.312507:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304541.312570:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765551616 00000100:00100000:2.0:1789304541.312587:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765551616 00000100:00100000:2.0:1789304541.312646:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 450 00000100:00100000:2.0:1789304541.312657:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765551616:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:0.0:1789304541.312981:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789304541.352717:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967348 is committed 00000001:00100000:0.0:1789304541.352740:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:3.0:1789304541.352931:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:0:x1876219765551616:12345-192.168.202.29@tcp:2:touch.0 Request processed in 40270us (40425us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789304541.352944:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 450 00000100:00100000:2.0:1789304541.355948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304541.356203:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765551872 00000100:00100000:0.0:1789304541.356214:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765551872 00000100:00100000:0.0:1789304541.356455:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 87 00000100:00100000:0.0:1789304541.356468:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:48706:x1876219765551872:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:0.0:1789304541.356937:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:48706:x1876219765551872:12345-192.168.202.29@tcp:35:touch.0 Request processed in 470us (996us total) trans 4294967620 rc 0/0 00000100:00100000:0.0:1789304541.356945:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 87 00000100:00100000:2.0:1789304541.408603:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304541.408728:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765552000 00000100:00100000:3.0:1789304541.408743:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765552000 00000100:00100000:3.0:1789304541.408821:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 838 00000100:00100000:3.0:1789304541.408833:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:48710:x1876219765552000:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304541.408858:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304541.408881:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296563 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004ad expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.410726:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129656a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.410757:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129656a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.410774:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129656a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.411970:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296571 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.411985:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.411992:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412163:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412183:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412191:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304541.412408:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x45:0x0]: returning size 0 00000004:00200000:2.0:1789304541.412415:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304541.412446:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412459:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412468:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129656a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412475:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129656a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412483:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129656a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412489:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304541.412493:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129656a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412502:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129656a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412516:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:2.0:1789304541.412519:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304541.412524:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129656a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412532:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129656a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412551:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412557:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296571 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412563:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412568:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304541.412571:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412577:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296571 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412586:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304541.412588:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304541.412591:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296571 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412597:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296571 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412649:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296563 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004ad expref: 13 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412666:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004ad expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304541.412674:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:2.0:1789304541.412676:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304541.412679:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd400, rc 0) 00000100:00100000:2.0:1789304541.412782:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:48710:x1876219765552000:12345-192.168.202.29@tcp:101:rm.0 Request processed in 3950us (4190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304541.412792:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 838 00000100:00100000:2.0:1789304541.419357:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304541.419508:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765552128 00000100:00100000:0.0:1789304541.419522:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765552128 00000100:00100000:0.0:1789304541.419637:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 451 00000100:00100000:0.0:1789304541.419649:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765552128:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304541.419673:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304541.419699:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb723129657f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004b4 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304541.419736:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x6aa69edd, atime: 0x6aa69edd, ctime: 0x6aa69edd, blocks: 0x1 00010000:00010000:0.0:1789304541.419757:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=1991s v=(0 0) 00010000:00010000:0.0:1789304541.419762:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304541.419771:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb723129657f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004b4 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.419794:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb723129657f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004b4 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.419808:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa600, rc 0) 00000100:00100000:0.0:1789304541.419884:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765552128:12345-192.168.202.29@tcp:101:rm.0 Request processed in 237us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304541.419892:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 451 00000100:00100000:1.0:1789304541.429934:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304541.430922:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765552384 00000100:00100000:0.0:1789304541.430938:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765552384 00000100:00100000:0.0:1789304541.431969:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 839 00000100:00100000:0.0:1789304541.431982:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:48710:x1876219765552384:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:0.0:1789304541.432051:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304541.432083:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004ad expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.432146:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296555 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004a6 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.432164:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:0.0:1789304541.432186:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304541.432213:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296586 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.432238:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.432249:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.432263:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.432271:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.432278:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.432411:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296594 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.432419:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.432427:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789304541.433461:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].26, 64 off9856 00000004:00080000:0.0:1789304541.433475:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1991111383846ns, next at 1992111381441ns, rc = 0 00010000:00010000:0.0:1789304541.433538:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433551:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433598:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433606:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433613:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433619:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433646:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789304541.433670:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433677:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296594 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433684:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433690:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304541.433694:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433706:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296594 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433718:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:0.0:1789304541.433721:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789304541.433726:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296594 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.433731:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296594 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.434138:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304541.434169:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.434184:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304541.434209:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.434228:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.434243:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:1.0:1789304541.434246:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304541.434263:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.434269:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129659b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.434286:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304541.434311:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304541.434314:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304541.435945:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.435967:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296586 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.435976:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.435982:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304541.435987:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.435996:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296586 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.436017:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:0.0:1789304541.436020:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304541.436024:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296586 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304541.436030:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296586 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304541.436053:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014dbb173 reply state 00000000dd89b994 transno 4294967621 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304541.436064:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304541.436205:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:48710:x1876219765552384:12345-192.168.202.29@tcp:36:rm.0 Request processed in 4221us (6279us total) trans 4294967621 rc 0/0 00000100:00100000:0.0:1789304541.436214:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 839 00010000:00010000:3.0:1789304541.440816:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.440834:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.440846:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.440852:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304541.440856:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.440864:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.440880:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c0558d200) 00010000:00010000:3.0:1789304541.440883:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304541.440888:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304541.440894:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb723129658d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304541.532536:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304542.399813:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304542.399969:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765552512 00000100:00100000:3.0:1789304542.399981:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765552512 00000100:00100000:3.0:1789304542.400050:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 840 00000100:00100000:3.0:1789304542.400062:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:48725:x1876219765552512:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304542.400087:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304542.400153:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312965a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004bb expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.400282:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312965a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.400302:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312965a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.400318:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312965a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304542.400361:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:3.0:1789304542.400365:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304542.400386:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312965a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.400702:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312965a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004bb expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.400725:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312965a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004bb expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.400734:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304542.400738:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304542.400741:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ea00, rc 0) 00000100:00100000:3.0:1789304542.400814:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:48725:x1876219765552512:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 753us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304542.400821:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 840 00000100:00100000:2.0:1789304542.415349:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304542.418611:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765552768 00000100:00100000:0.0:1789304542.418625:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765552768 00000100:00100000:0.0:1789304542.418688:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 841 00000100:00100000:0.0:1789304542.418701:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:48725:x1876219765552768:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304542.418760:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304542.418788:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312965a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004bb expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.418811:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100498 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.418822:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:0.0:1789304542.418833:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304542.418862:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.418875:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.418885:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304542.419818:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080a06190 reply state 00000000aab04b9f transno 4294967622 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304542.419831:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304542.419840:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000100:00100000:0.0:1789304542.423369:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:48725:x1876219765552768:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 4658us (8016us total) trans 4294967622 rc 0/0 00000100:00100000:0.0:1789304542.423383:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 841 00010000:00010000:3.0:1789304542.436509:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.436530:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.436544:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.436550:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304542.436555:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.436563:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.436579:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:3.0:1789304542.436582:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304542.436587:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.436593:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.550214:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304542.573445:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304542.573531:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765552896 00000100:00100000:1.0:1789304542.573543:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765552896 00000100:00100000:1.0:1789304542.573607:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 842 00000100:00100000:1.0:1789304542.573618:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:48737:x1876219765552896:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304542.573733:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:48737:x1876219765552896:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 116us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304542.573739:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 842 00000100:00100000:2.0:1789304542.576399:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304542.576523:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765553024 00000100:00100000:3.0:1789304542.576533:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765553024 00000100:00100000:3.0:1789304542.576587:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 452 00000100:00100000:3.0:1789304542.576597:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:48737:x1876219765553024:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304542.576960:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:48737:x1876219765553024:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 363us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304542.576968:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 452 00000100:00100000:3.0:1789304542.579285:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304542.579499:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765553152 00000100:00100000:2.0:1789304542.579511:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765553152 00000100:00100000:2.0:1789304542.579581:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 453 00000100:00100000:2.0:1789304542.579594:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:48737:x1876219765553152:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304542.580135:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:48737:x1876219765553152:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 534us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304542.580144:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 453 00000100:00100000:0.0:1789304542.582603:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304542.582707:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765553280 00000100:00100000:3.0:1789304542.582718:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765553280 00000100:00100000:3.0:1789304542.582806:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 843 00000100:00100000:3.0:1789304542.582814:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:48737:x1876219765553280:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304542.583522:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:48737:x1876219765553280:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 706us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304542.583530:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 843 00000100:00100000:3.0:1789304542.587534:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304542.587713:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765553408 00000100:00100000:0.0:1789304542.587726:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765553408 00000100:00100000:0.0:1789304542.587792:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 844 00000100:00100000:0.0:1789304542.587802:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:48737:x1876219765553408:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304542.587954:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:48737:x1876219765553408:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 152us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304542.587962:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 844 00000100:00100000:0.0:1789304542.590609:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304542.590724:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765553536 00000100:00100000:3.0:1789304542.590736:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765553536 00000100:00100000:3.0:1789304542.590848:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 454 00000100:00100000:3.0:1789304542.590860:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:48737:x1876219765553536:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304542.591330:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:48737:x1876219765553536:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 471us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304542.591338:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 454 00000100:00100000:2.0:1789304542.593559:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304542.593635:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765553664 00000100:00100000:0.0:1789304542.593644:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765553664 00000100:00100000:0.0:1789304542.593712:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 455 00000100:00100000:0.0:1789304542.593719:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:48737:x1876219765553664:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304542.594074:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:48737:x1876219765553664:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 354us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304542.594081:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 455 00000100:00100000:0.0:1789304542.596336:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304542.596489:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765553792 00000100:00100000:2.0:1789304542.596499:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765553792 00000100:00100000:1.0:1789304542.596811:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 845 00000100:00100000:1.0:1789304542.596824:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:48737:x1876219765553792:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304542.597737:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:48737:x1876219765553792:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 911us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304542.597747:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 845 00000100:00100000:3.0:1789304542.657724:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304542.657861:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765553920 00000100:00100000:0.0:1789304542.657872:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765553920 00000100:00100000:0.0:1789304542.657940:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 846 00000100:00100000:0.0:1789304542.657950:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:48741:x1876219765553920:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789304542.657970:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304542.657989:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004c2 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658049:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312965be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658063:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312965be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658074:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312965be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658124:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312965c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658132:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312965c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658139:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312965c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658588:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312965cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658602:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312965cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658610:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312965cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304542.658643:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:0.0:1789304542.658647:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304542.658669:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312965cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658681:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312965be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658688:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312965be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658694:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312965be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658700:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304542.658704:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312965be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658712:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312965be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658725:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:0.0:1789304542.658729:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304542.658735:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312965be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658747:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312965be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658761:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312965c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658767:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312965c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658773:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312965c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658778:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304542.658781:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312965c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658787:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312965c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658794:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304542.658796:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304542.658798:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312965c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658804:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312965c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658836:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312965b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004c2 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658851:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312965cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004c2 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.658858:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:0.0:1789304542.658860:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304542.658863:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afaa00, rc 0) 00000100:00100000:0.0:1789304542.659413:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:48741:x1876219765553920:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1462us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304542.659431:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 846 00000100:00100000:2.0:1789304542.663723:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304542.663823:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765554176 00000100:00100000:0.0:1789304542.663837:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765554176 00000100:00100000:0.0:1789304542.663909:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 847 00000100:00100000:0.0:1789304542.663921:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:48741:x1876219765554176:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789304542.663950:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304542.663980:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312965d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004c9 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.664149:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312965da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.664174:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312965da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.664188:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312965da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.664204:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.664212:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.664231:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789304542.664803:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b:0x0], index 0: 0 00010000:00010000:0.0:1789304542.664982:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312965e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.664993:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312965e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.665002:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312965e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.665037:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312965da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.665045:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312965da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.665052:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312965da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.665058:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304542.665063:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312965da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.665070:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312965da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.665084:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:0.0:1789304542.665087:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304542.665127:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312965da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.665134:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb72312965da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304542.665147:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ad71462 reply state 0000000035371814 transno 4294967623 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304542.665157:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789304542.665202:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312965d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004c9 expref: 15 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.665219:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312965e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004c9 expref: 14 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.665227:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:0.0:1789304542.665229:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304542.665232:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa400, rc 0) 00000100:00100000:0.0:1789304542.665322:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+15:48741:x1876219765554176:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1404us (1615us total) trans 4294967623 rc 0/0 00000100:00100000:0.0:1789304542.665330:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 847 00010000:00010000:2.0:1789304542.673205:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304542.673237:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304542.673246:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304542.673252:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304542.673257:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304542.673265:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304542.673284:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c0558d600) 00010000:00010000:2.0:1789304542.673287:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304542.673293:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304542.673299:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312965e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304542.681572:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304542.681884:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765554304 00000100:00100000:3.0:1789304542.681898:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765554304 00000100:00100000:3.0:1789304542.681975:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 456 00000100:00100000:3.0:1789304542.681986:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:48741:x1876219765554304:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:3.0:1789304542.682007:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304542.682032:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1b25883/0xefc0bb72312965f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004d0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789304542.682063:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789304542.682120:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=1992s v=(0 0) 00010000:00010000:3.0:1789304542.682125:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304542.682136:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b25883/0xefc0bb72312965f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d0 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.682169:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a1b25883/0xefc0bb72312965f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d0 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304542.682182:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304542.682253:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:48741:x1876219765554304:12345-192.168.202.29@tcp:101:dd.0 Request processed in 268us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304542.682260:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 456 00000100:00100000:3.0:1789304542.704900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304542.705195:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765554432 00000100:00100000:0.0:1789304542.705326:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765554432 00002000:00100000:0.0:1789304542.705399:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff9e2c38460380 x1876219765554432/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:608/0 lens 488/0 e 0 to 0 dl 1789304553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789304542.705411:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c38460380 with x1876219765554432 ext(0->1048575) 00002000:00010000:0.0:1789304542.705417:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2c38460380 00000100:00100000:0.0:1789304542.705455:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:0.0:1789304542.705467:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765554432:12345-192.168.202.29@tcp:4:dd.0 00000100:00100000:2.0:1789304542.724932:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765554432:12345-192.168.202.29@tcp:4:dd.0 Request processed in 19456us (20031us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789304542.724948:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 20 00002000:00100000:2.0:1789304542.724961:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff9e2c38460380 x1876219765554432/t4294967350(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:608/0 lens 488/448 e 0 to 0 dl 1789304553 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304542.724972:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c38460380 with x1876219765554432 ext(0->1048575) 00002000:00010000:2.0:1789304542.724979:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2c38460380 00000100:00100000:2.0:1789304542.728606:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304542.728693:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765554560 00000100:00100000:0.0:1789304542.728706:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765554560 00000100:00100000:0.0:1789304542.728771:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 848 00000100:00100000:0.0:1789304542.728784:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+14:48741:x1876219765554560:12345-192.168.202.29@tcp:44:dd.0 00000100:00100000:0.0:1789304542.763412:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+14:48741:x1876219765554560:12345-192.168.202.29@tcp:44:dd.0 Request processed in 34619us (34805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304542.763427:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 848 00000001:00080000:3.0:1789304542.765438:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967623 is committed 00000004:00080000:3.0:1789304542.765459:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 74 committed 00000100:00100000:2.0:1789304542.765717:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304542.765951:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304542.765969:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785635840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789304542.766017:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304542.766083:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765554688 00000100:00100000:0.0:1789304542.766119:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765554688 00000100:00100000:0.0:1789304542.766177:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785635840 00000100:00100000:0.0:1789304542.766181:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785635840 00000100:00100000:0.0:1789304542.766338:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 457 00000100:00100000:0.0:1789304542.766350:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765554688:12345-192.168.202.29@tcp:16:dd.0 00000100:00080000:0.0:1789304542.766418:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304542.766448:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1789304542.766456:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785635840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789304542.766472:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:26 count 1 00010000:00010000:0.0:1789304542.766497:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.766519:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb723129657f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004b4 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.766533:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789304542.766537:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304542.766542:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.766575:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb723129657f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004b4 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.766589:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb723129657f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004b4 expref: 5 pid: 6693 timeout: 2092 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304542.766600:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785635968:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304542.766664:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16180 going to sleep for 11 seconds 00000100:00100000:3.0:1789304542.772309:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304542.773597:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765554816 00000100:00100000:2.0:1789304542.773613:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765554816 00010000:00010000:2.0:1789304542.773670:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb723129657f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004b4 expref: 6 pid: 6693 timeout: 2092 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304542.773776:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 379 00000100:00100000:2.0:1789304542.773788:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765554816:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304542.773805:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304542.773811:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb723129657f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004b4 expref: 6 pid: 6693 timeout: 2092 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304542.773828:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb723129657f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004b4 expref: 6 pid: 6693 timeout: 2092 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304542.773857:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304542.773863:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304542.773870:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304542.773880:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304542.773909:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304542.773991:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765554816:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 204us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304542.773999:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 379 00010000:00010000:0.0:1789304542.775367:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb723129657f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004b4 expref: 5 pid: 6693 timeout: 2092 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304542.775396:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785635968:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789304542.775426:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.775439:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.775446:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.775460:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.775468:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304542.775489:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789304542.776194:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785635840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9736us (10173us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789304542.776206:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000004:00080000:0.0:1789304542.776269:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c385c5880/2, rc 0, transno 4294967349 00000100:00100000:0.0:1789304542.776275:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785635840:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789304542.777468:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304542.777482:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304542.777496:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304542.777501:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304542.777513:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304542.777535:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304542.777544:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb72312965fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304542.777568:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304542.777570:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304542.777572:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304542.807822:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00000100:00100000:0.0:1789304542.808129:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765554688:12345-192.168.202.29@tcp:16:dd.0 Request processed in 41742us (42378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304542.808141:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 457 00000001:00080000:3.0:1789304542.810795:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00000100:00100000:2.0:1789304542.811365:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304542.811467:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765555072 00000100:00100000:3.0:1789304542.811478:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765555072 00000100:00100000:3.0:1789304542.811596:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 88 00000100:00100000:3.0:1789304542.811609:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:48741:x1876219765555072:12345-192.168.202.29@tcp:35:dd.0 00000001:00080000:3.0:1789304542.812087:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967624 00000100:00100000:3.0:1789304542.812468:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:48741:x1876219765555072:12345-192.168.202.29@tcp:35:dd.0 Request processed in 859us (1105us total) trans 4294967625 rc 0/0 00000100:00100000:3.0:1789304542.812476:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 88 00000020:00080000:3.0:1789304542.812482:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789304542.996889:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785636096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304542.996981:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304542.997497:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785636096 00000100:00100000:3.0:1789304542.997507:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785636096 00000100:00100000:3.0:1789304542.997567:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1789304542.997577:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785636096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304542.997615:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304542.997677:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785636096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304542.997684:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1789304542.997770:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785636096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304543.078320:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304543.078647:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765555200 00000100:00100000:3.0:1789304543.078659:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765555200 00000100:00100000:3.0:1789304543.078730:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1153 00000100:00100000:3.0:1789304543.078741:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765555200:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304543.078825:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765555200:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304543.078833:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1153 00010000:00010000:2.0:1789304543.579844:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304543.945518:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967625 is committed 00000100:00100000:0.0:1789304544.022551:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785636224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304544.022643:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304544.027457:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785636224 00000100:00100000:0.0:1789304544.027476:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785636224 00000100:00100000:0.0:1789304544.027605:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1789304544.027617:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785636224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304544.027648:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789304544.027734:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785636224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (5090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304544.027742:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1789304544.027784:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:0.0:1789304544.027790:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b02092680, transno 4294967349 00000100:00100000:0.0:1789304544.027812:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785636224:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789304544.029731:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304544.596051:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304545.176548:0:83380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1994854454027ns, next at 1990759847238ns, rc = 0 00000004:00080000:2.0:1789304545.176710:0:83380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1994854619146ns, next at 1992111381441ns, rc = 0 00000004:00080000:1.0:1789304545.208664:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 75 committed 00000004:00080000:1.0:1789304545.208687:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 68 committed 00000100:00100000:0.0:1789304545.555190:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304545.555219:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785636352:0@lo:400:kworker.0 00000100:00100000:0.0:1789304545.555311:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304545.555565:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785636864:0@lo:400:kworker.0 00000100:00100000:3.0:1789304545.555599:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304545.555627:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304545.555632:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785636736:0@lo:400:kworker.0 00000100:00100000:3.0:1789304545.555656:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304545.555685:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785636864 00000100:00100000:3.0:1789304545.555693:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785636864 00000100:00100000:3.0:1789304545.555749:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785636736 00000100:00100000:3.0:1789304545.555752:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785636736 00000100:00100000:3.0:1789304545.555778:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1789304545.555786:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785636864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304545.555841:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785636864:12345-0@lo:400:kworker.0 Request processed in 56us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304545.555848:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1789304545.555866:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1789304545.555873:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785636736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.555985:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785636480:0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.556015:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304545.556033:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785636992:0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.556056:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304545.556075:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304545.556081:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785636608:0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.556157:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304545.556202:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785636480 00000100:00100000:2.0:1789304545.556206:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785636480 00000100:00100000:2.0:1789304545.556229:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:2.0:1789304545.556236:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785636480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.556271:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785636480:12345-0@lo:400:kworker.0 Request processed in 36us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304545.556281:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00080000:2.0:1789304545.556299:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304545.556328:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785636480:0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.556376:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785636864:0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.556398:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785636992 00000100:00100000:2.0:1789304545.556402:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785636992 00000100:00100000:2.0:1789304545.556430:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785636608 00000100:00100000:2.0:1789304545.556433:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785636608 00000100:00100000:2.0:1789304545.556448:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1789304545.556454:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785636992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.556488:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785636992:12345-0@lo:400:kworker.0 Request processed in 35us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304545.556494:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1789304545.556505:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1789304545.556512:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785636608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.556539:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785636608:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304545.556545:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00080000:2.0:1789304545.556558:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304545.556574:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785636608:0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.556583:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785636992:0@lo:400:kworker.0 00000100:00100000:3.0:1789304545.556744:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785636736:12345-0@lo:400:kworker.0 Request processed in 871us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304545.556751:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:1.0:1789304545.557118:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785636352 00000100:00100000:1.0:1789304545.557124:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785636352 00000100:00100000:1.0:1789304545.557171:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1789304545.557179:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785636352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304545.557229:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785636352:12345-0@lo:400:kworker.0 Request processed in 51us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304545.557235:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1789304545.557361:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785636352:0@lo:400:kworker.0 00000100:00100000:2.0:1789304545.557514:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785636736:0@lo:400:kworker.0 00010000:00010000:1.0:1789304545.618669:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304546.376670:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967349 is committed 00000100:00100000:1.0:1789304546.514353:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304546.517280:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765555328 00000100:00100000:3.0:1789304546.517294:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765555328 00000100:00080000:2.0:1789304546.517420:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304546.517467:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 849 00000100:00100000:3.0:1789304546.517479:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:48933:x1876219765555328:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304546.517588:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:48933:x1876219765555328:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 111us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304546.517594:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 849 00000100:00100000:1.0:1789304546.526672:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304546.526744:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765555456 00000100:00100000:3.0:1789304546.526754:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765555456 00000100:00100000:3.0:1789304546.526834:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 459 00000100:00100000:3.0:1789304546.526845:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:48933:x1876219765555456:12345-192.168.202.29@tcp:19:lfs.0 00000100:00080000:1.0:1789304546.527263:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304546.527480:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:48933:x1876219765555456:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 636us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304546.527488:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 459 00000100:00100000:3.0:1789304546.529396:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304546.530203:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765555584 00000100:00100000:1.0:1789304546.530216:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765555584 00000100:00100000:1.0:1789304546.530284:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 460 00000100:00100000:1.0:1789304546.530295:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:48933:x1876219765555584:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304546.530640:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:48933:x1876219765555584:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 346us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304546.530648:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 460 00000100:00080000:3.0:1789304546.530795:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304546.538231:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304546.541241:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765555712 00000100:00100000:3.0:1789304546.541261:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765555712 00000100:00100000:3.0:1789304546.541394:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 850 00000100:00100000:3.0:1789304546.541407:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:48933:x1876219765555712:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304546.541888:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:48933:x1876219765555712:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 483us (3664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304546.541900:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 850 00000100:00100000:1.0:1789304546.552795:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304546.552877:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765555840 00000100:00100000:3.0:1789304546.552889:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765555840 00000100:00100000:3.0:1789304546.552956:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 851 00000100:00100000:3.0:1789304546.552966:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:48933:x1876219765555840:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304546.553059:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:48933:x1876219765555840:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 94us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304546.553067:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 851 00000100:00100000:2.0:1789304546.559161:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304546.559211:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765555968 00000100:00100000:2.0:1789304546.559223:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765555968 00000100:00100000:2.0:1789304546.559278:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 461 00000100:00100000:2.0:1789304546.559289:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:48933:x1876219765555968:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304546.559646:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:48933:x1876219765555968:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 358us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304546.559653:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 461 00000100:00100000:1.0:1789304546.569368:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304546.569396:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765556096 00000100:00100000:1.0:1789304546.569405:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765556096 00000100:00100000:1.0:1789304546.569447:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 462 00000100:00100000:1.0:1789304546.569454:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:48933:x1876219765556096:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304546.569756:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:48933:x1876219765556096:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 300us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304546.569764:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 462 00000100:00100000:2.0:1789304546.572677:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304546.572718:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765556224 00000100:00100000:2.0:1789304546.572727:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765556224 00000100:00100000:2.0:1789304546.572780:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 852 00000100:00100000:2.0:1789304546.572791:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:48933:x1876219765556224:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304546.573249:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:48933:x1876219765556224:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 459us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304546.573257:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 852 00000100:00100000:0.0:1789304546.634721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304546.634788:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765556480 00000100:00100000:3.0:1789304546.634797:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765556480 00000100:00100000:3.0:1789304546.634850:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 853 00000100:00100000:3.0:1789304546.634858:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:48937:x1876219765556480:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:3.0:1789304546.634908:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304546.634936:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312965e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004c9 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.634952:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:3.0:1789304546.634963:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304546.634984:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296604 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.634997:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296604 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.635007:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296604 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.635020:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.635027:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.635034:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.635489:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296612 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.635500:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.635508:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304546.636195:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].27, 64 off9920 00000004:00080000:3.0:1789304546.636206:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1996314115228ns, next at 1997314112954ns, rc = 0 00010000:00010000:3.0:1789304546.636305:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636316:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636323:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636330:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636336:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636345:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636362:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304546.636382:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636388:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296612 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636394:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296612 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636400:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304546.636404:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296612 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636413:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296612 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636423:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:3.0:1789304546.636425:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304546.636430:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296612 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636435:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296612 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636451:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296604 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636456:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296604 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636462:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296604 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636467:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304546.636469:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296604 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636476:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296604 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636482:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:3.0:1789304546.636484:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304546.636487:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296604 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.636492:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296604 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304546.636500:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002efbc43d reply state 0000000006af7d1a transno 4294967626 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304546.636510:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304546.636526:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304546.636533:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304546.636540:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304546.636543:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304546.636548:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304546.636557:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:2.0:1789304546.636560:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789304546.636562:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304546.636567:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296619 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304546.636579:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304546.636581:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304546.636583:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304546.636608:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:48937:x1876219765556480:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1747us (1894us total) trans 4294967626 rc 0/0 00000100:00100000:3.0:1789304546.636615:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 853 00010000:00010000:3.0:1789304546.639014:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.639035:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.639046:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.639052:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304546.639056:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.639064:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.639083:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304546.639086:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304546.639413:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304546.639420:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129660b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304546.643536:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304547.671338:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304548.117070:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304548.118371:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785637120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304548.118448:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304548.124488:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785637120 00000100:00100000:1.0:1789304548.124506:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785637120 00000100:00100000:1.0:1789304548.124641:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1789304548.124654:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785637120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304548.124697:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304548.124788:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785637120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (6339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304548.124795:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00080000:3.0:1789304548.124858:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304548.125366:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:3.0:1789304548.125374:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c385c5880, transno 4294967349 00000100:00100000:3.0:1789304548.125402:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785637120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304548.194628:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304548.194664:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304548.194689:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304548.194722:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304548.194828:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765556608 00000100:00100000:3.0:1789304548.194839:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765556608 00000100:00100000:3.0:1789304548.194894:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1155 00000100:00100000:3.0:1789304548.194903:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765556608:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304548.194968:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765556608:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 66us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304548.194979:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1155 00000100:00100000:3.0:1789304548.195135:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765556736 00000100:00100000:3.0:1789304548.195139:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765556736 00000100:00100000:3.0:1789304548.195181:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1413 00000100:00100000:3.0:1789304548.195188:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765556736:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304548.195227:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765556736:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304548.195233:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1413 00000100:00080000:3.0:1789304548.195248:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304548.197347:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765556864 00000100:00100000:2.0:1789304548.197361:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765556864 00000100:00100000:2.0:1789304548.197482:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765556992 00000100:00100000:2.0:1789304548.197486:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765556992 00000100:00100000:1.0:1789304548.197545:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1052 00000100:00100000:1.0:1789304548.197555:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765556864:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304548.197630:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765556864:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 78us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304548.197637:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1052 00000100:00080000:3.0:1789304548.203749:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304548.203761:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304548.206525:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1053 00000100:00100000:2.0:1789304548.206542:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765556992:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304548.206624:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765556992:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (11899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304548.206631:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1053 00000004:00080000:1.0:1789304548.689758:0:83527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1998367663888ns, next at 1997314112954ns, rc = 0 00010000:00010000:1.0:1789304548.692764:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304548.755633:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 70 committed 00000001:00080000:1.0:1789304548.755666:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967626 is committed 00000004:00080000:1.0:1789304548.755673:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 69 committed 00000100:00100000:2.0:1789304548.755897:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785637248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789304548.755965:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304548.756080:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785637248 00000100:00100000:0.0:1789304548.756121:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785637248 00000100:00100000:0.0:1789304548.756196:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1789304548.756206:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785637248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789304548.756240:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:27 count 1 00010000:00010000:0.0:1789304548.756269:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304548.756291:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1b25883/0xefc0bb72312965f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d0 expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304548.756302:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1b:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1789304548.756306:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304548.756311:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304548.756336:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a1b25883/0xefc0bb72312965f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d0 expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304548.756349:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a1b25883/0xefc0bb72312965f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d0 expref: 5 pid: 6691 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304548.756360:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785637376:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304548.756432:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112fa80 going to sleep for 11 seconds 00000100:00080000:2.0:1789304548.759071:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304548.760223:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785637376:192.168.202.29@tcp:104: 00010000:00010000:1.0:1789304548.760252:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304548.760532:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304548.760657:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765557120 00000100:00100000:2.0:1789304548.760665:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765557120 00010000:00010000:2.0:1789304548.760702:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a1b25883/0xefc0bb72312965f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d0 expref: 6 pid: 6691 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304548.760735:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 380 00000100:00100000:2.0:1789304548.760743:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765557120:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304548.760759:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304548.760763:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a1b25883/0xefc0bb72312965f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d0 expref: 6 pid: 6691 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304548.760776:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a1b25883/0xefc0bb72312965f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d0 expref: 6 pid: 6691 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304548.760799:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1b25883/0xefc0bb72312965f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d0 expref: 6 pid: 6691 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304548.760817:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304548.760822:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304548.760828:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304548.760838:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304548.760858:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304548.760914:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765557120:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 171us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304548.760921:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 380 00010000:00010000:1.0:1789304548.760981:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304548.760990:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304548.761001:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304548.761008:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304548.761029:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789304548.761873:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785637248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5666us (5906us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789304548.761882:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00010000:00010000:2.0:1789304548.762055:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304548.762062:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304548.762072:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304548.762076:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304548.762087:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304548.762132:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304548.762140:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231296620 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304548.762176:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304548.762178:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304548.762179:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304548.762211:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c02f2c000/2, rc 0, transno 4294967351 00000100:00100000:2.0:1789304548.762224:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785637248:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789304548.767432:0:83527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1998445338900ns, next at 1992111381441ns, rc = 0 00000004:00080000:1.0:1789304548.769478:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 76 committed 00000100:00100000:0.0:1789304549.147139:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304549.147478:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785637504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304549.147558:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304549.148520:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785637504 00000100:00100000:3.0:1789304549.148533:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785637504 00000100:00100000:3.0:1789304549.148593:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1789304549.148602:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785637504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304549.148641:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789304549.148723:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785637504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304549.148731:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1789304549.150073:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785637504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304549.714612:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304550.676498:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785638016:0@lo:400:kworker.0 00000100:00100000:2.0:1789304550.676576:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304550.676648:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304550.676655:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785637888:0@lo:400:kworker.0 00000100:00100000:2.0:1789304550.676681:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304550.676712:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785638016 00000100:00100000:2.0:1789304550.676719:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785638016 00000100:00100000:2.0:1789304550.676772:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1789304550.676782:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785638016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304550.676830:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785638016:12345-0@lo:400:kworker.0 Request processed in 50us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304550.676837:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1789304550.676872:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785637888 00000100:00100000:2.0:1789304550.676877:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785637888 00000100:00100000:2.0:1789304550.676903:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1789304550.676909:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785637888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304550.676938:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785637888:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304550.676943:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:2.0:1789304550.676968:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304550.676973:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304550.677004:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785637888:0@lo:400:kworker.0 00000100:00100000:2.0:1789304550.677012:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785638016:0@lo:400:kworker.0 00000100:00100000:3.0:1789304550.677375:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785637632:0@lo:400:kworker.0 00000100:00100000:3.0:1789304550.677411:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304550.677447:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785638144:0@lo:400:kworker.0 00000100:00100000:3.0:1789304550.677468:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304550.677494:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789304550.677500:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785637760:0@lo:400:kworker.0 00000100:00100000:3.0:1789304550.677521:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304550.677535:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785638272:0@lo:400:kworker.0 00000100:00100000:3.0:1789304550.677551:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304550.677571:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785638144 00000100:00100000:3.0:1789304550.677575:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785638144 00000100:00100000:3.0:1789304550.677600:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785637760 00000100:00100000:3.0:1789304550.677602:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785637760 00000100:00100000:3.0:1789304550.677616:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1789304550.677622:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785638144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304550.677657:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785638144:12345-0@lo:400:kworker.0 Request processed in 35us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304550.677663:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1789304550.677675:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1789304550.677681:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785637760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304550.677703:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785637760:12345-0@lo:400:kworker.0 Request processed in 23us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304550.677708:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1789304550.677735:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785637760:0@lo:400:kworker.0 00000100:00100000:3.0:1789304550.677743:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785638144:0@lo:400:kworker.0 00000100:00100000:1.0:1789304550.677810:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785637632 00000100:00100000:1.0:1789304550.677814:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785637632 00000100:00100000:1.0:1789304550.677846:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1789304550.677852:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785637632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304550.677898:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785637632:12345-0@lo:400:kworker.0 Request processed in 46us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304550.677904:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1789304550.677933:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785637632:0@lo:400:kworker.0 00000100:00100000:0.0:1789304550.680297:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785638272 00000100:00100000:0.0:1789304550.680313:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785638272 00000100:00100000:0.0:1789304550.680385:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1789304550.680396:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785638272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304550.680484:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785638272:12345-0@lo:400:kworker.0 Request processed in 92us (2931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304550.680491:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00080000:2.0:1789304550.680647:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304550.680652:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304550.683379:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785638272:0@lo:400:kworker.0 00010000:00010000:1.0:1789304550.744672:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304551.761932:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00010000:00010000:2.0:1789304551.763590:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304552.786369:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304553.234484:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785638400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304553.234571:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304553.234766:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785638400 00000100:00100000:3.0:1789304553.234775:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785638400 00000100:00100000:3.0:1789304553.234851:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1789304553.234862:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785638400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304553.234896:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304553.234945:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785638400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304553.234952:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00080000:0.0:1789304553.235049:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304553.235304:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785638400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304553.313776:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304553.314012:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765557248 00000100:00100000:1.0:1789304553.314025:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765557248 00000100:00100000:1.0:1789304553.314087:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1157 00000100:00100000:1.0:1789304553.314146:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765557248:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304553.314234:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765557248:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 90us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304553.314242:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1157 00000100:00100000:0.0:1789304553.314984:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304553.315013:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304553.315044:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304553.315222:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765557504 00000100:00100000:2.0:1789304553.315230:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765557504 00000100:00100000:2.0:1789304553.315288:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765557632 00000100:00100000:2.0:1789304553.315291:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765557632 00000100:00100000:2.0:1789304553.315316:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1056 00000100:00100000:2.0:1789304553.315324:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765557504:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304553.315373:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765557504:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 49us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304553.315380:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1056 00000100:00100000:2.0:1789304553.315396:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1057 00000100:00100000:2.0:1789304553.315403:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765557632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304553.315441:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765557632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304553.315447:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1057 00000100:00100000:3.0:1789304553.315873:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765557376 00000100:00100000:3.0:1789304553.315878:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765557376 00000100:00100000:3.0:1789304553.315974:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1417 00000100:00100000:3.0:1789304553.315984:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765557376:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304553.316022:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765557376:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304553.316029:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1417 00000100:00080000:0.0:1789304553.318451:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304553.318463:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304553.318466:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304553.810389:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304554.258830:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304554.258863:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785638528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304554.258954:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304554.272639:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785638528 00000100:00100000:3.0:1789304554.272653:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785638528 00000100:00100000:3.0:1789304554.272723:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1789304554.272735:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785638528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304554.272776:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304554.272862:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785638528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (13907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304554.272869:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00080000:3.0:1789304554.272905:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304554.272940:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000004:00080000:3.0:1789304554.272945:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c02f2c000, transno 4294967351 00000100:00100000:3.0:1789304554.272977:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785638528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304554.834323:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304555.817720:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785638912:0@lo:400:kworker.0 00000100:00100000:3.0:1789304555.817805:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304555.817890:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304555.817897:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785639040:0@lo:400:kworker.0 00000100:00100000:3.0:1789304555.817929:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304555.817964:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785638912 00000100:00100000:3.0:1789304555.817972:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785638912 00000100:00100000:3.0:1789304555.818026:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1789304555.818049:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785638912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304555.818204:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785638656:0@lo:400:kworker.0 00000100:00100000:2.0:1789304555.819297:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785638784:0@lo:400:kworker.0 00000100:00100000:0.0:1789304555.821826:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304555.821898:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785639168:0@lo:400:kworker.0 00000100:00100000:0.0:1789304555.821935:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304555.822000:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785638656 00000100:00100000:0.0:1789304555.822009:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785638656 00000100:00100000:0.0:1789304555.822066:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1789304555.822077:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785638656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304555.822699:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785638656:12345-0@lo:400:kworker.0 Request processed in 623us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304555.822708:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1789304555.822754:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785639040 00000100:00100000:0.0:1789304555.822760:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785639040 00000100:00100000:0.0:1789304555.822803:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785639168 00000100:00100000:0.0:1789304555.822807:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785639168 00000100:00100000:0.0:1789304555.822827:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1789304555.822833:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785639040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304555.824585:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785638912:12345-0@lo:400:kworker.0 Request processed in 6544us (6773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304555.824599:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1789304555.824730:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1789304555.824746:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785639168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304555.824811:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785639168:12345-0@lo:400:kworker.0 Request processed in 73us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304555.824817:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1789304555.825241:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785639040:12345-0@lo:400:kworker.0 Request processed in 1603us (6505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304555.825249:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1789304555.828371:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785638656:0@lo:400:kworker.0 00000100:00100000:0.0:1789304555.828393:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785639168:0@lo:400:kworker.0 00000100:00080000:0.0:1789304555.828432:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304555.828476:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785639040:0@lo:400:kworker.0 00000100:00100000:0.0:1789304555.828488:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785638912:0@lo:400:kworker.0 00000100:00100000:0.0:1789304555.829814:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304555.829854:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785639296:0@lo:400:kworker.0 00000100:00100000:0.0:1789304555.829899:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304555.830075:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785639296 00000100:00100000:3.0:1789304555.830109:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785639296 00000100:00100000:3.0:1789304555.830177:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1789304555.830188:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785639296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304555.830250:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785639296:12345-0@lo:400:kworker.0 Request processed in 65us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304555.830256:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1789304555.830640:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785638784 00000100:00100000:2.0:1789304555.830647:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785638784 00000100:00100000:2.0:1789304555.830689:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:2.0:1789304555.830698:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785638784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304555.830740:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785638784:12345-0@lo:400:kworker.0 Request processed in 44us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304555.830747:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00080000:0.0:1789304555.832415:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304555.832486:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785638784:0@lo:400:kworker.0 00000100:00100000:0.0:1789304555.832501:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785639296:0@lo:400:kworker.0 00010000:00010000:2.0:1789304555.861393:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304556.882404:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304557.906432:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304558.354758:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785639424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304558.354842:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304558.355147:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785639424 00000100:00100000:3.0:1789304558.355156:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785639424 00000100:00100000:3.0:1789304558.355218:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1789304558.355229:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785639424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304558.355266:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304558.355328:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785639424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304558.355336:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1789304558.355463:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785639424:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304558.355522:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304558.433422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304558.433475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304558.433521:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304558.433545:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304558.433567:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765557760 00000100:00100000:3.0:1789304558.433578:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765557760 00000100:00100000:3.0:1789304558.433638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1159 00000100:00100000:3.0:1789304558.433649:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765557760:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304558.433720:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765557760:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304558.433728:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1159 00000100:00100000:3.0:1789304558.433765:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765558144 00000100:00100000:3.0:1789304558.433769:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765558144 00000100:00100000:3.0:1789304558.433803:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765558016 00000100:00100000:3.0:1789304558.433806:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765558016 00000100:00100000:3.0:1789304558.433828:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1060 00000100:00100000:3.0:1789304558.433836:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765558144:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304558.433863:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765558144:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304558.433869:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1060 00000100:00100000:3.0:1789304558.433879:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1061 00000100:00100000:3.0:1789304558.433885:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765558016:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304558.433924:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765558016:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304558.433930:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1061 00000100:00080000:0.0:1789304558.434396:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304558.434401:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304558.438135:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765557888 00000100:00100000:2.0:1789304558.438152:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765557888 00000100:00100000:2.0:1789304558.438236:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1421 00000100:00100000:2.0:1789304558.438247:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765557888:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304558.438318:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765557888:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 74us (4916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304558.438324:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1421 00000100:00080000:0.0:1789304558.438884:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304558.930452:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304559.378557:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304559.378584:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785639552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304559.378676:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304559.379191:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785639552 00000100:00100000:3.0:1789304559.379202:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785639552 00000100:00100000:3.0:1789304559.379271:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1789304559.379280:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785639552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304559.379317:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304559.379370:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785639552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304559.379378:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00080000:3.0:1789304559.379398:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304559.379492:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785639552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304559.955028:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304560.914519:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785639936:0@lo:400:kworker.0 00000100:00100000:3.0:1789304560.914598:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304560.914691:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304560.914698:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785640064:0@lo:400:kworker.0 00000100:00100000:3.0:1789304560.914731:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304560.914768:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785640064 00000100:00100000:3.0:1789304560.914778:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785640064 00000100:00100000:3.0:1789304560.914833:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1789304560.914843:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785640064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304560.914897:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785640064:12345-0@lo:400:kworker.0 Request processed in 56us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304560.914905:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00080000:3.0:1789304560.914926:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304560.914957:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785640064:0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915135:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785639680:0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915174:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304560.915209:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785640192:0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915232:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304560.915253:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789304560.915258:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785639808:0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915278:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304560.915294:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785640320:0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915313:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304560.915342:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785640192 00000100:00100000:2.0:1789304560.915346:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785640192 00000100:00100000:2.0:1789304560.915372:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785639808 00000100:00100000:2.0:1789304560.915375:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785639808 00000100:00100000:2.0:1789304560.915388:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1789304560.915407:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785640192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915443:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785640192:12345-0@lo:400:kworker.0 Request processed in 49us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304560.915450:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1789304560.915465:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1789304560.915471:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785639808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915500:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785639808:12345-0@lo:400:kworker.0 Request processed in 29us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304560.915506:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1789304560.915530:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785639936 00000100:00100000:2.0:1789304560.915533:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785639936 00000100:00100000:2.0:1789304560.915553:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785640320 00000100:00100000:2.0:1789304560.915556:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785640320 00000100:00100000:2.0:1789304560.915575:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1789304560.915581:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785639936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915611:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785639936:12345-0@lo:400:kworker.0 Request processed in 31us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304560.915617:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1789304560.915627:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:2.0:1789304560.915633:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785640320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915655:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785640320:12345-0@lo:400:kworker.0 Request processed in 23us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304560.915660:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:2.0:1789304560.915681:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785639808:0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915689:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785640320:0@lo:400:kworker.0 00000100:00100000:2.0:1789304560.915695:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785640192:0@lo:400:kworker.0 00000100:00100000:3.0:1789304560.915964:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785639680 00000100:00100000:3.0:1789304560.915970:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785639680 00000100:00100000:3.0:1789304560.916014:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1789304560.916021:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785639680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304560.916074:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785639680:12345-0@lo:400:kworker.0 Request processed in 54us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304560.916081:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00080000:3.0:1789304560.916130:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304560.916134:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304560.916151:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785639680:0@lo:400:kworker.0 00000100:00100000:3.0:1789304560.916176:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785639936:0@lo:400:kworker.0 00010000:00010000:2.0:1789304560.978386:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304562.002659:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304563.028044:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304563.474707:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785640448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304563.474807:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304563.475018:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785640448 00000100:00100000:3.0:1789304563.475028:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785640448 00000100:00100000:3.0:1789304563.475121:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1789304563.475132:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785640448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304563.475180:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789304563.475221:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304563.475249:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785640448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304563.475256:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1789304563.475375:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785640448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304563.553784:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304563.553830:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304563.553872:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304563.553908:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304563.554027:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765558656 00000100:00100000:3.0:1789304563.554040:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765558656 00000100:00100000:3.0:1789304563.554146:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765558528 00000100:00100000:3.0:1789304563.554150:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765558528 00000100:00100000:3.0:1789304563.554176:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1064 00000100:00100000:3.0:1789304563.554186:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765558656:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304563.554256:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765558656:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 72us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304563.554264:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1064 00000100:00100000:3.0:1789304563.554281:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1065 00000100:00100000:3.0:1789304563.554287:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765558528:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304563.554325:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765558528:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304563.554331:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1065 00000100:00080000:0.0:1789304563.554510:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304563.554514:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304563.554631:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765558272 00000100:00100000:1.0:1789304563.554636:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765558272 00000100:00100000:1.0:1789304563.554680:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1161 00000100:00100000:1.0:1789304563.554688:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765558272:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304563.554729:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765558272:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 43us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304563.554736:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1161 00000100:00100000:2.0:1789304563.555133:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765558400 00000100:00100000:2.0:1789304563.555138:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765558400 00000100:00100000:2.0:1789304563.555187:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1425 00000100:00100000:2.0:1789304563.555195:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765558400:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304563.555232:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765558400:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304563.555239:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1425 00000100:00080000:0.0:1789304563.555318:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304564.050341:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304564.500852:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785640576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304564.500938:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304564.501236:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785640576 00000100:00100000:3.0:1789304564.501254:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785640576 00000100:00100000:3.0:1789304564.501313:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1789304564.501321:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785640576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304564.501357:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304564.501409:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785640576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304564.501416:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1789304564.501458:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785640576:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304564.501579:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304565.074469:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304566.034612:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785640704:0@lo:400:kworker.0 00000100:00100000:3.0:1789304566.034694:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304566.034799:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785640704 00000100:00100000:2.0:1789304566.034808:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785640704 00000100:00100000:0.0:1789304566.034828:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785640832:0@lo:400:kworker.0 00000100:00100000:2.0:1789304566.034860:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1789304566.034870:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785640704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304566.034873:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304566.034950:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785640832 00000100:00100000:0.0:1789304566.034954:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785640832 00000100:00100000:0.0:1789304566.034984:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:0.0:1789304566.035000:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785640832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304566.035039:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785640832:12345-0@lo:400:kworker.0 Request processed in 39us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304566.035046:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:0.0:1789304566.035085:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785640832:0@lo:400:kworker.0 00000100:00100000:1.0:1789304566.038925:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785640960:0@lo:400:kworker.0 00000100:00100000:1.0:1789304566.039020:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304566.039061:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304566.039067:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785641088:0@lo:400:kworker.0 00000100:00100000:1.0:1789304566.039110:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304566.039144:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785641088 00000100:00100000:1.0:1789304566.039152:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785641088 00000100:00100000:1.0:1789304566.039214:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1789304566.039223:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785641088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304566.039275:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785641088:12345-0@lo:400:kworker.0 Request processed in 54us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304566.039282:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1789304566.039324:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785641088:0@lo:400:kworker.0 00000100:00100000:1.0:1789304566.039378:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785640960 00000100:00100000:1.0:1789304566.039383:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785640960 00000100:00100000:1.0:1789304566.039411:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1789304566.039418:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785640960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304566.039451:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785640960:12345-0@lo:400:kworker.0 Request processed in 34us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304566.039456:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1789304566.039497:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785640960:0@lo:400:kworker.0 00000100:00100000:2.0:1789304566.043609:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785640704:12345-0@lo:400:kworker.0 Request processed in 8730us (8905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304566.043624:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00080000:0.0:1789304566.045682:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304566.045696:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304566.045725:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785641344:0@lo:400:kworker.0 00000100:00100000:0.0:1789304566.045800:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304566.045861:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304566.045869:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785641216:0@lo:400:kworker.0 00000100:00100000:0.0:1789304566.045896:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304566.045933:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785641216 00000100:00100000:0.0:1789304566.045952:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785641216 00000100:00100000:2.0:1789304566.046244:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785641344 00000100:00100000:2.0:1789304566.046250:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785641344 00000100:00100000:2.0:1789304566.046292:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1789304566.046304:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785641344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304566.046379:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785641344:12345-0@lo:400:kworker.0 Request processed in 78us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304566.046386:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00080000:1.0:1789304566.046655:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304566.046659:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304566.046693:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785641344:0@lo:400:kworker.0 00000100:00100000:0.0:1789304566.046792:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:0.0:1789304566.046802:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785641216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304566.046840:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785641216:12345-0@lo:400:kworker.0 Request processed in 41us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304566.046858:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1789304566.047734:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785641216:0@lo:400:kworker.0 00000100:00100000:3.0:1789304566.049657:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785640704:0@lo:400:kworker.0 00010000:00010000:1.0:1789304566.098338:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304566.909178:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304566.909232:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765558784 00000100:00100000:3.0:1789304566.909243:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765558784 00000100:00100000:3.0:1789304566.909308:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 854 00000100:00100000:3.0:1789304566.909320:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49196:x1876219765558784:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304566.909410:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49196:x1876219765558784:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304566.909417:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 854 00000100:00080000:3.0:1789304566.909439:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304566.912287:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304566.914971:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765558912 00000100:00100000:3.0:1789304566.915109:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765558912 00000100:00100000:3.0:1789304566.915192:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 464 00000100:00100000:3.0:1789304566.915204:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:49196:x1876219765558912:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304566.915622:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:49196:x1876219765558912:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 420us (3345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304566.915631:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 464 00000100:00080000:3.0:1789304566.915654:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304566.919298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304566.919365:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765559040 00000100:00100000:3.0:1789304566.919376:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765559040 00000100:00100000:3.0:1789304566.919435:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 465 00000100:00100000:3.0:1789304566.919445:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:49196:x1876219765559040:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304566.919917:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:49196:x1876219765559040:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 473us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304566.919925:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 465 00000100:00080000:3.0:1789304566.919956:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304566.925599:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304566.925872:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765559168 00000100:00100000:0.0:1789304566.925887:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765559168 00000100:00100000:0.0:1789304566.925963:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 855 00000100:00100000:0.0:1789304566.925976:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:49196:x1876219765559168:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304566.926914:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:49196:x1876219765559168:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 936us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304566.926924:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 855 00000100:00100000:3.0:1789304566.933623:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304566.934029:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765559296 00000100:00100000:0.0:1789304566.934041:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765559296 00000100:00100000:0.0:1789304566.934129:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 856 00000100:00100000:0.0:1789304566.934141:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49196:x1876219765559296:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304566.934240:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49196:x1876219765559296:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 102us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304566.934248:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 856 00000100:00100000:3.0:1789304566.937453:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304566.939375:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765559424 00000100:00100000:1.0:1789304566.939398:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765559424 00000100:00100000:1.0:1789304566.939480:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 466 00000100:00100000:1.0:1789304566.939502:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:49196:x1876219765559424:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304566.940759:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:49196:x1876219765559424:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 1263us (3379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304566.940787:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 466 00000100:00100000:3.0:1789304566.946530:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304566.946565:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765559552 00000100:00100000:3.0:1789304566.946575:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765559552 00000100:00100000:3.0:1789304566.946629:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 467 00000100:00100000:3.0:1789304566.946640:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:49196:x1876219765559552:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304566.947066:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:49196:x1876219765559552:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 427us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304566.947074:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 467 00000100:00100000:2.0:1789304566.954577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304566.959530:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765559680 00000100:00100000:0.0:1789304566.959547:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765559680 00000100:00100000:0.0:1789304566.959612:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 857 00000100:00100000:0.0:1789304566.959624:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:49196:x1876219765559680:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304566.961674:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:49196:x1876219765559680:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 2043us (7102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304566.961688:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 857 00010000:00010000:2.0:1789304567.128604:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304568.146350:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304568.595160:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304568.595196:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785641472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304568.595280:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304568.595359:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785641472 00000100:00100000:2.0:1789304568.595369:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785641472 00000100:00100000:2.0:1789304568.595432:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1789304568.595445:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785641472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304568.595480:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304568.595530:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785641472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304568.595536:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00080000:2.0:1789304568.595559:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304568.595598:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785641472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304568.696489:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304568.696531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304568.696555:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304568.696578:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304568.696601:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765560064 00000100:00100000:1.0:1789304568.696611:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765560064 00000100:00100000:1.0:1789304568.696670:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765560192 00000100:00100000:1.0:1789304568.696673:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765560192 00000100:00100000:1.0:1789304568.696700:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1068 00000100:00100000:1.0:1789304568.696711:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765560064:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304568.696788:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765560064:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304568.696796:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1068 00000100:00100000:1.0:1789304568.696813:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1069 00000100:00100000:1.0:1789304568.696820:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765560192:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304568.696846:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765560192:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304568.696852:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1069 00000100:00100000:1.0:1789304568.696872:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765559936 00000100:00100000:1.0:1789304568.696875:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765559936 00000100:00100000:1.0:1789304568.696902:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1429 00000100:00100000:1.0:1789304568.696908:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765559936:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304568.698131:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765559808 00000100:00100000:0.0:1789304568.698142:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765559808 00000100:00100000:0.0:1789304568.698212:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1163 00000100:00100000:0.0:1789304568.698223:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765559808:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304568.698279:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765559808:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 58us (1799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304568.698286:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1163 00000100:00080000:0.0:1789304568.698713:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304568.698720:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304568.698722:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304568.700930:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765559936:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 4001us (4352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304568.700945:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1429 00000100:00100000:3.0:1789304568.877526:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304568.877755:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765560320 00000100:00100000:1.0:1789304568.877767:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765560320 00000100:00100000:1.0:1789304568.877835:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 858 00000100:00100000:1.0:1789304568.877846:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49210:x1876219765560320:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304568.877868:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304568.877891:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231296627 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004d7 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.878362:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129662e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.878378:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129662e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.878391:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129662e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304568.878426:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:1.0:1789304568.878430:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304568.878449:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129662e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.878475:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231296627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d7 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.878492:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129662e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d7 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.878500:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:1.0:1789304568.878503:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304568.878507:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371600, rc 0) 00000100:00100000:1.0:1789304568.878970:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:49210:x1876219765560320:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 1124us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304568.878978:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 858 00000100:00100000:1.0:1789304568.890336:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304568.890410:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765560576 00000100:00100000:0.0:1789304568.890422:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765560576 00000100:00100000:0.0:1789304568.890484:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 859 00000100:00100000:0.0:1789304568.890495:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:49210:x1876219765560576:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304568.890550:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304568.890580:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129662e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004d7 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304568.890602:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312965cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004c2 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304568.890614:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:0.0:1789304568.890626:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304568.890655:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304568.890668:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304568.890682:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789304568.942610:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967627 is committed 00000004:00010000:3.0:1789304568.942698:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0857f20 reply state 0000000043de6ce7 transno 4294967627 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304568.942714:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304568.942730:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00080000:3.0:1789304568.942966:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304568.942991:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:49210:x1876219765560576:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 52494us (52659us total) trans 4294967627 rc 0/0 00000100:00100000:3.0:1789304568.943007:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 859 00010000:00010000:1.0:1789304568.943198:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.943209:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.943217:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.943223:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304568.943228:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.943235:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.943249:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d500) 00010000:00010000:1.0:1789304568.943252:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304568.943257:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304568.943263:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296635 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304569.017933:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304569.018030:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765560704 00000100:00100000:3.0:1789304569.018041:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765560704 00000100:00100000:3.0:1789304569.018150:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 860 00000100:00100000:3.0:1789304569.018163:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:49213:x1876219765560704:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304569.018196:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304569.018220:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129663c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004de expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018294:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296643 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018311:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296643 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018326:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296643 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018343:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb723129664a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018350:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb723129664a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018357:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb723129664a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018744:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018754:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018761:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304569.018780:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:3.0:1789304569.018784:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304569.018804:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018815:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296643 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018822:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296643 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018834:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296643 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018840:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304569.018844:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296643 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018850:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296643 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018862:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:3.0:1789304569.018865:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304569.018870:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296643 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018876:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018889:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb723129664a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018893:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb723129664a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018898:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb723129664a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018902:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304569.018904:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb723129664a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018927:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb723129664a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018935:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304569.018937:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304569.018940:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb723129664a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018944:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb723129664a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018970:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129663c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004de expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018982:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004de expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.018988:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304569.018990:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304569.018992:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789304569.019058:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:49213:x1876219765560704:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 899us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304569.019067:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 860 00000100:00100000:2.0:1789304569.026374:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304569.026537:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765560960 00000100:00100000:1.0:1789304569.026549:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765560960 00000100:00100000:1.0:1789304569.026617:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 861 00000100:00100000:1.0:1789304569.026629:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49213:x1876219765560960:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:1.0:1789304569.026651:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304569.026674:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231296658 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004e5 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.026955:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb723129665f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.026979:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb723129665f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.026991:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb723129665f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.027006:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.027013:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.027019:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789304569.027736:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b:0x0], index 1: 0 00010000:00010000:1.0:1789304569.029355:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129666d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029381:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129666d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029397:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129666d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029477:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb723129665f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029489:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb723129665f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029495:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb723129665f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029500:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304569.029506:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb723129665f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029513:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb723129665f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029526:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:1.0:1789304569.029529:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304569.029534:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb723129665f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029540:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb723129665f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304569.029556:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009976b212 reply state 00000000b7e2a878 transno 4294967628 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304569.029565:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789304569.029614:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231296658 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004e5 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029630:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129666d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004e5 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.029642:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9e2c14add400) 00010000:00010000:1.0:1789304569.029644:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304569.029646:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371a00, rc 0) 00000100:00100000:1.0:1789304569.029729:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:49213:x1876219765560960:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 3103us (3366us total) trans 4294967628 rc 0/0 00000100:00100000:1.0:1789304569.029738:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 861 00000100:00100000:2.0:1789304569.037685:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304569.037783:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765561216 00000100:00100000:3.0:1789304569.037796:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765561216 00000100:00100000:3.0:1789304569.037870:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 862 00000100:00100000:3.0:1789304569.037882:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:49213:x1876219765561216:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:3.0:1789304569.037958:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304569.037998:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129666d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004e5 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.038021:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9e2c14add400) 00010000:00010000:3.0:1789304569.038035:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304569.038081:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.038119:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.038132:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304569.038280:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ef9866c reply state 000000008a33c149 transno 4294967629 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304569.038290:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304569.038400:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:49213:x1876219765561216:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 519us (726us total) trans 4294967629 rc 0/0 00000100:00100000:3.0:1789304569.038409:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 862 00010000:00010000:1.0:1789304569.041451:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.041475:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.041485:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.041492:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304569.041497:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.041505:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.041521:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c14add300) 00010000:00010000:1.0:1789304569.041524:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304569.041529:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.041536:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296666 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.041673:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.041682:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.041689:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.041695:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304569.041698:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.041705:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.041715:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:2.0:1789304569.041718:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304569.041721:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.041731:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb723129667b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304569.043721:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304569.043937:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765561344 00000100:00100000:3.0:1789304569.043950:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765561344 00000100:00100000:3.0:1789304569.044036:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 863 00000100:00100000:3.0:1789304569.044046:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:49213:x1876219765561344:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304569.044076:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304569.044122:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004ec expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.044210:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004ec expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.044226:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004ec expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.044248:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:3.0:1789304569.044251:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789304569.044256:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304569.044314:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:49213:x1876219765561344:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 269us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304569.044321:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 863 00000100:00100000:3.0:1789304569.046681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304569.046960:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765561472 00000100:00100000:2.0:1789304569.046972:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765561472 00000100:00100000:2.0:1789304569.047036:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 468 00000100:00100000:2.0:1789304569.047046:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765561472:12345-192.168.202.29@tcp:2:touch.60003 00000100:00100000:2.0:1789304569.047439:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765561472:12345-192.168.202.29@tcp:2:touch.60003 Request processed in 392us (764us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789304569.047449:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 468 00000100:00100000:3.0:1789304569.061180:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304569.061366:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765561728 00000100:00100000:1.0:1789304569.061380:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765561728 00000100:00100000:1.0:1789304569.061454:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 89 00000100:00100000:1.0:1789304569.061465:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:49213:x1876219765561728:12345-192.168.202.29@tcp:35:touch.60003 00000100:00100000:1.0:1789304569.061823:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:49213:x1876219765561728:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 359us (652us total) trans 4294967630 rc 0/0 00000100:00100000:1.0:1789304569.061832:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 89 00000100:00100000:3.0:1789304569.133872:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304569.133906:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765561856 00000100:00100000:3.0:1789304569.133928:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765561856 00000100:00100000:3.0:1789304569.133992:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 864 00000100:00100000:3.0:1789304569.134003:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:49218:x1876219765561856:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:3.0:1789304569.134029:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304569.134053:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296689 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004f3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134149:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296690 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134175:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296690 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134186:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296690 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134202:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296697 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134209:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134216:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134312:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129669e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134321:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129669e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134328:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129669e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304569.134363:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x47:0x0]: returning size 0 00000004:00200000:3.0:1789304569.134368:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304569.134388:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129669e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134402:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129669e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134415:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296690 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134422:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296690 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134428:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296690 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134435:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304569.134439:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296690 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134447:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296690 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134458:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304569.134461:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304569.134466:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296690 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134472:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296690 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134484:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134490:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296697 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134497:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134503:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304569.134507:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134513:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296697 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134522:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304569.134525:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304569.134528:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296697 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134534:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296697 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134563:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296689 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004f3 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134577:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129669e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004f3 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.134584:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:3.0:1789304569.134587:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304569.134589:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f800, rc 0) 00000100:00100000:2.0:1789304569.139391:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:49218:x1876219765561856:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 5376us (5514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304569.139405:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 864 00000100:00100000:3.0:1789304569.149678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304569.149783:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765561984 00000100:00100000:0.0:1789304569.149796:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765561984 00000100:00100000:0.0:1789304569.149924:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 469 00000100:00100000:0.0:1789304569.149936:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765561984:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:0.0:1789304569.149964:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304569.149994:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb72312966a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861004fa expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304569.150386:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x6aa69ef9, atime: 0x6aa69ef9, ctime: 0x6aa69ef9, blocks: 0x1 00010000:00010000:0.0:1789304569.150405:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=2018s v=(0 0) 00010000:00010000:0.0:1789304569.150410:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304569.150419:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb72312966a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004fa expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304569.150439:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb72312966a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004fa expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304569.150452:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afaa00, rc 0) 00000100:00100000:0.0:1789304569.150546:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765561984:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 613us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304569.150554:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 469 00000100:00100000:0.0:1789304569.158745:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304569.158868:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765562240 00000100:00100000:2.0:1789304569.158881:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765562240 00000100:00100000:2.0:1789304569.159193:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 865 00000100:00100000:2.0:1789304569.159206:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:49218:x1876219765562240:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:2.0:1789304569.159269:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304569.159302:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129669e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004f3 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.159328:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004ec expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.159342:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:2.0:1789304569.159356:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304569.159380:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312966ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.159396:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312966ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.159407:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312966ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.159422:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.159429:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.159436:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.159561:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312966ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.159569:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312966ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.159576:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312966ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304569.160689:0:30980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].27, 64 off9920 00000004:00080000:2.0:1789304569.160704:0:30980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2018838613152ns, next at 2019838610469ns, rc = 0 00010000:00010000:2.0:1789304569.160768:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.160785:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.160795:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.160803:0:30980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.160809:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.160815:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.160892:0:30980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304569.160930:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312966ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.160937:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312966ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.160944:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312966ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.160950:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304569.160955:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312966ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.161086:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312966ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.161131:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:2.0:1789304569.161134:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304569.161139:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312966ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.161145:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312966ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.161219:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312966ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.161226:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312966ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.161232:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312966ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.161237:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304569.161240:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312966ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.161246:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312966ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.161254:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:2.0:1789304569.161257:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304569.161260:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312966ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304569.161265:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312966ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304569.161280:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000382792d2 reply state 00000000e055b56d transno 4294967631 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304569.161290:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304569.161424:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:49218:x1876219765562240:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 2218us (2687us total) trans 4294967631 rc 0/0 00000100:00100000:2.0:1789304569.161434:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 865 00010000:00010000:3.0:1789304569.166389:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.166410:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.166419:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.166425:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304569.166430:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.166438:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.166458:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c421d2d00) 00010000:00010000:3.0:1789304569.166462:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304569.166468:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304569.166475:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312966b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.172080:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304569.172121:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.172134:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304569.172139:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.172151:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.172183:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:1.0:1789304569.172186:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304569.172194:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.172201:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312966c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304569.172229:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304569.172231:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304569.172234:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304569.180509:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304569.625721:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785641600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304569.625805:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304569.625878:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785641600 00000100:00100000:2.0:1789304569.625886:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785641600 00000100:00100000:2.0:1789304569.625951:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1789304569.625961:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785641600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304569.625999:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304569.626047:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785641600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304569.626055:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1789304569.626121:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785641600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304569.629663:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304570.029524:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304570.029649:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765562368 00000100:00100000:3.0:1789304570.029661:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765562368 00000100:00100000:3.0:1789304570.029744:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 866 00000100:00100000:3.0:1789304570.029758:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:49238:x1876219765562368:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304570.029783:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304570.029806:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100501 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.029879:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.029899:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.029926:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789304570.029937:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1789304570.029970:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:3.0:1789304570.029975:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304570.029997:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.030028:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100501 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.030050:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100501 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.030059:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304570.030063:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304570.030066:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f400, rc 0) 00000100:00100000:3.0:1789304570.030139:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:49238:x1876219765562368:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 385us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304570.030147:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 866 00000100:00100000:3.0:1789304570.033564:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304570.033605:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765562624 00000100:00100000:3.0:1789304570.033615:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765562624 00000100:00100000:3.0:1789304570.033669:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 867 00000100:00100000:3.0:1789304570.033679:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:49238:x1876219765562624:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304570.033741:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304570.033769:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100501 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.033787:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004de expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.033798:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304570.033810:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304570.033836:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.033849:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.033859:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789304570.094200:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967630 is committed 00000001:00080000:1.0:1789304570.094220:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967631 is committed 00000004:00080000:1.0:1789304570.094224:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 77 committed 00000001:00080000:1.0:1789304570.094237:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967632 is committed 00000004:00010000:3.0:1789304570.094299:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002457d495 reply state 00000000283d80ed transno 4294967632 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304570.094313:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304570.094326:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000100:00100000:1.0:1789304570.094376:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785641728:0@lo:6:osp-syn-1-0.0 00010000:00080000:3.0:1789304570.094423:0:5852:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304570.094439:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49238:x1876219765562624:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 60759us (60883us total) trans 4294967632 rc 0/0 00000100:00100000:3.0:1789304570.094449:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 867 00000100:00100000:1.0:1789304570.099009:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304570.099114:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785641728 00000100:00100000:3.0:1789304570.099126:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785641728 00000100:00100000:3.0:1789304570.099229:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1789304570.099240:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785641728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789304570.099277:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:27 count 1 00010000:00010000:3.0:1789304570.099305:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.099330:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb72312966a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004fa expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.099341:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789304570.099345:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304570.099350:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.099384:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb72312966a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004fa expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.099400:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb72312966a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004fa expref: 6 pid: 6691 timeout: 2119 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304570.099414:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785641856:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304570.099477:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752840 going to sleep for 11 seconds 00000100:00080000:1.0:1789304570.099594:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789304570.100406:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.100420:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.100432:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.100439:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304570.100444:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.100452:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.100470:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304570.100473:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304570.100478:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.100485:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304570.110353:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304570.110516:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765562752 00000100:00100000:1.0:1789304570.110531:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765562752 00010000:00010000:1.0:1789304570.110605:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb72312966a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004fa expref: 7 pid: 6691 timeout: 2119 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304570.110649:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 381 00000100:00100000:1.0:1789304570.110659:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765562752:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304570.110675:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304570.110681:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb72312966a5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004fa expref: 7 pid: 6691 timeout: 2119 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304570.110695:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb72312966a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004fa expref: 7 pid: 6691 timeout: 2119 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304570.110722:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304570.110726:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304570.110733:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304570.110749:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304570.110772:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304570.110825:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765562752:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 167us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304570.110832:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 381 00000100:00080000:2.0:1789304570.111724:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789304570.111937:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb72312966a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861004fa expref: 6 pid: 6691 timeout: 2119 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304570.111957:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785641856:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304570.111981:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.111992:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.112005:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.112017:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.112024:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.112043:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789304570.112706:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785641728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13466us (13702us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789304570.112716:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000004:00080000:3.0:1789304570.112767:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c41241c00/2, rc 0, transno 4294967351 00000100:00100000:3.0:1789304570.112774:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785641728:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789304570.113179:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304570.113188:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304570.113208:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304570.113213:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304570.113224:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304570.113244:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304570.113251:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d03de8a/0xefc0bb72312966dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304570.113272:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304570.113275:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304570.113277:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304570.184603:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304570.185556:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765562880 00000100:00100000:3.0:1789304570.185574:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765562880 00000100:00100000:3.0:1789304570.185644:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 868 00000100:00100000:3.0:1789304570.185657:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:49242:x1876219765562880:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304570.185683:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304570.185706:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100508 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.185780:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.185802:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.185814:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.185830:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.185838:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.185845:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186736:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312966f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186752:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312966f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186761:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312966f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304570.186787:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:3.0:1789304570.186792:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304570.186814:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312966f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186828:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186841:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186848:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186855:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304570.186859:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186868:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186882:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:3.0:1789304570.186886:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304570.186891:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186898:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312966eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186921:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186928:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186934:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.186939:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304570.186943:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.187426:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.187438:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304570.187441:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304570.187445:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.187451:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb72312966f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.187489:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312966e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100508 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.187503:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312966f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100508 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304570.187511:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304570.187513:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304570.187516:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fe00, rc 0) 00000100:00100000:3.0:1789304570.187592:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:49242:x1876219765562880:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 1937us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304570.187602:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 868 00010000:00010000:1.0:1789304570.194543:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304571.158708:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785642112:0@lo:400:kworker.0 00000100:00100000:2.0:1789304571.158786:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304571.158832:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785642624:0@lo:400:kworker.0 00000100:00100000:2.0:1789304571.158858:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304571.158887:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304571.158905:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785642240:0@lo:400:kworker.0 00000100:00100000:2.0:1789304571.158928:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304571.158968:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785642624 00000100:00100000:2.0:1789304571.158977:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785642624 00000100:00100000:2.0:1789304571.159025:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785642240 00000100:00100000:2.0:1789304571.159028:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785642240 00000100:00100000:2.0:1789304571.159059:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1789304571.159067:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785642624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304571.159154:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785642624:12345-0@lo:400:kworker.0 Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304571.159163:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1789304571.159183:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1789304571.159189:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785642240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304571.159215:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785642240:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304571.159221:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00080000:2.0:1789304571.159241:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304571.159269:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785642240:0@lo:400:kworker.0 00000100:00100000:2.0:1789304571.159281:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785642624:0@lo:400:kworker.0 00000100:00100000:1.0:1789304571.159571:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785641984:0@lo:400:kworker.0 00000100:00100000:1.0:1789304571.159607:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304571.159631:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785642496:0@lo:400:kworker.0 00000100:00100000:1.0:1789304571.159795:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304571.159823:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304571.159829:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785642368:0@lo:400:kworker.0 00000100:00100000:1.0:1789304571.159851:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304571.159880:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785642112 00000100:00100000:1.0:1789304571.159885:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785642112 00000100:00100000:1.0:1789304571.159929:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785642496 00000100:00100000:1.0:1789304571.159932:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785642496 00000100:00100000:1.0:1789304571.159957:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785642368 00000100:00100000:1.0:1789304571.159960:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785642368 00000100:00100000:1.0:1789304571.159975:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1789304571.159981:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785642112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304571.160022:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785642112:12345-0@lo:400:kworker.0 Request processed in 41us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304571.160027:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1789304571.160040:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1789304571.160045:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785642496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304571.160075:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785642496:12345-0@lo:400:kworker.0 Request processed in 30us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304571.160080:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1789304571.160114:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1789304571.160122:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785642368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304571.160153:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785642368:12345-0@lo:400:kworker.0 Request processed in 33us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304571.160159:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00080000:1.0:1789304571.160181:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304571.160203:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785642368:0@lo:400:kworker.0 00000100:00100000:1.0:1789304571.160212:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785642496:0@lo:400:kworker.0 00000100:00100000:1.0:1789304571.160237:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785642112:0@lo:400:kworker.0 00000100:00100000:2.0:1789304571.160305:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785641984 00000100:00100000:2.0:1789304571.160310:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785641984 00000100:00100000:2.0:1789304571.160346:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1789304571.160353:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785641984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304571.160389:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785641984:12345-0@lo:400:kworker.0 Request processed in 37us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304571.160395:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1789304571.160611:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785641984:0@lo:400:kworker.0 00000100:00100000:2.0:1789304571.169154:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304571.169249:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765563008 00000100:00100000:0.0:1789304571.169261:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765563008 00000100:00100000:0.0:1789304571.169324:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 869 00000100:00100000:0.0:1789304571.169335:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49260:x1876219765563008:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304571.169359:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304571.169383:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610050f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.169464:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.169480:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.169495:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304571.169545:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:0.0:1789304571.169549:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304571.169570:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.169601:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231296700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610050f expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.169625:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610050f expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.169635:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:0.0:1789304571.169723:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304571.169729:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb800, rc 0) 00000100:00100000:0.0:1789304571.169800:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:49260:x1876219765563008:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 466us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304571.169808:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 869 00000100:00100000:2.0:1789304571.182854:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304571.182956:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765563264 00000100:00100000:0.0:1789304571.182968:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765563264 00000100:00100000:0.0:1789304571.183032:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 870 00000100:00100000:0.0:1789304571.183043:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:49260:x1876219765563264:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304571.183122:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304571.183156:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610050f expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.183180:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb72312966f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100508 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.183193:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:0.0:1789304571.183206:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304571.183238:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.183252:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.183262:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304571.183636:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000992e395e reply state 00000000c44fa77b transno 4294967633 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304571.183786:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304571.183797:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000100:00100000:0.0:1789304571.183912:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:49260:x1876219765563264:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 870us (1066us total) trans 4294967633 rc 0/0 00000100:00100000:0.0:1789304571.183920:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 870 00010000:00010000:3.0:1789304571.187193:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.187217:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.187228:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.187235:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304571.187240:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.187250:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.187271:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:3.0:1789304571.187275:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304571.187281:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.187288:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129670e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.221460:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304571.390823:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304571.391042:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765563392 00000100:00100000:3.0:1789304571.391054:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765563392 00000100:00100000:3.0:1789304571.391134:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 871 00000100:00100000:3.0:1789304571.391146:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:49272:x1876219765563392:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304571.391273:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:49272:x1876219765563392:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 128us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304571.391281:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 871 00000100:00100000:2.0:1789304571.398253:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304571.398515:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765563520 00000100:00100000:1.0:1789304571.398526:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765563520 00000100:00080000:2.0:1789304571.398669:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304571.398758:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 471 00000100:00100000:1.0:1789304571.398769:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:49272:x1876219765563520:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304571.399230:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:49272:x1876219765563520:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 463us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304571.399239:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 471 00000100:00100000:0.0:1789304571.402048:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304571.402195:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765563648 00000100:00100000:3.0:1789304571.402206:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765563648 00000100:00100000:3.0:1789304571.402263:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 472 00000100:00100000:3.0:1789304571.402274:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:49272:x1876219765563648:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304571.402704:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:49272:x1876219765563648:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 431us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304571.402713:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 472 00000100:00100000:2.0:1789304571.416586:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304571.416691:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765563776 00000100:00100000:1.0:1789304571.416701:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765563776 00000100:00100000:1.0:1789304571.416776:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 872 00000100:00100000:1.0:1789304571.416787:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49272:x1876219765563776:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304571.417779:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49272:x1876219765563776:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 991us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304571.417789:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 872 00000100:00100000:2.0:1789304571.439241:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304571.439383:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765563904 00000100:00100000:3.0:1789304571.439394:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765563904 00000100:00100000:3.0:1789304571.439468:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 873 00000100:00100000:3.0:1789304571.439481:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:49272:x1876219765563904:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304571.439647:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:49272:x1876219765563904:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 168us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304571.439655:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 873 00000100:00100000:3.0:1789304571.455539:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304571.456057:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765564032 00000100:00100000:2.0:1789304571.456070:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765564032 00000100:00100000:2.0:1789304571.456167:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 473 00000100:00100000:2.0:1789304571.456179:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:49272:x1876219765564032:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304571.456548:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:49272:x1876219765564032:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 370us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304571.456556:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 473 00000100:00100000:3.0:1789304571.463696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304571.463820:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765564160 00000100:00100000:0.0:1789304571.463831:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765564160 00000100:00100000:0.0:1789304571.463906:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 474 00000100:00100000:0.0:1789304571.463917:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:49272:x1876219765564160:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304571.464327:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:49272:x1876219765564160:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 410us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304571.464335:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 474 00000100:00100000:2.0:1789304571.466366:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304571.466459:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765564288 00000100:00100000:1.0:1789304571.466469:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765564288 00000100:00100000:1.0:1789304571.466528:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 874 00000100:00100000:1.0:1789304571.466539:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49272:x1876219765564288:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304571.467430:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49272:x1876219765564288:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 888us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304571.467440:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 874 00000100:00100000:3.0:1789304571.549000:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304571.549118:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765564416 00000100:00100000:1.0:1789304571.549129:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765564416 00000100:00100000:1.0:1789304571.549200:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 875 00000100:00100000:1.0:1789304571.549210:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49276:x1876219765564416:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:1.0:1789304571.549231:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304571.549251:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231296715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100516 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549318:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb723129671c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549333:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb723129671c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549346:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb723129671c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549361:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296723 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549368:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549374:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549679:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129672a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549689:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129672a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549697:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129672a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304571.549717:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:1.0:1789304571.549721:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304571.549739:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129672a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549751:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb723129671c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549759:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb723129671c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549764:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb723129671c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549770:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304571.549774:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb723129671c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549781:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb723129671c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549792:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:1.0:1789304571.549796:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304571.549801:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb723129671c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549807:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb723129671c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549818:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549823:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296723 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549828:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549833:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370c00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304571.549835:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549840:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296723 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549847:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c14add100) 00010000:00010000:1.0:1789304571.549850:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304571.549853:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296723 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549858:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296723 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549886:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231296715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100516 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549916:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129672a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100516 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304571.549922:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:1.0:1789304571.549924:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304571.549927:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370e00, rc 0) 00000100:00100000:1.0:1789304571.549996:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:49276:x1876219765564416:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 787us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304571.550003:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 875 00000100:00100000:2.0:1789304571.556299:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304571.556403:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765564672 00000100:00100000:0.0:1789304571.556414:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765564672 00000100:00100000:0.0:1789304571.556479:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 876 00000100:00100000:0.0:1789304571.556490:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:49276:x1876219765564672:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304571.556512:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304571.556533:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296731 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610051d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.556832:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231296738 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.556848:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231296738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.556860:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231296738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.556876:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.556883:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.556901:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789304571.557711:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c:0x0], index 0: 0 00010000:00010000:0.0:1789304571.557958:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.557970:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.557979:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.558018:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231296738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.558026:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231296738 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.558033:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231296738 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.558039:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304571.558045:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231296738 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.558053:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231296738 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.558065:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:0.0:1789304571.558069:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304571.558074:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231296738 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.558081:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231296738 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304571.558125:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4c852c7 reply state 000000004b189a03 transno 4294967634 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304571.558134:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789304571.558177:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296731 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610051d expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.558192:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610051d expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304571.558199:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:0.0:1789304571.558201:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304571.558204:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb400, rc 0) 00000100:00100000:0.0:1789304571.558281:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:49276:x1876219765564672:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1793us (1991us total) trans 4294967634 rc 0/0 00000100:00100000:0.0:1789304571.558289:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 876 00010000:00010000:3.0:1789304571.561379:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.561396:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.561404:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.561411:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304571.561416:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.561424:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.561442:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c0558da00) 00010000:00010000:3.0:1789304571.561444:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304571.561449:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.561453:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129673f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304571.570304:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304571.570612:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765564800 00000100:00100000:3.0:1789304571.570621:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765564800 00000100:00100000:3.0:1789304571.570673:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 475 00000100:00100000:3.0:1789304571.570680:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:49276:x1876219765564800:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:3.0:1789304571.570698:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304571.570719:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231296754 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100524 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789304571.570749:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789304571.570776:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=2021s v=(0 0) 00010000:00010000:3.0:1789304571.570781:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304571.570791:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231296754 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100524 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.570820:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231296754 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100524 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304571.570836:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ec00, rc 0) 00000100:00100000:3.0:1789304571.570985:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:49276:x1876219765564800:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 303us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304571.570993:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 475 00000100:00100000:0.0:1789304571.601285:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304571.601380:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765564928 00000100:00100000:1.0:1789304571.601390:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765564928 00002000:00100000:1.0:1789304571.601456:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff9e2b02d50380 x1876219765564928/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:637/0 lens 488/0 e 0 to 0 dl 1789304582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304571.601467:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b02d50380 with x1876219765564928 ext(0->1048575) 00002000:00010000:1.0:1789304571.601473:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2b02d50380 00000100:00100000:1.0:1789304571.601507:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:1.0:1789304571.601517:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765564928:12345-192.168.202.29@tcp:4:dd.60003 00000100:00100000:1.0:1789304571.651368:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2357:x1876219765564928:12345-192.168.202.29@tcp:4:dd.60003 Request processed in 49838us (50079us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789304571.651384:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 21 00002000:00100000:1.0:1789304571.651399:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff9e2b02d50380 x1876219765564928/t4294967352(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:637/0 lens 488/448 e 0 to 0 dl 1789304582 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304571.651410:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b02d50380 with x1876219765564928 ext(0->1048575) 00002000:00010000:1.0:1789304571.651418:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2b02d50380 00000100:00100000:0.0:1789304571.656847:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304571.656949:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765565056 00000100:00100000:1.0:1789304571.656977:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765565056 00000100:00100000:1.0:1789304571.657045:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 877 00000100:00100000:1.0:1789304571.657056:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:49276:x1876219765565056:12345-192.168.202.29@tcp:44:dd.60003 00000100:00100000:2.0:1789304571.705495:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:49276:x1876219765565056:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 48430us (48647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304571.705509:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 877 00000001:00080000:2.0:1789304571.705547:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967634 is committed 00000100:00100000:1.0:1789304571.708937:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304571.709273:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765565184 00000100:00100000:0.0:1789304571.709284:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765565184 00000100:00100000:0.0:1789304571.709347:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 476 00000100:00100000:0.0:1789304571.709358:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765565184:12345-192.168.202.29@tcp:16:dd.60003 00000100:00100000:2.0:1789304571.740705:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765565184:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 31339us (31768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304571.740720:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 476 00000001:00080000:3.0:1789304571.741822:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00000100:00100000:2.0:1789304571.743337:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304571.743431:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765565440 00000100:00100000:0.0:1789304571.743442:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765565440 00000100:00100000:0.0:1789304571.743502:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 90 00000100:00100000:0.0:1789304571.743513:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:49276:x1876219765565440:12345-192.168.202.29@tcp:35:dd.60003 00000100:00100000:0.0:1789304571.744678:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:49276:x1876219765565440:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 1161us (1342us total) trans 4294967635 rc 0/0 00000100:00100000:0.0:1789304571.744690:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 90 00010000:00010000:0.0:1789304572.249399:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304572.258232:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967350 is committed 00000001:00080000:2.0:1789304572.258254:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967351 is committed 00000001:00080000:2.0:1789304572.947708:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967635 is committed 00010000:00010000:1.0:1789304573.266413:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304573.715667:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785642752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304573.715741:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304573.715950:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785642752 00000100:00100000:0.0:1789304573.715960:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785642752 00000100:00100000:0.0:1789304573.716028:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1789304573.716038:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785642752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304573.716071:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304573.716143:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785642752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304573.716151:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00080000:1.0:1789304573.716350:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304573.716378:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000004:00080000:1.0:1789304573.716384:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c41241c00, transno 4294967351 00000100:00100000:1.0:1789304573.716402:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785642752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304573.795691:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304573.795724:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304573.795752:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304573.795824:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304573.795853:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765565568 00000100:00100000:0.0:1789304573.795864:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765565568 00000100:00100000:0.0:1789304573.795934:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1165 00000100:00100000:0.0:1789304573.795944:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765565568:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304573.796013:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765565568:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 70us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304573.796021:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1165 00000100:00100000:0.0:1789304573.796054:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765565824 00000100:00100000:0.0:1789304573.796057:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765565824 00000100:00100000:0.0:1789304573.796123:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765565952 00000100:00100000:0.0:1789304573.796127:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765565952 00000100:00100000:0.0:1789304573.796163:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1072 00000100:00100000:0.0:1789304573.796171:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765565824:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304573.796199:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765565824:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304573.796205:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1072 00000100:00100000:0.0:1789304573.796218:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1073 00000100:00100000:0.0:1789304573.796223:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765565952:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304573.796247:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765565952:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304573.796252:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1073 00000100:00080000:0.0:1789304573.796341:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304573.796345:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304573.796911:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765565696 00000100:00100000:3.0:1789304573.796917:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765565696 00000100:00100000:3.0:1789304573.796982:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1433 00000100:00100000:3.0:1789304573.796991:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765565696:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304573.797038:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765565696:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 49us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304573.797044:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1433 00000100:00080000:0.0:1789304573.799412:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304574.297209:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304574.312274:0:83988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2023990180203ns, next at 1997314112954ns, rc = 0 00000004:00080000:1.0:1789304574.312353:0:83988:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2023990262102ns, next at 2019838610469ns, rc = 0 00000004:00080000:2.0:1789304574.354524:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 78 committed 00000004:00080000:2.0:1789304574.354550:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 71 committed 00000100:00100000:3.0:1789304574.739497:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785642880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304574.739575:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304574.739952:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785642880 00000100:00100000:2.0:1789304574.739960:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785642880 00000100:00100000:2.0:1789304574.740033:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1789304574.740044:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785642880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304574.740114:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789304574.740187:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785642880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304574.740195:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00080000:0.0:1789304574.742620:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304574.742908:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785642880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304575.315243:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304575.830616:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304575.830658:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765566080 00000100:00100000:1.0:1789304575.830669:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765566080 00000100:00100000:1.0:1789304575.830738:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 878 00000100:00100000:1.0:1789304575.830749:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:49469:x1876219765566080:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304575.830862:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:49469:x1876219765566080:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304575.830870:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 878 00000100:00080000:1.0:1789304575.830892:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304575.835283:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304575.835324:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765566208 00000100:00100000:0.0:1789304575.835347:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765566208 00000100:00100000:0.0:1789304575.835412:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 477 00000100:00100000:0.0:1789304575.835423:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:49469:x1876219765566208:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304575.838239:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:49469:x1876219765566208:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 2668us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304575.838256:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 477 00000100:00080000:0.0:1789304575.838292:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304575.845060:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304575.845122:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765566336 00000100:00100000:0.0:1789304575.845134:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765566336 00000100:00100000:0.0:1789304575.845195:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 478 00000100:00100000:0.0:1789304575.845206:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:49469:x1876219765566336:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304575.845602:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:49469:x1876219765566336:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 396us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304575.845828:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 478 00000100:00080000:0.0:1789304575.845862:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304575.848961:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304575.848995:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765566464 00000100:00100000:3.0:1789304575.849007:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765566464 00000100:00100000:3.0:1789304575.849056:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 879 00000100:00100000:3.0:1789304575.849065:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:49469:x1876219765566464:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304575.849660:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:49469:x1876219765566464:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 594us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304575.849669:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 879 00000100:00100000:2.0:1789304575.853026:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304575.853577:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765566592 00000100:00100000:3.0:1789304575.853591:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765566592 00000100:00100000:3.0:1789304575.853747:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 880 00000100:00100000:3.0:1789304575.853757:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:49469:x1876219765566592:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304575.854288:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:49469:x1876219765566592:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 529us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304575.854300:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 880 00000100:00100000:0.0:1789304575.858361:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304575.858450:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765566720 00000100:00100000:3.0:1789304575.858462:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765566720 00000100:00100000:3.0:1789304575.858633:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 479 00000100:00100000:3.0:1789304575.858644:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:49469:x1876219765566720:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304575.859015:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:49469:x1876219765566720:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 372us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304575.859023:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 479 00000100:00100000:3.0:1789304575.862450:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304575.862501:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765566848 00000100:00100000:3.0:1789304575.862512:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765566848 00000100:00100000:3.0:1789304575.862569:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 480 00000100:00100000:3.0:1789304575.862579:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:49469:x1876219765566848:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304575.864276:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:49469:x1876219765566848:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1691us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304575.864290:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 480 00000100:00100000:3.0:1789304575.866427:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304575.866589:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765566976 00000100:00100000:2.0:1789304575.866601:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765566976 00000100:00100000:2.0:1789304575.866766:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 881 00000100:00100000:2.0:1789304575.866775:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:49469:x1876219765566976:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304575.867322:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:49469:x1876219765566976:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 546us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304575.867331:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 881 00000100:00100000:3.0:1789304575.919913:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304575.920052:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765567232 00000100:00100000:0.0:1789304575.920063:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765567232 00000100:00100000:2.0:1789304575.920516:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 882 00000100:00100000:2.0:1789304575.920529:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:49473:x1876219765567232:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:2.0:1789304575.920587:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304575.920632:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610051d expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.920656:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:2.0:1789304575.920666:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304575.920688:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129675b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.920701:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129675b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.920710:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129675b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.920725:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.920732:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.920738:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.921075:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296769 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.921084:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296769 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.921135:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296769 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304575.922038:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].28, 64 off9984 00000004:00080000:2.0:1789304575.922049:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2025599957978ns, next at 2026599955783ns, rc = 0 00010000:00010000:2.0:1789304575.922202:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922216:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922225:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922233:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922239:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922246:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922260:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304575.922286:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296769 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922294:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296769 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922300:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296769 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922306:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304575.922311:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296769 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922319:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296769 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922330:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:2.0:1789304575.922333:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304575.922338:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296769 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922345:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296769 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922364:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129675b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922371:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129675b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922378:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129675b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922383:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304575.922386:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129675b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922392:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129675b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922400:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:2.0:1789304575.922402:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304575.922405:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129675b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.922411:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129675b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304575.922425:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d340270 reply state 000000002a0b6822 transno 4294967636 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304575.922435:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304575.922526:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:49473:x1876219765567232:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 1997us (2620us total) trans 4294967636 rc 0/0 00000100:00100000:2.0:1789304575.922536:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 882 00010000:00010000:1.0:1789304575.923141:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304575.923149:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304575.923172:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304575.923175:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304575.923183:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304575.923197:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:1.0:1789304575.923200:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304575.923203:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304575.923209:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296770 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304575.923229:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304575.923231:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304575.923232:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304575.926371:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.926391:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.926400:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.926406:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304575.926411:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.926420:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.926438:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff9e2c421d2c00) 00010000:00010000:2.0:1789304575.926441:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304575.926446:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304575.926452:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296762 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304576.274785:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785643008:0@lo:400:kworker.0 00000100:00100000:1.0:1789304576.274893:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304576.275170:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785643008 00000100:00100000:0.0:1789304576.275178:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785643008 00000100:00100000:0.0:1789304576.275224:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:0.0:1789304576.275234:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785643008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.275352:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785643392:0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.275389:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304576.275427:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785643392 00000100:00100000:3.0:1789304576.275430:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785643392 00000100:00100000:3.0:1789304576.275467:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1789304576.275475:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785643392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.275515:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785643392:12345-0@lo:400:kworker.0 Request processed in 41us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304576.275522:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00080000:3.0:1789304576.275542:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304576.275572:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785643392:0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.275815:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785643136:0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.275841:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304576.275874:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304576.275881:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785643264:0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.276168:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304576.276200:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785643136 00000100:00100000:3.0:1789304576.276205:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785643136 00000100:00100000:3.0:1789304576.276232:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1789304576.276238:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785643136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.276288:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785643136:12345-0@lo:400:kworker.0 Request processed in 50us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304576.276295:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1789304576.276312:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785643264 00000100:00100000:3.0:1789304576.276315:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785643264 00000100:00100000:3.0:1789304576.276344:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1789304576.276350:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785643264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.276381:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785643264:12345-0@lo:400:kworker.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304576.276387:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1789304576.276419:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785643264:0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.276429:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785643136:0@lo:400:kworker.0 00000100:00080000:3.0:1789304576.276447:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304576.279126:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304576.279140:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785643008:12345-0@lo:400:kworker.0 Request processed in 3904us (4243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304576.279153:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785643520:0@lo:400:kworker.0 00000100:00100000:0.0:1789304576.279153:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:3.0:1789304576.279217:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304576.279253:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304576.279260:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785643648:0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.279286:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304576.279348:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785643648 00000100:00100000:0.0:1789304576.279357:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785643648 00000100:00100000:2.0:1789304576.279378:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785643520 00000100:00100000:2.0:1789304576.279382:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785643520 00000100:00100000:2.0:1789304576.279419:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1789304576.279419:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1789304576.279427:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785643520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304576.279427:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785643648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304576.279474:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785643648:12345-0@lo:400:kworker.0 Request processed in 48us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304576.279480:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1789304576.279485:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785643520:12345-0@lo:400:kworker.0 Request processed in 48us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304576.279491:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00080000:3.0:1789304576.279608:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789304576.279613:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304576.279644:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785643648:0@lo:400:kworker.0 00000100:00100000:3.0:1789304576.279672:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785643520:0@lo:400:kworker.0 00000100:00100000:1.0:1789304576.280631:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785643008:0@lo:400:kworker.0 00010000:00010000:2.0:1789304576.341561:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304577.364646:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304577.793866:0:84134:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2027471772220ns, next at 2026599955783ns, rc = 0 00000004:00080000:2.0:1789304577.839136:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 73 committed 00000001:00080000:2.0:1789304577.839166:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967636 is committed 00000004:00080000:2.0:1789304577.839171:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 72 committed 00000100:00100000:2.0:1789304577.839345:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304577.839364:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785643776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789304577.839429:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304577.839579:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785643776 00000100:00100000:3.0:1789304577.839589:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785643776 00000100:00100000:3.0:1789304577.839700:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1789304577.839710:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785643776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789304577.839737:0:17212:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:28 count 1 00010000:00010000:3.0:1789304577.839762:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304577.839785:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231296754 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100524 expref: 5 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304577.839795:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1c:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1789304577.839799:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304577.839804:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304577.839840:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231296754 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100524 expref: 5 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304577.839855:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231296754 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100524 expref: 5 pid: 6693 timeout: 2127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304577.839867:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785643904:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304577.840144:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c013593c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304577.842749:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785643904:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789304577.842781:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304577.844066:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304577.845069:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765567360 00000100:00100000:2.0:1789304577.845084:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765567360 00010000:00010000:2.0:1789304577.845268:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231296754 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100524 expref: 6 pid: 6693 timeout: 2127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304577.845316:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 382 00000100:00100000:2.0:1789304577.845327:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765567360:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304577.845347:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304577.845353:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231296754 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100524 expref: 6 pid: 6693 timeout: 2127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304577.845367:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231296754 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100524 expref: 6 pid: 6693 timeout: 2127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304577.845392:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4983c41/0xefc0bb7231296754 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100524 expref: 6 pid: 6693 timeout: 2127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304577.845413:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304577.845417:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304577.845423:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304577.845432:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304577.845455:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304577.845511:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765567360:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 186us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304577.845518:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 382 00000100:00080000:3.0:1789304577.845668:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304577.845785:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304577.845796:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304577.845807:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304577.845815:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304577.845850:0:17212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304577.845954:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304577.845960:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304577.845968:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304577.845972:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304577.845981:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304577.845999:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304577.846006:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231296777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304577.846024:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304577.846026:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304577.846027:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304577.846467:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785643776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6757us (7035us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789304577.846475:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000004:00080000:2.0:1789304577.846502:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c3fd20000/2, rc 0, transno 4294967353 00000100:00100000:2.0:1789304577.846525:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785643776:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789304577.846795:0:84134:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2027524703140ns, next at 2019838610469ns, rc = 0 00000004:00080000:1.0:1789304577.854736:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 79 committed 00010000:00010000:2.0:1789304578.389393:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304578.835490:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785644032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304578.835567:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304578.835744:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785644032 00000100:00100000:3.0:1789304578.835753:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785644032 00000100:00100000:3.0:1789304578.835831:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1789304578.835852:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785644032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304578.835889:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304578.835941:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785644032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304578.835948:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00080000:1.0:1789304578.837649:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304578.837719:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785644032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304578.914395:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304578.914444:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304578.914483:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304578.914507:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765567616 00000100:00100000:3.0:1789304578.914512:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304578.914518:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765567616 00000100:00100000:3.0:1789304578.914533:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765567488 00000100:00100000:3.0:1789304578.914537:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765567488 00000100:00100000:3.0:1789304578.914645:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1167 00000100:00100000:3.0:1789304578.914725:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765567488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304578.915355:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765567872 00000100:00100000:1.0:1789304578.915362:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765567872 00000100:00100000:1.0:1789304578.915397:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765567744 00000100:00100000:1.0:1789304578.915400:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765567744 00000100:00100000:1.0:1789304578.915421:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1076 00000100:00100000:1.0:1789304578.915428:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765567872:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304578.918002:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765567488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 3334us (3503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304578.918006:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1437 00000100:00100000:3.0:1789304578.918015:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1167 00000100:00100000:0.0:1789304578.918028:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765567616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304578.918074:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1077 00000100:00100000:3.0:1789304578.918082:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765567744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304578.918783:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765567872:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 3350us (4333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304578.918794:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1076 00000100:00080000:1.0:1789304578.918832:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304578.921766:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304578.928191:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765567616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 10160us (13794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304578.928208:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1437 00000100:00100000:3.0:1789304578.932216:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765567744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 14120us (17686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304578.932235:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1077 00010000:00010000:0.0:1789304579.411083:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304579.858424:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304579.858457:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785644160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304579.858549:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304579.859533:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785644160 00000100:00100000:2.0:1789304579.859545:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785644160 00000100:00100000:2.0:1789304579.859635:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1789304579.859646:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785644160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304579.859684:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789304579.859751:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785644160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304579.859758:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00080000:0.0:1789304579.859867:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304579.863507:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785644160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304580.443058:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304581.048844:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00000100:00100000:0.0:1789304581.394350:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304581.394492:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304581.394514:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785644416:0@lo:400:kworker.0 00000100:00100000:3.0:1789304581.394589:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304581.394959:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785644416 00000100:00100000:1.0:1789304581.394967:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785644416 00000100:00100000:1.0:1789304581.395020:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1789304581.395028:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785644416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304581.395298:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785644416:12345-0@lo:400:kworker.0 Request processed in 271us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304581.395306:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1789304581.395362:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785644416:0@lo:400:kworker.0 00000100:00100000:0.0:1789304581.397290:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785644288:0@lo:400:kworker.0 00000100:00100000:0.0:1789304581.397364:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304581.400721:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785644288 00000100:00100000:1.0:1789304581.400747:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785644288 00000100:00100000:1.0:1789304581.400822:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:1.0:1789304581.401056:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785644288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304581.401257:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785644288:12345-0@lo:400:kworker.0 Request processed in 205us (3891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304581.401265:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:0.0:1789304581.401362:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785644288:0@lo:400:kworker.0 00000100:00100000:1.0:1789304581.402283:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785644800:0@lo:400:kworker.0 00000100:00100000:1.0:1789304581.402333:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304581.402386:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785644544:0@lo:400:kworker.0 00000100:00100000:3.0:1789304581.402422:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304581.402667:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785644672:0@lo:400:kworker.0 00000100:00100000:0.0:1789304581.402695:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304581.402746:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785644800 00000100:00100000:0.0:1789304581.402754:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785644800 00000100:00100000:0.0:1789304581.402806:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785644672 00000100:00100000:0.0:1789304581.402810:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785644672 00000100:00100000:2.0:1789304581.406393:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785644928:0@lo:400:kworker.0 00000100:00100000:3.0:1789304581.406760:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789304581.406827:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304581.409165:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1789304581.409201:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785644800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304581.409307:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785644800:12345-0@lo:400:kworker.0 Request processed in 121us (6973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304581.409318:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1789304581.409338:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1789304581.409344:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785644672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304581.409367:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785644800:0@lo:400:kworker.0 00000100:00100000:0.0:1789304581.409389:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785644672:12345-0@lo:400:kworker.0 Request processed in 45us (6693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304581.409395:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1789304581.409418:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785644544 00000100:00100000:0.0:1789304581.409420:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785644672:0@lo:400:kworker.0 00000100:00100000:3.0:1789304581.409424:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785644544 00000100:00100000:3.0:1789304581.409472:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785644928 00000100:00100000:3.0:1789304581.409475:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785644928 00000100:00100000:3.0:1789304581.409496:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1789304581.409503:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785644544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304581.409552:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785644544:12345-0@lo:400:kworker.0 Request processed in 50us (7130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304581.409559:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1789304581.409572:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1789304581.409578:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785644928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304581.409608:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785644928:12345-0@lo:400:kworker.0 Request processed in 31us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304581.409614:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:3.0:1789304581.409630:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304581.409634:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304581.409654:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785644928:0@lo:400:kworker.0 00000100:00100000:3.0:1789304581.409813:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:3.0:1789304581.409819:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c3fd20000, transno 4294967353 00000100:00100000:3.0:1789304581.409953:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785644544:0@lo:400:kworker.0 00010000:00010000:2.0:1789304581.459642:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304582.482220:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304583.507147:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304583.954523:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785645056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304583.954610:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304583.955376:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785645056 00000100:00100000:3.0:1789304583.955387:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785645056 00000100:00100000:3.0:1789304583.955661:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1789304583.955672:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785645056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304583.955710:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304583.955790:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785645056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304583.955797:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:1.0:1789304583.955883:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785645056:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304583.956010:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304584.033726:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304584.033783:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304584.033817:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304584.033847:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304584.033936:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765568128 00000100:00100000:0.0:1789304584.033946:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765568128 00000100:00100000:0.0:1789304584.034020:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1441 00000100:00100000:0.0:1789304584.034029:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765568128:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304584.034136:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765568128:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 100us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304584.034144:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1441 00000100:00100000:1.0:1789304584.034384:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765568256 00000100:00100000:1.0:1789304584.034389:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765568256 00000100:00100000:1.0:1789304584.034425:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765568384 00000100:00100000:1.0:1789304584.034428:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765568384 00000100:00100000:1.0:1789304584.034448:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1080 00000100:00100000:1.0:1789304584.034454:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765568256:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304584.034484:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765568256:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304584.034490:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1080 00000100:00100000:1.0:1789304584.034502:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1081 00000100:00100000:1.0:1789304584.034507:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765568384:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304584.034535:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765568384:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 18us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304584.034541:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1081 00000100:00080000:2.0:1789304584.034837:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304584.034841:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304584.034843:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304584.040443:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765568000 00000100:00100000:3.0:1789304584.040459:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765568000 00000100:00100000:3.0:1789304584.040631:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1169 00000100:00100000:3.0:1789304584.040642:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765568000:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304584.040728:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765568000:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 88us (7013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304584.040736:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1169 00010000:00010000:2.0:1789304584.531610:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304584.978540:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304584.978563:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785645184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304584.978629:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304584.978927:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785645184 00000100:00100000:3.0:1789304584.978936:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785645184 00000100:00100000:3.0:1789304584.979019:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1789304584.979029:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785645184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304584.979067:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304584.979151:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785645184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304584.979159:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00080000:2.0:1789304584.979365:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304584.979439:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785645184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304585.554606:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304586.514437:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785645696:0@lo:400:kworker.0 00000100:00100000:0.0:1789304586.514445:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785645440:0@lo:400:kworker.0 00000100:00100000:2.0:1789304586.514508:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785645312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304586.514566:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785645568:0@lo:400:kworker.0 00000100:00100000:3.0:1789304586.514885:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304586.514983:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785645696 00000100:00100000:3.0:1789304586.514993:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785645696 00000100:00100000:3.0:1789304586.515078:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:3.0:1789304586.515121:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785645696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304586.515178:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785645696:12345-0@lo:400:kworker.0 Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304586.515187:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00080000:3.0:1789304586.515207:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304586.515238:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785645696:0@lo:400:kworker.0 00000100:00100000:0.0:1789304586.522592:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304586.522671:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785645952:0@lo:400:kworker.0 00000100:00100000:0.0:1789304586.522717:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304586.522773:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785645440 00000100:00100000:0.0:1789304586.522783:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785645440 00000100:00100000:3.0:1789304586.522791:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785645952 00000100:00100000:3.0:1789304586.522795:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785645952 00000100:00100000:3.0:1789304586.522860:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1789304586.522871:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785645952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304586.522944:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785645952:12345-0@lo:400:kworker.0 Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304586.522950:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00080000:3.0:1789304586.522981:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304586.524560:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1789304586.524571:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785645440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304586.526603:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304586.526725:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785645568 00000100:00100000:1.0:1789304586.526737:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785645568 00000100:00100000:1.0:1789304586.526808:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1789304586.526819:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785645568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304586.526877:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785645568:12345-0@lo:400:kworker.0 Request processed in 62us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304586.526885:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1789304586.526939:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785645568:0@lo:400:kworker.0 00000100:00080000:1.0:1789304586.527022:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304586.534864:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304586.534953:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785645824:0@lo:400:kworker.0 00000100:00100000:2.0:1789304586.535022:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304586.535232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785645312 00000100:00100000:1.0:1789304586.535242:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785645312 00000100:00100000:1.0:1789304586.535298:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1789304586.535307:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785645312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304586.535371:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785645312:12345-0@lo:400:kworker.0 Request processed in 64us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304586.535378:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1789304586.535435:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785645824 00000100:00100000:1.0:1789304586.535439:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785645824 00000100:00100000:1.0:1789304586.535475:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1789304586.535482:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785645824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304586.535514:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785645824:12345-0@lo:400:kworker.0 Request processed in 34us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304586.535519:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00080000:1.0:1789304586.535540:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304586.535746:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785645312:0@lo:400:kworker.0 00000100:00100000:0.0:1789304586.538655:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785645440:12345-0@lo:400:kworker.0 Request processed in 14075us (16061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304586.539968:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:3.0:1789304586.543081:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785645952:0@lo:400:kworker.0 00000100:00100000:3.0:1789304586.543153:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785645440:0@lo:400:kworker.0 00000100:00100000:2.0:1789304586.543395:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785645824:0@lo:400:kworker.0 00010000:00010000:2.0:1789304586.578364:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304587.602504:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304588.626593:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304589.074420:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304589.074797:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785646080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304589.074884:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304589.076846:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785646080 00000100:00100000:3.0:1789304589.078702:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785646080 00000100:00100000:3.0:1789304589.078905:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1789304589.078916:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785646080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304589.078961:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304589.079111:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785646080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (4207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304589.079120:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1789304589.079564:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785646080:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304589.080302:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304589.153692:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304589.153771:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304589.153819:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304589.153857:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304589.153891:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765568896 00000100:00100000:0.0:1789304589.153901:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765568896 00000100:00100000:0.0:1789304589.153954:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765568768 00000100:00100000:0.0:1789304589.153957:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765568768 00000100:00100000:0.0:1789304589.153978:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1084 00000100:00100000:0.0:1789304589.153988:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765568896:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304589.154056:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765568896:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 69us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304589.154064:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1084 00000100:00100000:0.0:1789304589.154081:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1085 00000100:00100000:0.0:1789304589.154088:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765568768:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304589.154135:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765568512 00000100:00100000:2.0:1789304589.154142:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765568512 00000100:00100000:0.0:1789304589.154171:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765568768:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304589.154178:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1085 00000100:00100000:2.0:1789304589.154195:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1171 00000100:00100000:2.0:1789304589.154205:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765568512:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304589.154269:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765568640 00000100:00100000:3.0:1789304589.154276:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765568640 00000100:00080000:1.0:1789304589.154278:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304589.154283:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304589.154286:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304589.154321:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1445 00000100:00100000:3.0:1789304589.154332:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765568640:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304589.154371:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765568512:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 34us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304589.154380:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1171 00000100:00100000:3.0:1789304589.158168:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765568640:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 2348us (2996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304589.158186:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1445 00010000:00010000:2.0:1789304589.654471:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304590.104369:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785646208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304590.104458:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304590.104771:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785646208 00000100:00100000:2.0:1789304590.104784:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785646208 00000100:00100000:2.0:1789304590.104869:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1789304590.104883:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785646208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304590.104927:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304590.104984:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785646208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304590.104991:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00080000:3.0:1789304590.105288:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304590.105534:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785646208:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304590.676353:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304591.635532:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785646592:0@lo:400:kworker.0 00000100:00100000:1.0:1789304591.635609:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304591.635681:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304591.635688:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785646720:0@lo:400:kworker.0 00000100:00100000:1.0:1789304591.635747:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304591.635786:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785646720 00000100:00100000:1.0:1789304591.635794:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785646720 00000100:00100000:1.0:1789304591.635856:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1789304591.635866:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785646720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304591.635918:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785646720:12345-0@lo:400:kworker.0 Request processed in 53us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304591.635924:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1789304591.636017:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785646720:0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636130:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785646464:0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636164:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304591.636188:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785646976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636210:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304591.636229:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789304591.636235:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785646336:0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636262:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304591.636288:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785646848:0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636309:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304591.636336:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785646592 00000100:00100000:0.0:1789304591.636340:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785646592 00000100:00100000:0.0:1789304591.636372:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785646976 00000100:00100000:0.0:1789304591.636375:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785646976 00000100:00100000:0.0:1789304591.636396:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1789304591.636402:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785646592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636441:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785646592:12345-0@lo:400:kworker.0 Request processed in 38us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304591.636447:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1789304591.636460:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1789304591.636466:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785646976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636496:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785646976:12345-0@lo:400:kworker.0 Request processed in 31us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304591.636501:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1789304591.636518:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785646336 00000100:00100000:0.0:1789304591.636521:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785646336 00000100:00100000:0.0:1789304591.636544:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1789304591.636550:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785646336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636580:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785646336:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304591.636586:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1789304591.636610:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785646464 00000100:00100000:0.0:1789304591.636615:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785646464 00000100:00100000:0.0:1789304591.636636:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785646848 00000100:00100000:0.0:1789304591.636639:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785646848 00000100:00100000:0.0:1789304591.636658:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1789304591.636664:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785646464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636693:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785646464:12345-0@lo:400:kworker.0 Request processed in 29us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304591.636715:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1789304591.636727:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1789304591.636734:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785646848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636761:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785646848:12345-0@lo:400:kworker.0 Request processed in 29us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304591.636768:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1789304591.636820:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785646336:0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636830:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785646848:0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636839:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785646464:0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636847:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785646976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304591.636885:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785646592:0@lo:400:kworker.0 00000100:00080000:3.0:1789304591.637235:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304591.637241:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304591.699043:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304592.723654:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304593.323042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304593.327944:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765569024 00000100:00100000:1.0:1789304593.327962:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765569024 00000100:00100000:1.0:1789304593.328061:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 883 00000100:00100000:1.0:1789304593.328073:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:49691:x1876219765569024:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304593.328200:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:49691:x1876219765569024:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 128us (5167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304593.328207:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 883 00000100:00080000:0.0:1789304593.328309:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304593.332504:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304593.334218:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765569152 00000100:00100000:0.0:1789304593.334232:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765569152 00000100:00100000:0.0:1789304593.334427:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 482 00000100:00100000:0.0:1789304593.334438:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:49691:x1876219765569152:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304593.335124:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:49691:x1876219765569152:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 686us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304593.335133:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 482 00000100:00080000:3.0:1789304593.340961:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304593.341114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304593.343107:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765569280 00000100:00100000:1.0:1789304593.343123:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765569280 00000100:00100000:1.0:1789304593.343209:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 483 00000100:00100000:1.0:1789304593.343222:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:49691:x1876219765569280:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:3.0:1789304593.343955:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304593.345112:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:49691:x1876219765569280:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1885us (4014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304593.345126:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 483 00000100:00100000:2.0:1789304593.351481:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304593.351844:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765569408 00000100:00100000:0.0:1789304593.351855:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765569408 00000100:00100000:0.0:1789304593.351916:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 884 00000100:00100000:0.0:1789304593.351927:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49691:x1876219765569408:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304593.352544:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49691:x1876219765569408:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 617us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304593.352553:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 884 00000100:00100000:2.0:1789304593.359578:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304593.361748:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765569536 00000100:00100000:1.0:1789304593.361766:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765569536 00000100:00100000:1.0:1789304593.361844:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 885 00000100:00100000:1.0:1789304593.361855:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49691:x1876219765569536:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304593.363881:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49691:x1876219765569536:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 2017us (4302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304593.363896:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 885 00000100:00100000:2.0:1789304593.371470:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304593.371576:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765569664 00000100:00100000:0.0:1789304593.371590:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765569664 00000100:00100000:0.0:1789304593.371661:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 484 00000100:00100000:0.0:1789304593.371672:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:49691:x1876219765569664:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304593.372503:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:49691:x1876219765569664:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 831us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304593.372513:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 484 00000100:00100000:0.0:1789304593.385399:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304593.385830:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765569792 00000100:00100000:3.0:1789304593.385844:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765569792 00000100:00100000:3.0:1789304593.385969:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 485 00000100:00100000:3.0:1789304593.385980:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:49691:x1876219765569792:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304593.386423:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:49691:x1876219765569792:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 444us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304593.386432:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 485 00000100:00100000:2.0:1789304593.417171:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304593.417212:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765569920 00000100:00100000:2.0:1789304593.417226:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765569920 00000100:00100000:2.0:1789304593.417299:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 886 00000100:00100000:2.0:1789304593.417311:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:49691:x1876219765569920:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304593.421905:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:49691:x1876219765569920:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 4582us (4731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304593.421923:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 886 00000100:00100000:0.0:1789304593.468537:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304593.468759:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765570048 00000100:00100000:3.0:1789304593.468771:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765570048 00000100:00100000:3.0:1789304593.468841:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 887 00000100:00100000:3.0:1789304593.468852:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49692:x1876219765570048:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304593.468875:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304593.468900:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129677e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610052b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.468971:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.468988:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.469001:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304593.469051:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:3.0:1789304593.469054:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304593.469078:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.469132:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129677e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610052b expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.469168:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610052b expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.469184:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:3.0:1789304593.469187:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304593.469191:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304593.469268:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:49692:x1876219765570048:12345-192.168.202.29@tcp:101:rm.0 Request processed in 418us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304593.469276:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 887 00000100:00100000:1.0:1789304593.473662:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304593.473796:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765570304 00000100:00100000:0.0:1789304593.473807:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765570304 00000100:00100000:0.0:1789304593.473861:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 888 00000100:00100000:0.0:1789304593.473870:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:49692:x1876219765570304:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304593.473891:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304593.473909:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129678c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100532 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304593.474051:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00010000:0.0:1789304593.474743:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129678c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100532 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304593.474762:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:0.0:1789304593.474766:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789304593.474773:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129678c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100532 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304593.474789:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:1.0:1789304593.474910:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:49692:x1876219765570304:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1038us (1256us total) trans 4294967637 rc 301/301 00000100:00100000:1.0:1789304593.474918:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 888 00000100:00100000:2.0:1789304593.481896:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304593.482010:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765570432 00000100:00100000:3.0:1789304593.482033:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765570432 00000100:00100000:3.0:1789304593.482159:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 91 00000100:00100000:3.0:1789304593.482172:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:49692:x1876219765570432:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:3.0:1789304593.490988:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:49692:x1876219765570432:12345-192.168.202.29@tcp:37:rm.0 Request processed in 8806us (9089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304593.491003:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 91 00000100:00100000:0.0:1789304593.527627:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304593.527673:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765570688 00000100:00100000:0.0:1789304593.527695:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765570688 00000100:00100000:0.0:1789304593.527748:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 92 00000100:00100000:0.0:1789304593.527759:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:49692:x1876219765570688:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:0.0:1789304593.530140:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:49692:x1876219765570688:12345-192.168.202.29@tcp:35:rm.0 Request processed in 2372us (2512us total) trans 4294967638 rc 0/0 00000100:00100000:0.0:1789304593.530158:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 92 00000100:00100000:1.0:1789304593.545289:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304593.550676:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765570944 00000100:00100000:2.0:1789304593.550706:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765570944 00000100:00100000:2.0:1789304593.551004:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 889 00000100:00100000:2.0:1789304593.551017:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:49692:x1876219765570944:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304593.551084:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789304593.551128:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610052b expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551151:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129672a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100516 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551163:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:2.0:1789304593.551192:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296436 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100460 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551203:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304593.551209:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304593.551236:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129679a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551250:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129679a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551262:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129679a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551275:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551282:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551289:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551617:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312967a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551627:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312967a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.551636:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312967a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304593.552438:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00010000:2.0:1789304593.552457:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312967a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552465:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312967a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552473:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312967a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552480:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304593.552484:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312967a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552491:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312967a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552502:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304593.552506:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304593.552510:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312967a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552520:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312967a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552546:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129679a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552553:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129679a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552559:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129679a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552564:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304593.552567:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129679a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552573:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129679a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552580:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304593.552583:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304593.552585:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129679a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.552590:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb723129679a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304593.552602:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f2dce80 reply state 0000000058d1d9cd transno 4294967639 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304593.552610:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304593.552719:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:49692:x1876219765570944:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1702us (7439us total) trans 4294967639 rc 0/0 00000100:00100000:2.0:1789304593.552729:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 889 00010000:00010000:3.0:1789304593.571337:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.571357:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.571364:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.571371:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304593.571376:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.571385:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.571403:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c421d2d00) 00010000:00010000:3.0:1789304593.571406:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304593.571412:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304593.571418:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312967a1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304593.755794:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304594.195211:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304594.195235:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785647104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304594.195311:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304594.195370:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785647104 00000100:00100000:2.0:1789304594.195378:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785647104 00000100:00100000:2.0:1789304594.195437:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1789304594.195446:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785647104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304594.195480:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304594.195525:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785647104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304594.195531:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00080000:2.0:1789304594.195552:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304594.195589:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785647104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304594.277538:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304594.277577:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765571072 00000100:00100000:0.0:1789304594.277588:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765571072 00000100:00100000:0.0:1789304594.277640:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1173 00000100:00100000:0.0:1789304594.277651:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765571072:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304594.277735:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765571072:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304594.277743:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1173 00010000:00010000:0.0:1789304594.770270:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304595.219256:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304595.219281:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785647232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304595.219346:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304595.219406:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785647232 00000100:00100000:3.0:1789304595.219413:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785647232 00000100:00100000:3.0:1789304595.219464:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:3.0:1789304595.219474:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785647232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304595.219507:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304595.219552:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785647232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304595.219559:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:3.0:1789304595.219603:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785647232:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789304595.220150:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304595.794265:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304596.726971:0:84447:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc824c0750 20000000:00000080:2.0:1789304596.726992:0:84447:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f665800 uarg=0000000000000000 10000000:01000000:2.0:1789304596.727044:0:84447:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304596.727320:0:84447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304596.727341:0:84447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296428 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296421 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304596.727350:0:84447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304596.727520:0:84447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296428 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296421 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304596.727534:0:84447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296428 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296421 expref: 18 pid: 5845 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304596.727548:0:84447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84447:1876219785647360:0@lo:104: 00000100:00100000:2.0:1789304596.727612:0:84447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304596.727843:0:84447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752900 going to sleep for 11 seconds 00000100:00100000:0.0:1789304596.729406:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785647360 00000100:00100000:0.0:1789304596.729423:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785647360 00000100:00100000:0.0:1789304596.729535:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789304596.729546:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:84447:x1876219785647360:12345-0@lo:104: 00010000:00010000:0.0:1789304596.729563:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304596.729673:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304596.729680:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04087480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:84447:x1876219785647360:12345-0@lo:104: Request processed in 136us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304596.729687:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00010000:1.0:1789304596.729804:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304596.729814:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.729823:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371c00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304596.729829:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.729838:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304596.729847:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304596.729854:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304596.729897:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.729904:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304596.729929:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.729936:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41371c00/0xefc0bb7231296421 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296428 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.729974:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304596.729976:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304596.729984:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304596.730010:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785647488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304596.730052:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304596.730145:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785647488 00000100:00100000:1.0:1789304596.730150:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785647488 00010000:00010000:1.0:1789304596.730169:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296428 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296421 expref: 19 pid: 5845 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304596.730191:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789304596.730198:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785647488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304596.730210:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304596.730215:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296428 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296421 expref: 19 pid: 5845 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730225:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296428 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296421 expref: 19 pid: 5845 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730245:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730254:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730271:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730279:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730286:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730292:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730298:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304596.730302:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730310:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730319:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304596.730330:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304596.730536:0:84447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296428 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296421 expref: 19 pid: 5845 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304596.730553:0:84447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84447:1876219785647360:0@lo:104: 00010000:00010000:3.0:1789304596.730574:0:84447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304596.730583:0:84447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304596.730589:0:84447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304596.730596:0:84447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312967af lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304596.733079:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785647488:12345-0@lo:103:ldlm_bl.0 Request processed in 2861us (3005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304596.733110:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789304596.733186:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785647488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304596.755518:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785647616:0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.755585:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304596.755642:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785648128:0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.755688:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304596.755727:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304596.755732:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785648000:0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.755760:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304596.755786:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785647744:0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.755807:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304596.755824:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304596.755828:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785647872:0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.755844:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304596.755871:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785647616 00000100:00100000:3.0:1789304596.755877:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785647616 00000100:00100000:3.0:1789304596.755916:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785648000 00000100:00100000:3.0:1789304596.755918:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785648000 00000100:00100000:3.0:1789304596.755939:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785647872 00000100:00100000:3.0:1789304596.755952:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785647872 00000100:00100000:3.0:1789304596.755970:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1789304596.755977:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785647616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.756028:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785647616:12345-0@lo:400:kworker.0 Request processed in 51us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304596.756034:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1789304596.756049:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1789304596.756054:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785648000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.756107:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785648000:12345-0@lo:400:kworker.0 Request processed in 35us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304596.756112:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1789304596.756122:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:3.0:1789304596.756127:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785647872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.756166:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785647872:12345-0@lo:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304596.756173:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:3.0:1789304596.756189:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785648128 00000100:00100000:3.0:1789304596.756192:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785648128 00000100:00100000:3.0:1789304596.756215:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785647744 00000100:00100000:3.0:1789304596.756217:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785647744 00000100:00100000:3.0:1789304596.756229:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1789304596.756234:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785648128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.756261:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785648128:12345-0@lo:400:kworker.0 Request processed in 27us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304596.756267:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1789304596.756277:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1789304596.756284:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785647744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.756310:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785647744:12345-0@lo:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304596.756315:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00080000:3.0:1789304596.756345:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304596.756350:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304596.756387:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785648000:0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.756398:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785647616:0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.756406:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785648128:0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.756448:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785647872:0@lo:400:kworker.0 00000100:00100000:3.0:1789304596.756457:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785647744:0@lo:400:kworker.0 00010000:00010000:0.0:1789304596.818233:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304597.666055:0:84495:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6d468240 20000000:00000080:3.0:1789304597.666074:0:84495:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f6dec00 uarg=0000000000000000 00010000:00010000:3.0:1789304597.666616:0:84495:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789304597.666632:0:84495:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789304597.667335:0:84495:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304597.667359:0:84495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304597.667375:0:84495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304597.667387:0:84495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304597.667395:0:84495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304597.667402:0:84495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304597.667409:0:84495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304597.667416:0:84495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304597.667420:0:84495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304597.667428:0:84495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304597.667441:0:84495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304597.667449:0:84495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304597.667456:0:84495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312967b6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304597.843686:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304598.370184:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967638 is committed 00000001:00080000:1.0:1789304598.370207:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967639 is committed 10000000:01000000:2.0:1789304598.738217:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304598.738224:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304598.738229:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304598.738273:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304598.738285:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304598.738296:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304598.738319:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785648256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304598.738387:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304598.738436:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c07bc73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304598.738518:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785648256 00000100:00100000:0.0:1789304598.738526:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785648256 00000100:00100000:0.0:1789304598.738577:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1789304598.738585:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785648256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304598.738601:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304598.738614:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312967c4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312967bd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304598.738645:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312967c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312967bd expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304598.738656:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312967c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312967bd expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304598.738665:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afac00, rc 0) 00000100:00100000:0.0:1789304598.738898:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785648256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 312us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304598.738905:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:1.0:1789304598.739178:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04086680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785648256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304598.739195:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304598.739204:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304598.739222:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304598.739227:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304598.739235:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304598.868321:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304599.314272:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304599.314296:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785648384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304599.314370:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304599.314482:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785648384 00000100:00100000:2.0:1789304599.314492:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785648384 00000100:00100000:2.0:1789304599.314561:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:2.0:1789304599.314572:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785648384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304599.314609:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304599.314675:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785648384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304599.314684:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:2.0:1789304599.314737:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785648384:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304599.314802:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304599.396718:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304599.396809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304599.396847:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304599.396878:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304599.396906:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765571328 00000100:00100000:3.0:1789304599.396916:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765571328 00000100:00100000:2.0:1789304599.398108:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765571456 00000100:00100000:2.0:1789304599.398119:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765571456 00000100:00100000:2.0:1789304599.398173:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765571584 00000100:00100000:2.0:1789304599.398176:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765571584 00000100:00100000:2.0:1789304599.398205:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1090 00000100:00100000:2.0:1789304599.398215:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765571456:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304599.398301:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765571456:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304599.398309:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1090 00000100:00100000:2.0:1789304599.398325:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1091 00000100:00100000:2.0:1789304599.398332:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765571584:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304599.398357:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765571584:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304599.398362:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1091 00000100:00100000:2.0:1789304599.398530:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1452 00000100:00100000:2.0:1789304599.398540:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765571328:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304599.398586:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765571328:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 49us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304599.398593:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1452 00000100:00100000:1.0:1789304599.400959:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765571200 00000100:00100000:1.0:1789304599.400983:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765571200 00000100:00100000:1.0:1789304599.401042:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1175 00000100:00100000:1.0:1789304599.401051:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765571200:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304599.401141:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765571200:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 92us (4433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304599.401149:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1175 00000100:00080000:1.0:1789304599.401183:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304599.401187:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304599.401191:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304599.896084:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304600.339895:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785648512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304600.339983:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304600.340086:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785648512 00000100:00100000:2.0:1789304600.340112:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785648512 00000100:00100000:2.0:1789304600.340175:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1789304600.340185:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785648512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304600.340226:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304600.340271:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785648512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304600.340278:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00080000:2.0:1789304600.340301:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304600.340344:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785648512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304600.822862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304600.822968:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765571712 00000100:00100000:3.0:1789304600.822980:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765571712 00000100:00100000:3.0:1789304600.823054:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 890 00000100:00100000:3.0:1789304600.823066:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:49805:x1876219765571712:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304600.823131:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304600.823160:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312967cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100539 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.823357:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312967d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.823373:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312967d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.823387:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312967d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304600.823425:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789304600.823430:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304600.823453:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312967d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.823476:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312967cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100539 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.823497:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312967d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100539 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.823505:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304600.823509:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304600.823513:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ea00, rc 0) 00000100:00100000:3.0:1789304600.823579:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:49805:x1876219765571712:12345-192.168.202.29@tcp:101:rm.0 Request processed in 516us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304600.823586:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 890 00000100:00100000:1.0:1789304600.827210:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304600.827402:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765571840 00000100:00100000:3.0:1789304600.827412:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765571840 00000100:00100000:3.0:1789304600.827469:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 891 00000100:00100000:3.0:1789304600.827480:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:49805:x1876219765571840:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304600.827500:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304600.827520:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100540 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.827577:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312967e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.827591:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312967e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.827603:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312967e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.827630:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.827639:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.827645:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828004:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312967e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828013:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312967e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828020:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312967e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828027:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304600.828031:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312967e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828039:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312967e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828051:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304600.828054:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304600.828059:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312967e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828065:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312967e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828078:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828084:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828272:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828278:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304600.828280:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828286:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828294:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c2ea19b00) 00010000:00010000:3.0:1789304600.828296:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304600.828299:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828304:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828335:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100540 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828346:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304600.828348:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304600.828351:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100540 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.828360:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fa00, rc 0) 00000100:00100000:3.0:1789304600.828550:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:49805:x1876219765571840:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1070us (1356us total) trans 0 rc 301/301 00000100:00100000:3.0:1789304600.828557:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 891 00000100:00100000:2.0:1789304600.864386:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304600.864500:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765572224 00000100:00100000:3.0:1789304600.864512:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765572224 00000100:00100000:3.0:1789304600.864564:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 892 00000100:00100000:3.0:1789304600.864575:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:49809:x1876219765572224:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:3.0:1789304600.864643:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304600.864747:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312967d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100539 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.864767:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304600.864779:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304600.865010:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967ee lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.865026:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.865036:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.865049:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.865056:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.865063:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304600.865805:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000004:00200000:2.0:1789304600.867659:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00010000:2.0:1789304600.867857:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967ee lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304600.867868:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967ee lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304600.867875:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304600.867881:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304600.867885:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967ee lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304600.867892:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967ee lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304600.867908:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:2.0:1789304600.867911:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304600.867915:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304600.867921:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312967ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304600.867940:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cfd897a reply state 000000008f08b3e6 transno 4294967640 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304600.867949:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304600.868117:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:49809:x1876219765572224:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 3540us (3737us total) trans 4294967640 rc 0/0 00000100:00100000:2.0:1789304600.868126:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 892 00000100:00100000:2.0:1789304600.868166:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765571968 00000100:00100000:2.0:1789304600.868173:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765571968 00000100:00100000:2.0:1789304600.868233:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 893 00000100:00100000:2.0:1789304600.868242:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765571968:12345-192.168.202.29@tcp:41:mkdir.0 00000004:00000024:2.0:1789304600.868273:0:30980:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789304600.868303:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765571968:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 63us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304600.868309:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 893 00010000:00010000:3.0:1789304600.871528:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.871546:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.871555:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.871562:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304600.871566:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.871574:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.871591:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304600.871593:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304600.871598:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.871604:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967f5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304600.913600:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304600.913849:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765572352 00000100:00100000:3.0:1789304600.913859:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765572352 00000100:00100000:3.0:1789304600.913958:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 894 00000100:00100000:3.0:1789304600.913970:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:49813:x1876219765572352:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:3.0:1789304600.913995:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304600.914019:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100547 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.914085:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296803 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.914142:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.914167:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304600.914211:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789304600.914215:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304600.914238:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296803 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.914262:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312967fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100547 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.914282:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296803 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100547 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.914289:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304600.914292:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304600.914295:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ea00, rc 0) 00000100:00100000:3.0:1789304600.914350:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:49813:x1876219765572352:12345-192.168.202.29@tcp:101:chown.0 Request processed in 383us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304600.914358:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 894 00010000:00010000:2.0:1789304600.914716:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304600.918409:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304600.918486:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765572480 00000100:00100000:3.0:1789304600.918495:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765572480 00000100:00100000:3.0:1789304600.918556:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 895 00000100:00100000:3.0:1789304600.918566:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49813:x1876219765572480:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:3.0:1789304600.918585:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304600.918606:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129680a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610054e expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918704:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296811 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918720:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918741:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918756:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296818 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918763:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918770:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918865:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129681f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918874:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129681f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918881:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129681f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304600.918911:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:3.0:1789304600.918915:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304600.918933:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129681f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918945:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296811 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918951:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296811 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918959:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918964:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304600.918968:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296811 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918976:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296811 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918986:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304600.918988:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304600.918992:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.918998:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.919011:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296818 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.919017:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296818 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.919023:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.919029:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304600.919032:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296818 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.919038:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296818 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.919044:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304600.919046:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304600.919048:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296818 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.919054:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296818 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.919078:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129680a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610054e expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.919124:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129681f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610054e expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304600.919132:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304600.919134:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304600.919136:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304600.919899:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:49813:x1876219765572480:12345-192.168.202.29@tcp:101:chown.0 Request processed in 1332us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304600.919907:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 895 00000100:00100000:0.0:1789304600.924566:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304600.924761:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765572736 00000100:00100000:1.0:1789304600.924772:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765572736 00000100:00100000:1.0:1789304600.924891:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 896 00000100:00100000:1.0:1789304600.924903:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:49813:x1876219765572736:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:1.0:1789304600.925013:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304600.925057:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb723129681f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610054e expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304600.925079:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:1.0:1789304600.925127:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304600.925390:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304600.925405:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304600.925416:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789304600.972344:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967641 is committed 00000004:00010000:2.0:1789304600.972366:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e815ae95 reply state 00000000fb4b59f1 transno 4294967641 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304600.972387:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789304600.972417:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00080000:2.0:1789304600.972525:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789304600.972545:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:49813:x1876219765572736:12345-192.168.202.29@tcp:36:chown.0 Request processed in 47640us (47984us total) trans 4294967641 rc 0/0 00000100:00100000:2.0:1789304600.972554:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 896 00010000:00010000:1.0:1789304600.972661:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304600.972795:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304600.972805:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304600.972811:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304600.972816:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304600.972825:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304600.972841:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:1.0:1789304600.972845:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304600.972850:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304600.972856:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296826 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304601.876484:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785648896:0@lo:400:kworker.0 00000100:00100000:2.0:1789304601.876556:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304601.876617:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304601.876623:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785649024:0@lo:400:kworker.0 00000100:00100000:2.0:1789304601.876657:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304601.876693:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785648896 00000100:00100000:2.0:1789304601.876701:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785648896 00000100:00100000:2.0:1789304601.876759:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:2.0:1789304601.876769:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785648896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304601.876823:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785648896:12345-0@lo:400:kworker.0 Request processed in 56us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304601.876831:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:2.0:1789304601.876877:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785648896:0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.877422:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785648768:0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.877460:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304601.877483:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b020bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785649280:0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.877517:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304601.877540:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789304601.877546:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785648640:0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.877575:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304601.877600:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b020bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785649152:0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.877636:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304601.877729:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785649024 00000100:00100000:0.0:1789304601.877735:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785649024 00000100:00100000:0.0:1789304601.877901:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785648768 00000100:00100000:0.0:1789304601.877906:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785648768 00000100:00100000:0.0:1789304601.877927:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:0.0:1789304601.877934:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785649024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.877985:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785649024:12345-0@lo:400:kworker.0 Request processed in 51us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304601.877991:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:0.0:1789304601.878004:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785649152 00000100:00100000:0.0:1789304601.878007:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785649152 00000100:00100000:0.0:1789304601.878026:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1789304601.878031:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785648768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.878061:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785648768:12345-0@lo:400:kworker.0 Request processed in 30us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304601.878067:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1789304601.878080:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1789304601.878086:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785649152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.878133:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785649152:12345-0@lo:400:kworker.0 Request processed in 47us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304601.878139:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1789304601.878157:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785649280 00000100:00100000:0.0:1789304601.878161:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785649280 00000100:00100000:0.0:1789304601.878187:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1789304601.878194:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785649280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.878225:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785649280:12345-0@lo:400:kworker.0 Request processed in 31us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304601.878232:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1789304601.878249:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785648640 00000100:00100000:0.0:1789304601.878253:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785648640 00000100:00100000:0.0:1789304601.878277:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1789304601.878955:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785648640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.878997:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785648640:12345-0@lo:400:kworker.0 Request processed in 48us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304601.879002:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00080000:0.0:1789304601.879042:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304601.879047:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304601.879126:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785649024:0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.879176:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785648640:0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.879188:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b020bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785649152:0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.879199:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785648768:0@lo:400:kworker.0 00000100:00100000:0.0:1789304601.879209:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b020bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785649280:0@lo:400:kworker.0 00000020:00000080:1.0:1789304601.880497:0:84692:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3b494410 20000000:00000080:1.0:1789304601.880515:0:84692:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02f30800 uarg=0000000000000000 10000000:01000000:1.0:1789304601.880564:0:84692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304601.880586:0:84692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304601.880619:0:84692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312967c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312967bd expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304601.880633:0:84692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304601.880924:0:84692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312967c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312967bd expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304601.880939:0:84692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312967c4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312967bd expref: 18 pid: 5845 timeout: 2201 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304601.880954:0:84692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84692:1876219785649408:0@lo:104: 00000100:00100000:1.0:1789304601.881016:0:84692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304601.881069:0:84692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38835480 going to sleep for 11 seconds 00000100:00100000:0.0:1789304601.881302:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785649408 00000100:00100000:0.0:1789304601.881313:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785649408 00000100:00100000:0.0:1789304601.881378:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789304601.881390:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:84692:x1876219785649408:12345-0@lo:104: 00010000:00010000:0.0:1789304601.881408:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.881474:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304601.881481:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:84692:x1876219785649408:12345-0@lo:104: Request processed in 94us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304601.881489:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:0.0:1789304601.881519:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304601.881526:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.881534:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304601.881538:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.881547:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304601.881556:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304601.881562:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304601.881596:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.881615:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304601.881637:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.881643:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb72312967bd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312967c4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.881676:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304601.881678:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304601.881680:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304601.881695:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304601.881708:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0136a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785649536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304601.881739:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304601.882022:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785649536 00000100:00100000:0.0:1789304601.882028:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785649536 00010000:00010000:0.0:1789304601.882052:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312967c4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312967bd expref: 19 pid: 5845 timeout: 2201 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304601.882077:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1789304601.882084:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785649536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304601.882125:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304601.882130:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312967c4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312967bd expref: 19 pid: 5845 timeout: 2201 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882141:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312967c4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312967bd expref: 19 pid: 5845 timeout: 2201 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882158:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882166:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882180:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882198:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882205:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882211:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882217:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304601.882221:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882229:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882237:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.882247:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304601.882411:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785649536:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304601.882417:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1789304601.883061:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0136a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785649536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304601.883199:0:84692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312967c4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312967bd expref: 18 pid: 5845 timeout: 2201 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304601.883212:0:84692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:84692:1876219785649408:0@lo:104: 00010000:00010000:1.0:1789304601.883228:0:84692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304601.883236:0:84692:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304601.883242:0:84692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304601.883248:0:84692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370a00/0xefc0bb723129682d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304601.939582:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304602.964142:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304602.999994:0:84740:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffde8ddc00 20000000:00000080:1.0:1789304603.000016:0:84740:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02f32800 uarg=0000000000000000 00010000:00010000:1.0:1789304603.000548:0:84740:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304603.000588:0:84740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:1.0:1789304603.001350:0:84740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304603.001370:0:84740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296803 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100547 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001402:0:84740:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304603.001427:0:84740:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304603.001446:0:84740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001461:0:84740:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001473:0:84740:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001480:0:84740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001488:0:84740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001494:0:84740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001500:0:84740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371c00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304603.001505:0:84740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001519:0:84740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001531:0:84740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001539:0:84740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.001545:0:84740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231296834 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304603.859161:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304603.859168:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304603.859172:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304603.859221:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304603.859234:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304603.859245:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304603.859275:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0136a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785649664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304603.859355:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304603.859415:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789304603.859577:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785649664 00000100:00100000:1.0:1789304603.859594:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785649664 00000100:00100000:1.0:1789304603.859655:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1789304603.859665:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785649664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304603.859680:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304603.859695:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231296842 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129683b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.859720:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231296842 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129683b expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.859730:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231296842 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129683b expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304603.859739:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371e00, rc 0) 00000100:00100000:1.0:1789304603.859838:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785649664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304603.859847:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:3.0:1789304603.860405:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0136a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785649664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304603.860424:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304603.860434:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304603.860457:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304603.860462:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304603.860470:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304603.986744:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304604.434813:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304604.434837:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785649792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304604.434908:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304604.434971:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785649792 00000100:00100000:0.0:1789304604.434979:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785649792 00000100:00100000:0.0:1789304604.435036:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1789304604.435041:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785649792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304604.435071:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304604.435137:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785649792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304604.435142:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00080000:0.0:1789304604.435157:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304604.435185:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785649792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304604.519247:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304604.519459:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765572864 00000100:00100000:3.0:1789304604.519470:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765572864 00000100:00100000:3.0:1789304604.519530:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1178 00000100:00100000:3.0:1789304604.519540:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765572864:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304604.519634:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765572864:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 95us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304604.519642:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1178 00000100:00100000:2.0:1789304604.534261:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304604.534350:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304604.534408:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304604.534958:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765573248 00000100:00100000:3.0:1789304604.534970:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765573248 00000100:00100000:3.0:1789304604.535061:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765573120 00000100:00100000:3.0:1789304604.535065:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765573120 00000100:00100000:3.0:1789304604.535113:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1094 00000100:00100000:3.0:1789304604.535124:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765573248:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304604.535224:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765573248:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 102us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304604.535232:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1094 00000100:00100000:3.0:1789304604.535252:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1095 00000100:00100000:3.0:1789304604.535259:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765573120:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304604.535285:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765573120:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304604.535292:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1095 00000100:00080000:2.0:1789304604.536244:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304604.536251:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304604.539369:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765572992 00000100:00100000:0.0:1789304604.539557:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765572992 00000100:00100000:1.0:1789304604.544477:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1456 00000100:00100000:1.0:1789304604.544495:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765572992:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304604.544601:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765572992:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 109us (10353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304604.544610:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1456 00000100:00080000:0.0:1789304604.545183:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304605.017390:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304605.459279:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304605.468839:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b020bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785649920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304605.468919:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304605.468997:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785649920 00000100:00100000:0.0:1789304605.469005:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785649920 00000100:00100000:0.0:1789304605.469062:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1789304605.469072:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785649920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304605.469136:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304605.469188:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785649920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304605.469195:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00080000:0.0:1789304605.469217:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304605.469255:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b020bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785649920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304606.034270:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304606.174573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304606.174679:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765573376 00000100:00100000:1.0:1789304606.174690:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765573376 00000100:00100000:1.0:1789304606.174761:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:1.0:1789304606.174769:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:5593:x1876219765573376:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304606.174782:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304606.174784:0:5837:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231296803) 00010000:00010000:1.0:1789304606.174786:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304606.174841:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:5593:x1876219765573376:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 74us (1443us total) trans 0 rc 116/116 00000100:00100000:1.0:1789304606.174847:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00080000:0.0:1789304606.175188:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304606.994468:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785650176:0@lo:400:kworker.0 00000100:00100000:0.0:1789304606.994540:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304606.994603:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0136b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785650688:0@lo:400:kworker.0 00000100:00100000:3.0:1789304606.994722:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0136ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785650432:0@lo:400:kworker.0 00000100:00100000:3.0:1789304606.994753:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304606.994783:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789304606.994790:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0136b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785650048:0@lo:400:kworker.0 00000100:00100000:3.0:1789304606.994834:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304606.994860:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0136aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785650560:0@lo:400:kworker.0 00000100:00100000:3.0:1789304606.994884:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304606.994913:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785650176 00000100:00100000:3.0:1789304606.994921:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785650176 00000100:00100000:3.0:1789304606.994964:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785650432 00000100:00100000:3.0:1789304606.994967:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785650432 00000100:00100000:3.0:1789304606.994993:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785650560 00000100:00100000:3.0:1789304606.994996:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785650560 00000100:00100000:3.0:1789304606.995010:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1789304606.995016:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785650176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304606.995062:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785650176:12345-0@lo:400:kworker.0 Request processed in 45us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304606.995069:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1789304606.995084:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1789304606.995122:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785650432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304606.995290:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785650432:12345-0@lo:400:kworker.0 Request processed in 199us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304606.995297:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1789304606.995309:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:3.0:1789304606.995316:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785650560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304606.995342:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785650560:12345-0@lo:400:kworker.0 Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304606.995347:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:3.0:1789304606.995388:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0136aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785650560:0@lo:400:kworker.0 00000100:00100000:3.0:1789304606.995399:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0136ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785650432:0@lo:400:kworker.0 00000100:00100000:0.0:1789304606.995474:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304606.995510:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785650176:0@lo:400:kworker.0 00000100:00100000:0.0:1789304606.995520:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304606.995526:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0136bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785650304:0@lo:400:kworker.0 00000100:00100000:0.0:1789304606.995549:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304606.995599:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785650048 00000100:00100000:0.0:1789304606.995603:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785650048 00000100:00100000:0.0:1789304606.995628:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1789304606.995635:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785650048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304606.995670:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785650048:12345-0@lo:400:kworker.0 Request processed in 35us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304606.995675:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00080000:0.0:1789304606.995699:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304606.995710:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785650688 00000100:00100000:0.0:1789304606.995713:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785650688 00000100:00100000:0.0:1789304606.995741:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785650304 00000100:00100000:0.0:1789304606.995744:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785650304 00000100:00100000:0.0:1789304606.995762:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1789304606.995768:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0136a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785650688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304606.996227:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1789304606.996237:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785650304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304606.996269:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785650304:12345-0@lo:400:kworker.0 Request processed in 36us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304606.996275:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1789304606.996675:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0136a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785650688:12345-0@lo:400:kworker.0 Request processed in 905us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304606.996683:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00080000:0.0:1789304606.996707:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304606.996737:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0136b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785650048:0@lo:400:kworker.0 00000100:00100000:0.0:1789304606.996768:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0136bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785650304:0@lo:400:kworker.0 00000100:00100000:0.0:1789304606.996778:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0136b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785650688:0@lo:400:kworker.0 00010000:00010000:1.0:1789304607.070816:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304607.258282:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304607.258370:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765573504 00000100:00100000:3.0:1789304607.258381:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765573504 00000100:00100000:3.0:1789304607.258442:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 897 00000100:00100000:3.0:1789304607.258454:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0136b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:49918:x1876219765573504:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304607.258478:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304607.258503:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296849 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100555 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.258594:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296850 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.258613:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.258638:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304607.258680:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789304607.258684:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304607.258704:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296850 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.258729:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296849 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100555 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.258745:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296850 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100555 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.258754:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304607.258757:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304607.258761:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f600, rc 0) 00000100:00100000:3.0:1789304607.258830:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0136b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:49918:x1876219765573504:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 378us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304607.258838:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 897 00000100:00100000:3.0:1789304607.263787:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304607.264003:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765573632 00000100:00100000:0.0:1789304607.264014:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765573632 00000100:00100000:0.0:1789304607.264081:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 898 00000100:00100000:0.0:1789304607.264127:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:49918:x1876219765573632:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304607.264152:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304607.264176:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296857 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610055c expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264249:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129685e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264265:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129685e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264278:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129685e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264293:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296865 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264300:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296865 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264307:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296865 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264577:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129686c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264586:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129686c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264594:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129686c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304607.264629:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:0.0:1789304607.264633:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304607.264655:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129686c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264667:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129685e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264674:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129685e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264681:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129685e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264688:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304607.264692:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129685e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264700:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129685e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264713:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:0.0:1789304607.264716:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304607.264721:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129685e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264728:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb723129685e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264743:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296865 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264749:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296865 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264755:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296865 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264760:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304607.264763:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296865 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264769:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296865 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264776:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c0558d200) 00010000:00010000:0.0:1789304607.264779:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304607.264781:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296865 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264787:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296865 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264825:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610055c expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264839:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129686c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610055c expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.264846:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:0.0:1789304607.264849:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304607.264851:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789304607.264924:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:49918:x1876219765573632:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 833us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304607.264932:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 898 00000100:00100000:0.0:1789304607.276193:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304607.276348:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765573888 00000100:00100000:3.0:1789304607.276358:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765573888 00000100:00100000:3.0:1789304607.276412:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 899 00000100:00100000:3.0:1789304607.276633:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0136bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:49918:x1876219765573888:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304607.276689:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304607.276717:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb723129686c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610055c expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.276739:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:3.0:1789304607.276751:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304607.276777:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.276790:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.276801:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789304607.387442:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967642 is committed 00000004:00010000:3.0:1789304607.387525:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d745b71 reply state 0000000063bd83ff transno 4294967642 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304607.387539:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304607.387571:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00080000:3.0:1789304607.387928:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304607.387953:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0136bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:49918:x1876219765573888:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 111320us (111764us total) trans 4294967642 rc 0/0 00000100:00100000:3.0:1789304607.387962:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 899 00010000:00010000:1.0:1789304607.388035:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.388044:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.388052:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.388063:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304607.388068:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.388076:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.388125:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:1.0:1789304607.388129:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304607.388143:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.388149:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296873 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304607.451321:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304607.453303:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765574016 00000100:00100000:1.0:1789304607.453319:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765574016 00000100:00100000:2.0:1789304607.454281:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 900 00000100:00100000:2.0:1789304607.454297:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0136b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:49922:x1876219765574016:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789304607.454325:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304607.454351:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129687a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100563 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454416:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296881 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454432:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454458:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454474:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296888 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454482:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454489:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454864:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129688f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454874:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129688f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454881:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129688f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304607.454910:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:2.0:1789304607.454914:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304607.454935:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129688f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454946:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454953:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296881 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454959:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296881 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454965:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304607.454970:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296881 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454977:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296881 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.454988:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:2.0:1789304607.454991:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304607.454996:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296881 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455002:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296881 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455015:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455026:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296888 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455032:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455037:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304607.455040:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455045:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296888 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455052:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c421d2200) 00010000:00010000:2.0:1789304607.455055:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304607.455057:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296888 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455062:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296888 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455148:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb723129687a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100563 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455164:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129688f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100563 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304607.455171:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:2.0:1789304607.455175:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304607.455178:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40eccc00, rc 0) 00000100:00100000:2.0:1789304607.455258:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0136b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49922:x1876219765574016:12345-192.168.202.29@tcp:101:touch.0 Request processed in 964us (3953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304607.455265:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 900 00000100:00100000:3.0:1789304607.459187:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304607.459311:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765574272 00000100:00100000:1.0:1789304607.459321:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765574272 00000100:00100000:1.0:1789304607.459381:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 901 00000100:00100000:1.0:1789304607.459391:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49922:x1876219765574272:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304607.459411:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304607.459430:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296896 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610056a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.460002:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129689d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.460019:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129689d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.460032:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129689d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.460128:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.460508:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.460517:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789304607.464355:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c:0x0], index 1: 0 00010000:00010000:1.0:1789304607.466381:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312968ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.466405:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312968ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.466418:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312968ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.466543:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129689d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.466562:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129689d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.466570:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129689d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.466576:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304607.466580:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129689d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.466588:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129689d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.466905:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:1.0:1789304607.466910:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304607.466916:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129689d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.466923:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129689d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304607.466938:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ed162eb reply state 0000000070c263e1 transno 4294967643 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304607.466947:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789304607.466988:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296896 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610056a expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.467003:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312968ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610056a expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.467011:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9e2c14add100) 00010000:00010000:1.0:1789304607.467013:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304607.467016:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371800, rc 0) 00000100:00100000:1.0:1789304607.467228:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:49922:x1876219765574272:12345-192.168.202.29@tcp:101:touch.0 Request processed in 7836us (8048us total) trans 4294967643 rc 0/0 00000100:00100000:1.0:1789304607.467237:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 901 00010000:00010000:3.0:1789304607.469374:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.469397:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.469907:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.469917:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304607.469924:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.469933:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.469951:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c14add400) 00010000:00010000:3.0:1789304607.469955:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304607.469960:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.469967:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312968a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304607.471964:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304607.472277:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765574528 00000100:00100000:0.0:1789304607.472291:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765574528 00000100:00100000:0.0:1789304607.472361:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 902 00000100:00100000:0.0:1789304607.472373:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:49922:x1876219765574528:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:0.0:1789304607.472436:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304607.472464:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312968ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610056a expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.472481:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9e2c14add100) 00010000:00010000:0.0:1789304607.472492:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304607.472540:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.472566:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.472578:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304607.473572:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7827461 reply state 000000006498b26e transno 4294967644 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304607.473586:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304607.474316:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:49922:x1876219765574528:12345-192.168.202.29@tcp:36:touch.0 Request processed in 1941us (2359us total) trans 4294967644 rc 0/0 00000100:00100000:1.0:1789304607.474326:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 902 00000100:00100000:1.0:1789304607.476952:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304607.479026:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765574656 00000100:00100000:3.0:1789304607.479044:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765574656 00000100:00100000:3.0:1789304607.479194:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 903 00000100:00100000:3.0:1789304607.479206:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:49922:x1876219765574656:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304607.479231:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304607.479256:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312968c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100571 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.479333:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312968c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100571 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.479350:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312968c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100571 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.479371:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9e2c0558d200) 00010000:00010000:3.0:1789304607.479375:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789304607.479378:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304607.479443:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:49922:x1876219765574656:12345-192.168.202.29@tcp:101:touch.0 Request processed in 239us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304607.479450:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 903 00010000:00010000:0.0:1789304607.479657:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.479667:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.479674:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.479679:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304607.479683:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.479691:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.479703:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9e2c0558d200) 00010000:00010000:0.0:1789304607.479706:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304607.479710:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.479716:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb72312968b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304607.484671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304607.484776:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765574784 00000100:00100000:3.0:1789304607.484793:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765574784 00000100:00100000:3.0:1789304607.484900:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 486 00000100:00100000:3.0:1789304607.484913:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765574784:12345-192.168.202.29@tcp:2:touch.0 00000100:00100000:3.0:1789304607.485328:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765574784:12345-192.168.202.29@tcp:2:touch.0 Request processed in 417us (667us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789304607.485336:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 486 00000100:00080000:0.0:1789304607.485418:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304607.490937:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304607.491005:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765575040 00000100:00100000:0.0:1789304607.491016:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765575040 00000100:00100000:0.0:1789304607.491077:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 93 00000100:00100000:0.0:1789304607.491134:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:49922:x1876219765575040:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:0.0:1789304607.491433:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:49922:x1876219765575040:12345-192.168.202.29@tcp:35:touch.0 Request processed in 347us (509us total) trans 4294967645 rc 0/0 00000100:00100000:0.0:1789304607.491648:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 93 00000100:00100000:2.0:1789304607.562949:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304607.563085:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765575168 00000100:00100000:1.0:1789304607.563132:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765575168 00000100:00100000:1.0:1789304607.563194:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 904 00000100:00100000:1.0:1789304607.563205:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:49926:x1876219765575168:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304607.563230:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304607.563256:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312968c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100578 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563320:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312968ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563336:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312968ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563346:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312968ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563360:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312968d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563367:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312968d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563374:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312968d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563465:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312968dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563473:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312968dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563481:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312968dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304607.563512:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4a:0x0]: returning size 0 00000004:00200000:1.0:1789304607.563516:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304607.563534:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312968dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563547:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312968dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563567:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312968ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563573:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312968ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563580:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312968ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563586:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304607.563590:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312968ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563839:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312968ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563853:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:1.0:1789304607.563856:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304607.563862:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312968ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563869:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312968ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563883:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312968d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563890:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312968d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563896:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312968d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563901:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371c00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304607.563904:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312968d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563910:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312968d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563917:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c14adda00) 00010000:00010000:1.0:1789304607.563920:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304607.563923:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312968d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.563934:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312968d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.564029:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312968c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100578 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.564047:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312968dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100578 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.564054:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9e2c0558d200) 00010000:00010000:1.0:1789304607.564057:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304607.564060:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370000, rc 0) 00000100:00100000:2.0:1789304607.564494:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:49926:x1876219765575168:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1289us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304607.564504:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 904 00000100:00100000:1.0:1789304607.568328:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304607.568772:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765575296 00000100:00100000:0.0:1789304607.568782:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765575296 00000100:00100000:0.0:1789304607.568853:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 487 00000100:00100000:0.0:1789304607.568861:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765575296:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304607.568876:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304607.568894:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb72312968e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610057f expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304607.568915:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x6aa69f1f, atime: 0x6aa69f1f, ctime: 0x6aa69f1f, blocks: 0x1 00010000:00010000:0.0:1789304607.568931:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=2057s v=(0 0) 00010000:00010000:0.0:1789304607.568934:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304607.568940:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb72312968e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610057f expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.568955:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb72312968e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610057f expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304607.568968:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:0.0:1789304607.569029:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765575296:12345-192.168.202.29@tcp:101:rm.0 Request processed in 168us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304607.569037:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 487 00000100:00100000:0.0:1789304607.570985:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304607.571180:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765575552 00000100:00100000:1.0:1789304607.571192:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765575552 00000100:00100000:1.0:1789304607.571283:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 905 00000100:00100000:1.0:1789304607.571291:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0136b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:49926:x1876219765575552:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:1.0:1789304607.571335:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304607.571358:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312968dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100578 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.571376:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312968c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100571 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.571385:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9e2c0558d200) 00010000:00010000:1.0:1789304607.571391:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304607.571408:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb72312968ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.571417:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb72312968ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.571424:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb72312968ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.571432:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.571436:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.571440:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.571515:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312968f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.571520:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312968f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.571524:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312968f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789304607.572451:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].28, 64 off9984 00000004:00080000:1.0:1789304607.572460:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2057250368805ns, next at 2058250367263ns, rc = 0 00010000:00010000:1.0:1789304607.572502:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572510:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572517:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572522:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572525:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572529:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572546:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304607.572592:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304607.572613:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.572621:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304607.572625:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.572636:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.572647:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:3.0:1789304607.572650:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304607.572654:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.572659:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312968ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.572670:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304607.572672:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304607.572673:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304607.572910:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312968f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572916:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312968f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572920:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312968f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572922:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304607.572925:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312968f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572929:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312968f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572934:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:1.0:1789304607.572936:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789304607.572939:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312968f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.572942:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312968f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.573731:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb72312968ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.573742:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb72312968ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.573749:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb72312968ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.573754:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304607.573757:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb72312968ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.573764:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb72312968ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.573776:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:1.0:1789304607.573778:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304607.573782:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb72312968ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304607.573787:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb72312968ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304607.573798:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008aff1bf1 reply state 000000009930bf69 transno 4294967646 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304607.573811:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304607.573932:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0136b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:49926:x1876219765575552:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2636us (2950us total) trans 4294967646 rc 0/0 00000100:00100000:1.0:1789304607.573941:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 905 00010000:00010000:3.0:1789304607.577085:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.577127:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.577135:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.577141:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304607.577147:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.577165:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.577180:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c14addc00) 00010000:00010000:3.0:1789304607.577183:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304607.577187:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304607.577191:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312968f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.084766:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304608.605581:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304608.605781:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765575680 00000100:00100000:3.0:1789304608.605790:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765575680 00000100:00100000:3.0:1789304608.605847:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 906 00000100:00100000:3.0:1789304608.605855:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:49941:x1876219765575680:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304608.605875:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304608.605893:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296906 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100586 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.605945:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129690d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.605955:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129690d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.605964:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129690d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304608.605994:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:3.0:1789304608.605997:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304608.606011:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129690d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.606029:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296906 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100586 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.606044:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129690d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100586 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.606050:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:3.0:1789304608.606052:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304608.606055:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e000, rc 0) 00000100:00100000:3.0:1789304608.606129:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:49941:x1876219765575680:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 275us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304608.606133:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 906 00000100:00080000:0.0:1789304608.606245:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304608.609389:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304608.609473:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765575936 00000100:00100000:0.0:1789304608.609483:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765575936 00000100:00100000:0.0:1789304608.609538:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 907 00000100:00100000:0.0:1789304608.609557:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:49941:x1876219765575936:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304608.609629:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304608.609655:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129690d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100586 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.609678:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb723129688f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100563 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.609820:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:0.0:1789304608.609830:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304608.609851:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.609861:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.609868:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789304608.651902:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967647 is committed 00000004:00080000:3.0:1789304608.651924:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 80 committed 00000100:00100000:3.0:1789304608.652046:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785650816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789304608.652131:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304608.652213:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785650816 00000100:00100000:3.0:1789304608.652221:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785650816 00000100:00100000:3.0:1789304608.652269:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1789304608.652276:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785650816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789304608.652302:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:28 count 1 00010000:00010000:3.0:1789304608.652325:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.652346:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb72312968e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610057f expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.652360:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789304608.652365:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304608.652369:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.652394:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb72312968e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610057f expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.652407:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb72312968e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610057f expref: 6 pid: 6691 timeout: 2158 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304608.652418:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876219785650944:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304608.652472:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c06287f00 going to sleep for 11 seconds 00000004:00010000:0.0:1789304608.652812:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c43be05 reply state 00000000f1d1ed01 transno 4294967647 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304608.652823:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304608.652837:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000100:00080000:3.0:1789304608.652879:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789304608.652890:0:5852:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789304608.652904:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:49941:x1876219765575936:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 43349us (43523us total) trans 4294967647 rc 0/0 00000100:00100000:0.0:1789304608.652912:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 907 00010000:00010000:0.0:1789304608.652940:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.652947:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.652954:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.652960:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304608.652964:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.652972:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.652986:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c0558d200) 00010000:00010000:0.0:1789304608.652989:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304608.652994:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.653000:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296914 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304608.657355:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1876219785650944:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789304608.657392:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304608.660828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304608.660902:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765576064 00000100:00100000:0.0:1789304608.660915:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765576064 00010000:00010000:0.0:1789304608.660961:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb72312968e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610057f expref: 7 pid: 6691 timeout: 2158 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304608.661035:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 385 00000100:00100000:0.0:1789304608.661045:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765576064:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789304608.661061:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304608.661067:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb72312968e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610057f expref: 7 pid: 6691 timeout: 2158 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.661082:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb72312968e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610057f expref: 7 pid: 6691 timeout: 2158 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.661141:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddb79b7e/0xefc0bb72312968e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610057f expref: 7 pid: 6691 timeout: 2158 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.661158:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304608.661162:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304608.661169:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.661179:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.661212:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304608.661269:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765576064:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 225us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304608.661276:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 385 00010000:00010000:1.0:1789304608.661346:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.661357:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.661367:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.661375:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.661392:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789304608.661961:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04015f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785650816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9683us (9828us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789304608.661970:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000004:00080000:3.0:1789304608.661992:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b04016300/2, rc 0, transno 4294967353 00010000:00010000:1.0:1789304608.661997:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789304608.662000:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785650816:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789304608.662004:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.662013:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304608.662017:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.662028:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.662041:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.662049:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129691b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.662066:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304608.662068:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304608.662070:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304608.728834:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304608.728911:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765576192 00000100:00100000:1.0:1789304608.728921:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765576192 00000100:00100000:1.0:1789304608.728981:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 908 00000100:00100000:1.0:1789304608.728992:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:49945:x1876219765576192:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304608.729016:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304608.729036:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296922 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610058d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729126:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296929 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729141:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296929 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729153:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296929 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729181:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296930 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729188:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729195:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729483:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231296937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729492:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231296937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729500:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231296937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304608.729528:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:1.0:1789304608.729532:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304608.729562:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231296937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729573:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296929 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729580:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296929 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729586:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296929 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729595:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304608.729599:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296929 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729607:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296929 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729618:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:1.0:1789304608.729620:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304608.729756:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296929 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729765:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296929 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729778:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729784:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296930 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729789:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729793:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304608.729796:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729801:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296930 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729811:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c14add200) 00010000:00010000:1.0:1789304608.729813:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304608.729817:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296930 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729823:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231296930 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729855:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610058d expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729869:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231296937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610058d expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.729876:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:1.0:1789304608.729878:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304608.729880:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370200, rc 0) 00000100:00100000:1.0:1789304608.729951:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:49945:x1876219765576192:12345-192.168.202.29@tcp:101:touch.0 Request processed in 960us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304608.729959:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 908 00000100:00100000:3.0:1789304608.733315:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304608.733353:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765576448 00000100:00100000:3.0:1789304608.733364:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765576448 00000100:00100000:3.0:1789304608.733414:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 909 00000100:00100000:3.0:1789304608.733424:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:49945:x1876219765576448:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304608.733445:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304608.733463:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb723129693e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100594 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.735934:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296945 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.735959:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296945 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.735970:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296945 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.735986:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.735993:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.735999:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304608.739252:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d:0x0], index 0: 0 00010000:00010000:3.0:1789304608.739616:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.739634:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.739648:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.739877:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296945 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.739891:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296945 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.739898:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296945 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.739903:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304608.739908:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296945 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.739915:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296945 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.739927:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:3.0:1789304608.739929:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304608.739934:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296945 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.739941:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296945 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304608.739954:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001137a148 reply state 0000000034dde0f4 transno 4294967648 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304608.739963:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304608.740002:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb723129693e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100594 expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.740018:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100594 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.740032:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304608.740034:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304608.740036:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304608.740400:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:49945:x1876219765576448:12345-192.168.202.29@tcp:101:touch.0 Request processed in 6976us (7095us total) trans 4294967648 rc 0/0 00000100:00100000:3.0:1789304608.740409:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 909 00010000:00010000:0.0:1789304608.744474:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.744494:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.744502:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.744508:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304608.744513:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.744521:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.744549:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c2ea19900) 00010000:00010000:0.0:1789304608.744553:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304608.744558:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.744564:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129694c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304608.747672:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304608.748359:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765576704 00000100:00100000:3.0:1789304608.748372:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765576704 00000100:00100000:3.0:1789304608.748478:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 910 00000100:00100000:3.0:1789304608.748490:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:49945:x1876219765576704:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:3.0:1789304608.748564:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304608.748603:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100594 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.748632:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304608.748644:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304608.748763:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.748777:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.748786:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304608.748919:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d238e2d7 reply state 0000000006672935 transno 4294967649 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304608.748934:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304608.749031:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:49945:x1876219765576704:12345-192.168.202.29@tcp:36:touch.0 Request processed in 542us (1366us total) trans 4294967649 rc 0/0 00000100:00100000:3.0:1789304608.749038:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 910 00000100:00100000:1.0:1789304608.752567:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:3.0:1789304608.755597:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.756254:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.756269:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.756276:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304608.756281:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.756290:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.756309:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304608.756313:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304608.756319:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.756325:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296961 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304608.756410:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765576832 00000100:00100000:2.0:1789304608.756422:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765576832 00000100:00100000:2.0:1789304608.756823:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 911 00000100:00100000:2.0:1789304608.756836:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:49945:x1876219765576832:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789304608.756861:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304608.756880:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610059b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304608.756944:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296968 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610059b expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304608.756958:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296968 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610059b expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304608.757019:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304608.757022:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789304608.757026:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40eccc00, rc 0) 00000100:00100000:2.0:1789304608.757250:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:49945:x1876219765576832:12345-192.168.202.29@tcp:101:touch.0 Request processed in 416us (4694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304608.757258:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 911 00000100:00100000:0.0:1789304608.761762:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304608.762704:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765576960 00000100:00100000:2.0:1789304608.762715:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765576960 00000100:00100000:2.0:1789304608.762788:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 489 00000100:00100000:2.0:1789304608.762797:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765576960:12345-192.168.202.29@tcp:2:touch.0 00000100:00100000:2.0:1789304608.763132:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765576960:12345-192.168.202.29@tcp:2:touch.0 Request processed in 334us (1376us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789304608.763141:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 489 00000100:00080000:0.0:1789304608.763249:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304608.776412:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304608.776461:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765577216 00000100:00100000:0.0:1789304608.776472:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765577216 00000100:00100000:0.0:1789304608.776535:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 94 00000100:00100000:0.0:1789304608.776562:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:49945:x1876219765577216:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:0.0:1789304608.777012:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:49945:x1876219765577216:12345-192.168.202.29@tcp:35:touch.0 Request processed in 452us (608us total) trans 4294967650 rc 0/0 00000100:00100000:0.0:1789304608.777020:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 94 00000100:00100000:0.0:1789304608.829293:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304608.830640:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765577344 00000100:00100000:3.0:1789304608.830654:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765577344 00000100:00100000:3.0:1789304608.830722:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 912 00000100:00100000:3.0:1789304608.830731:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:49949:x1876219765577344:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304608.830756:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304608.830776:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb723129696f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005a2 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.830835:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296976 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.830849:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.830873:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.830888:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129697d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.830895:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129697d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.830902:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129697d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.830983:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296984 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.830991:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.830998:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304608.831034:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 0 00000004:00200000:3.0:1789304608.831038:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304608.831056:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831067:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831075:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296976 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831081:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296976 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831134:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831140:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304608.831144:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831153:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296976 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831173:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:3.0:1789304608.831176:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304608.831181:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296976 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831187:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296976 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831204:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129697d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831210:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129697d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831216:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129697d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831221:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304608.831224:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129697d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831229:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129697d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831235:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304608.831237:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304608.831240:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129697d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831245:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129697d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831275:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb723129696f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a2 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831286:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a2 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.831299:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:3.0:1789304608.831302:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304608.831304:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fa00, rc 0) 00000100:00100000:3.0:1789304608.831376:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:49949:x1876219765577344:12345-192.168.202.29@tcp:101:rm.0 Request processed in 645us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304608.831382:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 912 00000100:00100000:3.0:1789304608.835629:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304608.836436:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765577472 00000100:00100000:1.0:1789304608.836451:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765577472 00000100:00100000:2.0:1789304608.836677:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 490 00000100:00100000:2.0:1789304608.836691:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765577472:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304608.836712:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304608.836736:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098c2652b/0xefc0bb723129698b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005a9 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304608.836765:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x6aa69f20, atime: 0x6aa69f20, ctime: 0x6aa69f20, blocks: 0x1 00010000:00010000:2.0:1789304608.836790:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=2058s v=(0 0) 00010000:00010000:2.0:1789304608.836795:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304608.836805:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098c2652b/0xefc0bb723129698b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a9 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304608.836828:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098c2652b/0xefc0bb723129698b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a9 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304608.836851:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789304608.836947:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765577472:12345-192.168.202.29@tcp:101:rm.0 Request processed in 258us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304608.836955:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 490 00000100:00100000:1.0:1789304608.840331:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304608.840384:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765577728 00000100:00100000:3.0:1789304608.840394:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765577728 00000100:00100000:3.0:1789304608.840456:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 913 00000100:00100000:3.0:1789304608.840471:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:49949:x1876219765577728:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:3.0:1789304608.840613:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304608.840648:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296984 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a2 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.840669:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610059b expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.840680:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:3.0:1789304608.840690:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304608.840713:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296992 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.840727:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296992 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.840737:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296992 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.840751:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.840757:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.840763:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.840877:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.840886:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.840893:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304608.842042:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].29, 64 off10048 00000004:00080000:3.0:1789304608.842054:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2058519963333ns, next at 2059519960534ns, rc = 0 00010000:00010000:3.0:1789304608.842210:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842225:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842234:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842243:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842254:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842260:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842330:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304608.842354:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842360:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842367:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842372:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304608.842376:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842386:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842398:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304608.842401:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304608.842405:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842412:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842431:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296992 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842438:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296992 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842442:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296992 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842447:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304608.842449:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296992 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842455:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296992 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842461:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:3.0:1789304608.842464:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304608.842467:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296992 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304608.842471:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296992 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304608.842480:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7a49c4a reply state 0000000099bf8b17 transno 4294967651 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304608.842489:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304608.842627:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:49949:x1876219765577728:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2149us (2297us total) trans 4294967651 rc 0/0 00000100:00100000:3.0:1789304608.842636:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 913 00010000:00010000:1.0:1789304608.845918:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.845925:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304608.845936:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.845939:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.845943:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304608.845946:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.845947:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.845951:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304608.845955:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.845956:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.845961:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.845974:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c2ea19c00) 00010000:00010000:0.0:1789304608.845974:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:1.0:1789304608.845977:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304608.845977:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304608.845982:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.845982:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304608.845989:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296999 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.845989:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312969a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304608.846011:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304608.846013:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304608.846015:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304609.106331:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304609.557939:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b020bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785651072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304609.558013:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304609.558594:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785651072 00000100:00100000:3.0:1789304609.558603:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785651072 00000100:00100000:3.0:1789304609.558660:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1789304609.558669:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785651072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304609.558704:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304609.560037:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785651072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1364us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304609.560047:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1789304609.562284:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b020bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785651072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304609.642196:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304609.642235:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304609.642260:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304609.642288:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304609.642316:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765577984 00000100:00100000:2.0:1789304609.642325:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765577984 00000100:00100000:2.0:1789304609.642378:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1460 00000100:00100000:2.0:1789304609.642388:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:2356:x1876219765577984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304609.642489:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:2356:x1876219765577984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 102us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304609.642497:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1460 00000100:00100000:2.0:1789304609.642521:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765578112 00000100:00100000:2.0:1789304609.642524:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765578112 00000100:00100000:2.0:1789304609.642555:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765578240 00000100:00100000:2.0:1789304609.642558:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765578240 00000100:00100000:2.0:1789304609.642584:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1098 00000100:00100000:2.0:1789304609.642601:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765578112:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304609.642637:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765578112:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304609.642643:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1098 00000100:00100000:2.0:1789304609.642656:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1099 00000100:00100000:2.0:1789304609.642662:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765578240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304609.642690:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765578240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304609.642697:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1099 00000100:00100000:0.0:1789304609.645783:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765577856 00000100:00100000:0.0:1789304609.645797:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765577856 00000100:00100000:0.0:1789304609.645861:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1180 00000100:00100000:0.0:1789304609.645870:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765577856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304609.645944:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765577856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (3757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304609.645951:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1180 00000100:00080000:0.0:1789304609.645984:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304609.737886:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304609.738014:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765578368 00000100:00100000:3.0:1789304609.738025:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765578368 00000100:00100000:3.0:1789304609.738122:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 914 00000100:00100000:3.0:1789304609.738140:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:49964:x1876219765578368:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304609.738169:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304609.738193:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312969ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005b0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.738262:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.738276:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.738290:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304609.738327:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:3.0:1789304609.738331:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304609.738351:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.738377:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312969ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005b0 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.738403:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005b0 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.738411:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:3.0:1789304609.738414:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304609.738418:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304609.738474:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:49964:x1876219765578368:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 343us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304609.738481:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 914 00000100:00100000:0.0:1789304609.742767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304609.745170:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765578624 00000100:00100000:1.0:1789304609.745194:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765578624 00000100:00100000:1.0:1789304609.745281:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 915 00000100:00100000:1.0:1789304609.745291:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0136ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:49964:x1876219765578624:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789304609.745352:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304609.745382:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312969b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005b0 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304609.745411:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231296937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610058d expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304609.745422:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:1.0:1789304609.745432:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304609.745468:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304609.745488:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304609.745499:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304609.745794:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3e61ed8 reply state 00000000c3cf7369 transno 4294967652 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304609.745817:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304609.745826:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000100:00100000:1.0:1789304609.745935:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0136ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:49964:x1876219765578624:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 644us (3183us total) trans 4294967652 rc 0/0 00000100:00100000:1.0:1789304609.745950:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 915 00010000:00010000:3.0:1789304609.757968:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.757985:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.757993:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.757999:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304609.758004:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.758012:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.758028:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:3.0:1789304609.758031:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304609.758035:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304609.758042:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb72312969bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304609.935845:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304609.936005:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765578752 00000100:00100000:1.0:1789304609.936016:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765578752 00000100:00100000:1.0:1789304609.936066:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 916 00000100:00100000:1.0:1789304609.936076:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:49976:x1876219765578752:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304609.936199:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:49976:x1876219765578752:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 124us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304609.936210:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 916 00000100:00100000:1.0:1789304609.938430:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304609.938494:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765578880 00000100:00100000:2.0:1789304609.938503:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765578880 00000100:00100000:2.0:1789304609.938570:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 491 00000100:00100000:2.0:1789304609.938583:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49976:x1876219765578880:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304609.938968:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49976:x1876219765578880:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 387us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304609.938977:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 491 00000100:00100000:2.0:1789304609.943977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304609.944209:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765579008 00000100:00100000:1.0:1789304609.944222:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765579008 00000100:00100000:1.0:1789304609.944275:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 492 00000100:00100000:1.0:1789304609.944297:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:49976:x1876219765579008:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304609.945407:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:49976:x1876219765579008:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 1004us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304609.945416:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 492 00000100:00100000:1.0:1789304609.950377:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304609.956955:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765579136 00000100:00100000:2.0:1789304609.956975:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765579136 00000100:00100000:0.0:1789304609.960134:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 917 00000100:00100000:0.0:1789304609.960989:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:49976:x1876219765579136:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304609.962153:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:49976:x1876219765579136:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 1998us (11844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304609.962165:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 917 00000100:00100000:3.0:1789304609.964903:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304609.977240:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765579264 00000100:00100000:1.0:1789304609.977258:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765579264 00000100:00100000:1.0:1789304609.977356:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 918 00000100:00100000:1.0:1789304609.977368:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:49976:x1876219765579264:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304609.977473:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:49976:x1876219765579264:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 106us (12581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304609.977480:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 918 00000100:00100000:3.0:1789304609.980281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304609.980903:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765579392 00000100:00100000:0.0:1789304609.980914:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765579392 00000100:00100000:0.0:1789304609.980977:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 493 00000100:00100000:0.0:1789304609.980986:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49976:x1876219765579392:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304609.981791:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:49976:x1876219765579392:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 803us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304609.981802:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 493 00000100:00100000:1.0:1789304609.990306:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304609.990471:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765579520 00000100:00100000:2.0:1789304609.990484:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765579520 00000100:00100000:2.0:1789304609.990552:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 494 00000100:00100000:2.0:1789304609.990564:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:49976:x1876219765579520:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304609.991057:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:49976:x1876219765579520:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 494us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304609.991070:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 494 00000100:00100000:3.0:1789304609.999008:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304609.999480:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765579648 00000100:00100000:2.0:1789304609.999493:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765579648 00000100:00100000:2.0:1789304609.999614:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 919 00000100:00100000:2.0:1789304609.999625:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:49976:x1876219765579648:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304610.000231:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:49976:x1876219765579648:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 604us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304610.000241:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 919 00000100:00100000:3.0:1789304610.105656:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304610.108813:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765579776 00000100:00100000:1.0:1789304610.108830:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765579776 00000100:00080000:0.0:1789304610.108904:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304610.108924:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 920 00000100:00100000:1.0:1789304610.108935:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:49980:x1876219765579776:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:1.0:1789304610.108958:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304610.108980:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312969c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005b7 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109047:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312969ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109065:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312969ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109079:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312969ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109111:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312969d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109119:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312969d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109126:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312969d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109803:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312969d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109814:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312969d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109822:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312969d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304610.109853:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:1.0:1789304610.109857:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304610.109876:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312969d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109948:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312969ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109955:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312969ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109962:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312969ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109968:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371c00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304610.109972:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312969ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109980:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312969ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.109992:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:1.0:1789304610.109995:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304610.110000:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312969ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110007:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312969ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110018:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312969d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110023:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312969d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110029:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312969d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110035:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304610.110038:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312969d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110044:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312969d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110049:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c14adda00) 00010000:00010000:1.0:1789304610.110052:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304610.110054:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312969d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110059:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312969d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110138:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb72312969c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005b7 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110153:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312969d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005b7 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.110171:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:1.0:1789304610.110173:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304610.110176:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370000, rc 0) 00000100:00100000:1.0:1789304610.110246:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:49980:x1876219765579776:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1313us (4602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304610.110254:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 920 00000100:00100000:0.0:1789304610.118369:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304610.118460:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765580032 00000100:00100000:2.0:1789304610.118470:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765580032 00000100:00100000:2.0:1789304610.118523:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 921 00000100:00100000:2.0:1789304610.118545:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0136aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:49980:x1876219765580032:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:2.0:1789304610.118565:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304610.118587:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312969df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005be expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.118729:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312969e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.118744:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312969e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.118756:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312969e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.118772:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.118783:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.118789:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304610.131295:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304610.135054:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d:0x0], index 1: 0 00010000:00010000:2.0:1789304610.135576:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312969f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135595:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312969f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135610:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312969f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135655:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312969e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135663:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312969e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135671:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312969e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135677:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304610.135681:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312969e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135690:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312969e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135707:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:2.0:1789304610.135710:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304610.135716:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312969e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135722:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312969e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304610.135738:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089a694f7 reply state 00000000e76e564c transno 4294967653 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304610.135747:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304610.135784:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312969df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005be expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135814:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312969f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005be expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.135823:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304610.135825:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304610.135827:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecce00, rc 0) 00000100:00100000:2.0:1789304610.135910:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0136aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+15:49980:x1876219765580032:12345-192.168.202.29@tcp:101:dd.0 Request processed in 17367us (17550us total) trans 4294967653 rc 0/0 00000100:00100000:2.0:1789304610.135919:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 921 00010000:00010000:1.0:1789304610.139927:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.139946:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.139954:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.139960:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304610.139964:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.139972:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.139989:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c421d2e00) 00010000:00010000:1.0:1789304610.139992:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304610.139998:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304610.140004:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312969ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304610.145397:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304610.145503:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765580160 00000100:00100000:3.0:1789304610.145515:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765580160 00000100:00100000:3.0:1789304610.145599:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 495 00000100:00100000:3.0:1789304610.145610:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0136a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:49980:x1876219765580160:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:3.0:1789304610.145631:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304610.145655:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296a02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005c5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789304610.145684:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789304610.145708:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=2059s v=(0 0) 00010000:00010000:3.0:1789304610.145712:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304610.145721:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296a02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005c5 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304610.145739:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296a02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005c5 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304610.145754:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304610.145995:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0136a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:49980:x1876219765580160:12345-192.168.202.29@tcp:101:dd.0 Request processed in 385us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304610.146003:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 495 00000100:00100000:3.0:1789304610.202355:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304610.202479:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765580288 00000100:00100000:2.0:1789304610.202491:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765580288 00002000:00100000:2.0:1789304610.202566:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff9e2b04016680 x1876219765580288/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:676/0 lens 488/0 e 0 to 0 dl 1789304621 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304610.202689:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b04016680 with x1876219765580288 ext(0->1048575) 00002000:00010000:2.0:1789304610.202696:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b04016680 00000100:00100000:2.0:1789304610.202733:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:2.0:1789304610.202743:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765580288:12345-192.168.202.29@tcp:4:dd.0 00000100:00100000:2.0:1789304610.247265:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:2356:x1876219765580288:12345-192.168.202.29@tcp:4:dd.0 Request processed in 44509us (44905us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789304610.247284:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 22 00002000:00100000:2.0:1789304610.247299:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff9e2b04016680 x1876219765580288/t4294967354(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:676/0 lens 488/448 e 0 to 0 dl 1789304621 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304610.247310:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b04016680 with x1876219765580288 ext(0->1048575) 00002000:00010000:2.0:1789304610.247317:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b04016680 00000100:00100000:0.0:1789304610.253518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304610.253731:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765580416 00000100:00100000:3.0:1789304610.253744:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765580416 00000100:00100000:3.0:1789304610.253809:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 922 00000100:00100000:3.0:1789304610.253821:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+14:49980:x1876219765580416:12345-192.168.202.29@tcp:44:dd.0 00000100:00100000:3.0:1789304610.316146:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+14:49980:x1876219765580416:12345-192.168.202.29@tcp:44:dd.0 Request processed in 62316us (62629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304610.316161:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 922 00000001:00080000:3.0:1789304610.316205:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967650 is committed 00000001:00080000:3.0:1789304610.316217:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967652 is committed 00000001:00080000:3.0:1789304610.316224:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967653 is committed 00000004:00080000:3.0:1789304610.316233:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 74 committed 00000100:00100000:3.0:1789304610.316365:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785651200:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789304610.316423:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304610.316841:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785651200 00000100:00100000:3.0:1789304610.316850:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785651200 00000100:00100000:3.0:1789304610.316906:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1789304610.316914:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785651200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789304610.316939:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:29 count 1 00010000:00010000:3.0:1789304610.316968:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304610.316991:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098c2652b/0xefc0bb723129698b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a9 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304610.317007:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789304610.317012:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304610.317017:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304610.317047:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098c2652b/0xefc0bb723129698b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a9 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304610.317061:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098c2652b/0xefc0bb723129698b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a9 expref: 6 pid: 6692 timeout: 2159 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304610.317074:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04015c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785651328:192.168.202.29@tcp:104: 00000100:00080000:1.0:1789304610.320169:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304610.327037:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c011ca9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304610.327808:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04015c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785651328:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789304610.327835:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304610.331240:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304610.331338:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765580544 00000100:00100000:2.0:1789304610.331349:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765580544 00010000:00010000:2.0:1789304610.331411:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098c2652b/0xefc0bb723129698b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a9 expref: 7 pid: 6692 timeout: 2159 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304610.331458:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 386 00000100:00100000:2.0:1789304610.331479:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765580544:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304610.331500:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304610.331506:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000098c2652b/0xefc0bb723129698b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a9 expref: 7 pid: 6692 timeout: 2159 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331522:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098c2652b/0xefc0bb723129698b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a9 expref: 7 pid: 6692 timeout: 2159 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331559:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098c2652b/0xefc0bb723129698b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005a9 expref: 7 pid: 6692 timeout: 2159 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331588:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789304610.331593:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304610.331599:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331609:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331641:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304610.331694:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765580544:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 227us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304610.331701:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 386 00010000:00010000:2.0:1789304610.331798:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331808:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331819:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331828:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331846:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304610.331861:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304610.331867:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331874:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304610.331879:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331888:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331901:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331907:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ffff804/0xefc0bb7231296a09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304610.331925:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304610.331927:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304610.331929:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304610.332522:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785651200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15606us (16096us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789304610.332546:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000004:00080000:2.0:1789304610.332612:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b04017100/2, rc 0, transno 4294967355 00000100:00100000:2.0:1789304610.332619:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785651200:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1789304610.333130:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304610.336491:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304610.337982:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765580672 00000100:00100000:2.0:1789304610.338003:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765580672 00000100:00100000:2.0:1789304610.338113:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 497 00000100:00100000:2.0:1789304610.338128:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:2356:x1876219765580672:12345-192.168.202.29@tcp:16:dd.0 00000001:00080000:0.0:1789304610.387963:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967353 is committed 00000001:00080000:0.0:1789304610.387983:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967354 is committed 00000100:00100000:0.0:1789304610.388125:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765580672:12345-192.168.202.29@tcp:16:dd.0 Request processed in 49993us (51648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304610.388137:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 497 00000100:00100000:2.0:1789304610.391830:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304610.392133:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765580928 00000100:00100000:0.0:1789304610.392144:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765580928 00000100:00100000:0.0:1789304610.392214:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 95 00000100:00100000:0.0:1789304610.392225:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:49980:x1876219765580928:12345-192.168.202.29@tcp:35:dd.0 00000100:00100000:0.0:1789304610.392990:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:49980:x1876219765580928:12345-192.168.202.29@tcp:35:dd.0 Request processed in 764us (1168us total) trans 4294967654 rc 0/0 00000100:00100000:0.0:1789304610.392999:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 95 00000100:00100000:0.0:1789304610.580359:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304610.580385:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b020bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785651456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304610.580471:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304610.580557:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785651456 00000100:00100000:1.0:1789304610.580566:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785651456 00000100:00100000:1.0:1789304610.580643:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1789304610.580653:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785651456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304610.580689:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304610.580772:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785651456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304610.580800:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1789304610.580852:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b020bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785651456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304611.155579:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304611.763384:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967355 is committed 00000001:00080000:2.0:1789304611.763400:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00000001:00080000:0.0:1789304611.868367:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967654 is committed 00000100:00100000:2.0:1789304612.114653:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785651584:0@lo:400:kworker.0 00000100:00100000:2.0:1789304612.114747:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304612.114984:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785651968:0@lo:400:kworker.0 00000100:00100000:1.0:1789304612.115031:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304612.115086:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785651968 00000100:00100000:1.0:1789304612.115117:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785651968 00000100:00100000:1.0:1789304612.115198:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1789304612.115209:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785651968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304612.115268:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785651968:12345-0@lo:400:kworker.0 Request processed in 61us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304612.115275:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00080000:1.0:1789304612.115300:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304612.115411:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785651968:0@lo:400:kworker.0 00000100:00100000:0.0:1789304612.115827:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785651584 00000100:00100000:0.0:1789304612.115833:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785651584 00000100:00100000:0.0:1789304612.115866:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1789304612.115874:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785651584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304612.117279:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785651712:0@lo:400:kworker.0 00000100:00100000:1.0:1789304612.117454:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304612.117465:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785652096:0@lo:400:kworker.0 00000100:00100000:1.0:1789304612.117526:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304612.117680:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304612.117712:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785652224:0@lo:400:kworker.0 00000100:00100000:3.0:1789304612.117738:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304612.117757:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304612.117762:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785651840:0@lo:400:kworker.0 00000100:00100000:3.0:1789304612.117780:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304612.117882:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785652096 00000100:00100000:1.0:1789304612.117890:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785652096 00000100:00100000:0.0:1789304612.118027:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785651584:12345-0@lo:400:kworker.0 Request processed in 2153us (3280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304612.118039:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00080000:0.0:1789304612.118223:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304612.118264:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785651712 00000100:00100000:1.0:1789304612.118268:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785651712 00000100:00100000:1.0:1789304612.118428:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1789304612.118440:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785652096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304612.118503:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785652096:12345-0@lo:400:kworker.0 Request processed in 67us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304612.118566:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785652224 00000100:00100000:3.0:1789304612.118571:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785652224 00000100:00100000:3.0:1789304612.118607:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785651840 00000100:00100000:3.0:1789304612.118610:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785651840 00000100:00100000:3.0:1789304612.118631:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1789304612.118639:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785652224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304612.118680:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785652224:12345-0@lo:400:kworker.0 Request processed in 43us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304612.118686:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1789304612.118850:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1789304612.118856:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785651840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304612.118885:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785651840:12345-0@lo:400:kworker.0 Request processed in 29us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304612.118890:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1789304612.118971:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785651584:0@lo:400:kworker.0 00000100:00100000:0.0:1789304612.119114:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:0.0:1789304612.119125:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785651712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304612.119172:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785651712:12345-0@lo:400:kworker.0 Request processed in 50us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304612.119179:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:1.0:1789304612.119469:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1789304612.119523:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785652096:0@lo:400:kworker.0 00000100:00080000:3.0:1789304612.119651:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304612.119656:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304612.120073:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:3.0:1789304612.120079:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b04017100, transno 4294967355 00000100:00100000:3.0:1789304612.120119:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785651840:0@lo:400:kworker.0 00000100:00100000:3.0:1789304612.120933:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04015180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785651712:0@lo:400:kworker.0 00000100:00100000:2.0:1789304612.121111:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:2.0:1789304612.121117:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b04016300, transno 4294967353 00000100:00100000:2.0:1789304612.121531:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785652224:0@lo:400:kworker.0 00010000:00010000:3.0:1789304612.181768:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304613.208052:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304613.221725:0:85133:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2062899631152ns, next at 2059519960534ns, rc = 0 00000004:00080000:2.0:1789304613.221834:0:85133:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2062899742913ns, next at 2058250367263ns, rc = 0 00000004:00080000:3.0:1789304613.299914:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 81 committed 00000004:00080000:3.0:1789304613.299934:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 75 committed 00010000:00010000:2.0:1789304614.226436:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304614.675387:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304614.675411:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b020bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785652352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304614.675492:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304614.675560:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785652352 00000100:00100000:2.0:1789304614.675568:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785652352 00000100:00100000:2.0:1789304614.675632:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1789304614.675642:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785652352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304614.675683:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789304614.675732:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785652352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304614.675739:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00080000:2.0:1789304614.675760:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304614.675792:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b020bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785652352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304614.693815:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304614.693901:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765581056 00000100:00100000:1.0:1789304614.693912:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765581056 00000100:00100000:1.0:1789304614.693990:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 923 00000100:00100000:1.0:1789304614.694002:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:50172:x1876219765581056:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304614.694121:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:50172:x1876219765581056:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 120us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304614.694128:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 923 00000100:00080000:3.0:1789304614.697619:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304614.697722:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304614.697854:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765581184 00000100:00100000:3.0:1789304614.697864:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765581184 00000100:00100000:3.0:1789304614.697934:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 498 00000100:00100000:3.0:1789304614.697944:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50172:x1876219765581184:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304614.698349:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50172:x1876219765581184:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 406us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304614.698357:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 498 00000100:00080000:0.0:1789304614.698501:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304614.706964:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304614.709208:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765581312 00000100:00100000:0.0:1789304614.709224:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765581312 00000100:00100000:0.0:1789304614.709473:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 499 00000100:00100000:0.0:1789304614.709494:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:50172:x1876219765581312:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304614.709949:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:50172:x1876219765581312:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 465us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304614.709957:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 499 00000100:00080000:3.0:1789304614.716113:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304614.717005:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304614.717133:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765581440 00000100:00100000:2.0:1789304614.717145:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765581440 00000100:00100000:2.0:1789304614.717199:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 924 00000100:00100000:2.0:1789304614.717210:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:50172:x1876219765581440:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304614.717704:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:50172:x1876219765581440:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 493us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304614.717712:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 924 00000100:00100000:2.0:1789304614.721763:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304614.721805:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765581568 00000100:00100000:2.0:1789304614.721815:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765581568 00000100:00100000:2.0:1789304614.721878:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 925 00000100:00100000:2.0:1789304614.721888:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:50172:x1876219765581568:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304614.722000:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:50172:x1876219765581568:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 113us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304614.722007:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 925 00000100:00100000:2.0:1789304614.724809:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304614.724886:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765581696 00000100:00100000:3.0:1789304614.724896:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765581696 00000100:00100000:3.0:1789304614.724961:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 500 00000100:00100000:3.0:1789304614.724972:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50172:x1876219765581696:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304614.725375:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50172:x1876219765581696:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 404us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304614.725384:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 500 00000100:00100000:2.0:1789304614.727956:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304614.728024:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765581824 00000100:00100000:3.0:1789304614.728034:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765581824 00000100:00100000:3.0:1789304614.728519:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 501 00000100:00100000:3.0:1789304614.728545:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:50172:x1876219765581824:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304614.728922:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:50172:x1876219765581824:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 392us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304614.728931:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 501 00000100:00100000:2.0:1789304614.736938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304614.739770:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765581952 00000100:00100000:0.0:1789304614.739786:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765581952 00000100:00100000:0.0:1789304614.739854:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 926 00000100:00100000:0.0:1789304614.739863:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:50172:x1876219765581952:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304614.740352:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:50172:x1876219765581952:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 487us (3423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304614.740361:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 926 00000100:00100000:1.0:1789304614.772513:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304614.773754:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765582080 00000100:00100000:0.0:1789304614.773770:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765582080 00000100:00100000:0.0:1789304614.773984:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1182 00000100:00100000:0.0:1789304614.773997:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765582080:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304614.774083:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765582080:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304614.774109:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1182 00000100:00100000:0.0:1789304614.808910:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304614.808992:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765582336 00000100:00100000:3.0:1789304614.809004:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765582336 00000100:00100000:3.0:1789304614.809068:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 927 00000100:00100000:3.0:1789304614.809079:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:50177:x1876219765582336:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:3.0:1789304614.809160:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304614.809190:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb72312969f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005be expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.809207:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:3.0:1789304614.809218:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304614.809241:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a10 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.809255:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.809264:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.809279:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.809286:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.809293:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.809638:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.809647:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.809654:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304614.810500:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].29, 64 off10048 00000004:00080000:3.0:1789304614.810514:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2064488423262ns, next at 2065488420059ns, rc = 0 00010000:00010000:3.0:1789304614.810612:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810624:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810633:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810641:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810647:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810654:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810679:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304614.810703:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810710:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a1e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810716:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810722:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304614.810727:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810736:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a1e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810746:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304614.810749:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304614.810754:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a1e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810759:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a1e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810777:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a10 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810782:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a10 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810787:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810791:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304614.810794:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a10 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810798:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a10 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810806:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:3.0:1789304614.810809:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304614.810811:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304614.810816:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304614.810826:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052253d61 reply state 00000000301613ea transno 4294967655 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304614.810841:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304614.810927:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:50177:x1876219765582336:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1847us (2025us total) trans 4294967655 rc 0/0 00000100:00100000:3.0:1789304614.810935:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 927 00010000:00010000:1.0:1789304614.811139:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304614.811146:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304614.811152:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304614.811155:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304614.811161:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304614.811171:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:1.0:1789304614.811173:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304614.811175:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304614.811180:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296a25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304614.811195:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304614.811197:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304614.811199:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304614.813205:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304614.813222:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304614.813229:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304614.813236:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304614.813240:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304614.813247:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304614.813261:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c2ea19000) 00010000:00010000:2.0:1789304614.813263:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304614.813268:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304614.813273:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296a17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304615.252316:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304615.698460:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b020bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785652480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304615.698547:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304615.698711:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785652480 00000100:00100000:3.0:1789304615.698721:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785652480 00000100:00100000:3.0:1789304615.698796:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:3.0:1789304615.698807:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785652480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304615.698849:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304615.698903:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785652480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304615.698910:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00080000:1.0:1789304615.699062:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304615.699129:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b020bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785652480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304616.275393:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304617.147020:0:85277:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2066824927152ns, next at 2059519960534ns, rc = 0 00000004:00080000:1.0:1789304617.147160:0:85277:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2066825068342ns, next at 2065488420059ns, rc = 0 00000004:00080000:1.0:1789304617.226937:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 83 committed 00000004:00080000:1.0:1789304617.226966:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 76 committed 00000001:00080000:1.0:1789304617.226989:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967655 is committed 00000004:00080000:1.0:1789304617.226994:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 82 committed 00000100:00100000:1.0:1789304617.227367:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785652608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789304617.227432:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304617.227685:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785652608 00000100:00100000:0.0:1789304617.227694:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785652608 00000100:00100000:0.0:1789304617.227768:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1789304617.227778:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785652608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789304617.227805:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:29 count 1 00010000:00010000:0.0:1789304617.227831:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304617.227851:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296a02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005c5 expref: 5 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304617.227861:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1789304617.227865:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304617.227869:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304617.227907:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296a02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005c5 expref: 5 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304617.227921:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296a02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005c5 expref: 5 pid: 6692 timeout: 2166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304617.227938:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785652736:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304617.227998:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0246db40 going to sleep for 11 seconds 00000100:00080000:1.0:1789304617.231815:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304617.239583:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785652864:0@lo:400:kworker.0 00000100:00100000:2.0:1789304617.239670:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304617.239724:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785653376:0@lo:400:kworker.0 00000100:00100000:2.0:1789304617.239753:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304617.239783:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304617.239788:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785652992:0@lo:400:kworker.0 00000100:00100000:2.0:1789304617.239809:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304617.239843:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785653376 00000100:00100000:2.0:1789304617.239853:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785653376 00000100:00100000:2.0:1789304617.239915:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785652992 00000100:00100000:2.0:1789304617.239918:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785652992 00000100:00100000:2.0:1789304617.239938:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1789304617.239946:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785653376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304617.239997:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785653376:12345-0@lo:400:kworker.0 Request processed in 51us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304617.240004:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1789304617.240023:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1789304617.240029:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785652992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304617.240057:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785652992:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304617.240063:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1789304617.240127:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785652992:0@lo:400:kworker.0 00000100:00100000:2.0:1789304617.240139:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785653376:0@lo:400:kworker.0 00000100:00100000:0.0:1789304617.240370:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785652864 00000100:00100000:0.0:1789304617.240376:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785652864 00000100:00100000:0.0:1789304617.240413:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1789304617.240420:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785652864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304617.240481:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785652864:12345-0@lo:400:kworker.0 Request processed in 62us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304617.240486:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1789304617.240601:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785652864:0@lo:400:kworker.0 00000100:00100000:0.0:1789304617.243155:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785653120:0@lo:400:kworker.0 00000100:00100000:0.0:1789304617.243242:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304617.243346:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304617.243354:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785653248:0@lo:400:kworker.0 00000100:00100000:0.0:1789304617.243381:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304617.244188:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304617.244225:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765582464 00000100:00100000:1.0:1789304617.244234:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765582464 00010000:00010000:1.0:1789304617.244278:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296a02 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005c5 expref: 6 pid: 6692 timeout: 2166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304617.244319:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 387 00000100:00100000:1.0:1789304617.244328:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765582464:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304617.244343:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304617.244350:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296a02 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005c5 expref: 6 pid: 6692 timeout: 2166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304617.244366:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296a02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005c5 expref: 6 pid: 6692 timeout: 2166 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304617.244396:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304617.244401:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304617.244407:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304617.244418:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304617.244441:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304617.244504:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765582464:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 176us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304617.244571:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 387 00010000:00010000:0.0:1789304617.245762:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296a02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005c5 expref: 5 pid: 6692 timeout: 2166 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304617.245788:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785652736:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789304617.245813:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304617.245826:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304617.245839:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304617.245849:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304617.245857:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304617.245881:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304617.245989:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304617.245996:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304617.246005:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304617.246010:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304617.246019:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304617.246034:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304617.246046:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb7231296a2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304617.246064:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304617.246066:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304617.246067:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789304617.246076:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304617.246081:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304617.246647:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785652608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18868us (19213us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789304617.246656:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1789304617.246679:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785653120 00000100:00100000:0.0:1789304617.246685:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785653120 00000100:00080000:1.0:1789304617.246748:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789304617.246778:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c3fd85c00/2, rc 0, transno 4294967355 00000100:00100000:1.0:1789304617.246789:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785652608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789304617.248576:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1789304617.248595:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785653120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304617.248703:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785653120:12345-0@lo:400:kworker.0 Request processed in 114us (5460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304617.248711:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1789304617.251084:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785653248 00000100:00100000:3.0:1789304617.251125:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785653248 00000100:00100000:3.0:1789304617.251311:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:3.0:1789304617.251323:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785653248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304617.251437:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785653248:12345-0@lo:400:kworker.0 Request processed in 117us (8054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304617.251444:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:0.0:1789304617.251782:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785653248:0@lo:400:kworker.0 00000100:00100000:0.0:1789304617.251801:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785653120:0@lo:400:kworker.0 00000100:00080000:1.0:1789304617.252790:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304617.301930:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304618.326370:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304619.347066:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304619.798255:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304619.798282:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785653504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304619.798371:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304619.798798:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785653504 00000100:00100000:1.0:1789304619.798810:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785653504 00000100:00100000:1.0:1789304619.798884:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1789304619.798894:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785653504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304619.798934:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789304619.798993:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785653504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304619.799000:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00080000:1.0:1789304619.799025:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304619.799319:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785653504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304619.879329:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304619.879373:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304619.879406:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304619.879431:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304619.879473:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765582976 00000100:00100000:2.0:1789304619.879496:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765582976 00000100:00100000:2.0:1789304619.879564:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765582848 00000100:00100000:2.0:1789304619.879568:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765582848 00000100:00100000:2.0:1789304619.879593:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1103 00000100:00100000:2.0:1789304619.879602:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765582976:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304619.879677:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765582976:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304619.879685:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1103 00000100:00100000:2.0:1789304619.879702:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1104 00000100:00100000:2.0:1789304619.879709:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765582848:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304619.879735:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765582848:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304619.879740:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1104 00000100:00100000:3.0:1789304619.879898:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765582720 00000100:00100000:3.0:1789304619.879903:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765582720 00000100:00100000:3.0:1789304619.879948:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1467 00000100:00100000:3.0:1789304619.879956:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b020bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765582720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304619.879992:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b020bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765582720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304619.879999:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1467 00000100:00100000:0.0:1789304619.882244:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765582592 00000100:00100000:0.0:1789304619.882260:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765582592 00000100:00100000:0.0:1789304619.882331:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1184 00000100:00100000:0.0:1789304619.882342:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765582592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304619.882411:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765582592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (3004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304619.882419:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1184 00000100:00080000:3.0:1789304619.883233:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789304619.883242:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304619.883245:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789304619.894621:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967355 is committed 00010000:00010000:1.0:1789304620.372334:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304620.821132:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785653632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304620.821221:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304620.821380:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785653632 00000100:00100000:1.0:1789304620.821390:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785653632 00000100:00100000:1.0:1789304620.821471:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1789304620.821495:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785653632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304620.821535:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304620.828173:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785653632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6654us (6925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304620.828191:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00080000:1.0:1789304620.828907:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304620.829331:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785653632:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304621.394311:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304622.354505:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785653888:0@lo:400:kworker.0 00000100:00100000:3.0:1789304622.354576:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304622.354635:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785654400:0@lo:400:kworker.0 00000100:00100000:3.0:1789304622.354659:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304622.354685:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304622.354691:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785654016:0@lo:400:kworker.0 00000100:00100000:3.0:1789304622.354712:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304622.354744:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785654400 00000100:00100000:3.0:1789304622.354751:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785654400 00000100:00100000:3.0:1789304622.354799:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785654016 00000100:00100000:3.0:1789304622.354802:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785654016 00000100:00100000:2.0:1789304622.354912:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785653760:0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.354951:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304622.354975:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785654272:0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.354998:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304622.355030:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304622.355036:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785654144:0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.355061:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304622.355087:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785653760 00000100:00100000:2.0:1789304622.355114:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785653760 00000100:00100000:2.0:1789304622.355142:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1789304622.355151:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785653760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.355200:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785653760:12345-0@lo:400:kworker.0 Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304622.355207:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1789304622.355252:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785653760:0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.355293:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1789304622.355301:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785654400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.355338:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785654400:12345-0@lo:400:kworker.0 Request processed in 39us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304622.355344:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00080000:2.0:1789304622.355363:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304622.355384:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785653888 00000100:00100000:2.0:1789304622.355387:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785653888 00000100:00100000:2.0:1789304622.355409:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785654272 00000100:00100000:2.0:1789304622.355422:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785654272 00000100:00100000:2.0:1789304622.355443:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785654144 00000100:00100000:2.0:1789304622.355446:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785654144 00000100:00100000:2.0:1789304622.355463:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1789304622.355468:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785653888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.355497:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785653888:12345-0@lo:400:kworker.0 Request processed in 29us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304622.355503:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1789304622.355514:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:2.0:1789304622.355519:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785654272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.355551:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785654272:12345-0@lo:400:kworker.0 Request processed in 31us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304622.355557:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:2.0:1789304622.355568:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1789304622.355574:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785654144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.355599:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785654144:12345-0@lo:400:kworker.0 Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304622.355605:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00080000:2.0:1789304622.355625:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304622.355643:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785654144:0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.355653:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785654272:0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.355695:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785653888:0@lo:400:kworker.0 00000100:00100000:2.0:1789304622.355704:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:2.0:1789304622.355708:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c3fd85c00, transno 4294967355 00000100:00100000:2.0:1789304622.355718:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785654400:0@lo:400:kworker.0 00000100:00100000:3.0:1789304622.355827:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1789304622.355836:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785654016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304622.355872:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785654016:12345-0@lo:400:kworker.0 Request processed in 39us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304622.355878:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1789304622.355904:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785654016:0@lo:400:kworker.0 00000100:00080000:2.0:1789304622.357877:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304622.418404:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304623.442436:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304624.469847:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304624.914659:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785654528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304624.914737:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304624.915442:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785654528 00000100:00100000:1.0:1789304624.915451:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785654528 00000100:00100000:1.0:1789304624.915510:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1789304624.915518:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785654528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304624.915552:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304624.915613:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785654528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304624.915620:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:2.0:1789304624.915732:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785654528:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304624.915877:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304624.994007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304624.994046:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304624.994080:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304624.994152:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304624.994192:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765583360 00000100:00100000:1.0:1789304624.994203:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765583360 00000100:00100000:1.0:1789304624.994249:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765583488 00000100:00100000:1.0:1789304624.994252:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765583488 00000100:00100000:1.0:1789304624.994283:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1107 00000100:00100000:1.0:1789304624.994292:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765583360:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304624.994367:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765583360:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304624.994374:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1107 00000100:00100000:1.0:1789304624.994403:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1108 00000100:00100000:1.0:1789304624.994411:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765583488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304624.994433:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765583488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304624.994439:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1108 00000100:00100000:3.0:1789304624.994615:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765583104 00000100:00100000:3.0:1789304624.994620:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765583104 00000100:00100000:3.0:1789304624.994646:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1186 00000100:00100000:3.0:1789304624.994653:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765583104:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304624.994683:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765583104:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304624.994690:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1186 00000100:00100000:0.0:1789304624.994888:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765583232 00000100:00100000:0.0:1789304624.994893:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765583232 00000100:00100000:0.0:1789304624.994932:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1471 00000100:00100000:0.0:1789304624.994939:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765583232:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304624.994979:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765583232:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304624.994985:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1471 00000100:00080000:0.0:1789304624.995001:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304624.995006:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304624.995007:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304625.490702:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304625.939113:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304625.939140:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785654656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304625.939217:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304625.939437:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785654656 00000100:00100000:1.0:1789304625.939448:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785654656 00000100:00100000:1.0:1789304625.941203:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1789304625.941222:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785654656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304625.941265:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304625.941363:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785654656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304625.941371:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1789304625.942941:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785654656:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789304625.950246:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304626.514389:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304627.474423:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785654912:0@lo:400:kworker.0 00000100:00100000:3.0:1789304627.474486:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785654784:0@lo:400:kworker.0 00000100:00100000:2.0:1789304627.474503:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304627.474548:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304627.474574:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785655424:0@lo:400:kworker.0 00000100:00100000:3.0:1789304627.474584:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785655296:0@lo:400:kworker.0 00000100:00100000:2.0:1789304627.474606:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304627.474617:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304627.474636:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304627.474645:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304627.474645:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785655040:0@lo:400:kworker.0 00000100:00100000:3.0:1789304627.474655:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785655168:0@lo:400:kworker.0 00000100:00100000:3.0:1789304627.474685:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304627.474694:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304627.474745:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785654912 00000100:00100000:2.0:1789304627.474752:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785654912 00000100:00100000:2.0:1789304627.474798:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785655296 00000100:00100000:2.0:1789304627.474802:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785655296 00000100:00100000:0.0:1789304627.474802:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785655168 00000100:00100000:0.0:1789304627.474809:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785655168 00000100:00100000:2.0:1789304627.474837:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:0.0:1789304627.474879:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:2.0:1789304627.476199:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785654912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304627.476284:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785654912:12345-0@lo:400:kworker.0 Request processed in 1439us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304627.476294:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1789304627.476323:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1789304627.476331:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785655168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304627.476957:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785655424 00000100:00100000:1.0:1789304627.476967:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785655424 00000100:00100000:1.0:1789304627.477003:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785655040 00000100:00100000:1.0:1789304627.477006:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785655040 00000100:00100000:1.0:1789304627.477027:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1789304627.477034:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785655424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304627.477076:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785655424:12345-0@lo:400:kworker.0 Request processed in 43us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304627.477083:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1789304627.477113:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1789304627.477120:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785655040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304627.477148:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785655040:12345-0@lo:400:kworker.0 Request processed in 28us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304627.477154:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1789304627.477276:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785654784 00000100:00100000:1.0:1789304627.477280:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785654784 00000100:00100000:2.0:1789304627.479155:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785655168:12345-0@lo:400:kworker.0 Request processed in 2817us (4460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304627.479169:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00080000:2.0:1789304627.479207:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304627.479212:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304627.479215:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304627.479265:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785655040:0@lo:400:kworker.0 00000100:00100000:2.0:1789304627.479279:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785654912:0@lo:400:kworker.0 00000100:00100000:2.0:1789304627.479289:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785655424:0@lo:400:kworker.0 00000100:00100000:2.0:1789304627.479350:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785655168:0@lo:400:kworker.0 00000100:00100000:0.0:1789304627.480959:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785655296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304627.481224:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785655296:12345-0@lo:400:kworker.0 Request processed in 6336us (6607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304627.481243:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:1.0:1789304627.483449:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1789304627.483478:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785654784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304627.483570:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785654784:12345-0@lo:400:kworker.0 Request processed in 101us (9030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304627.483577:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1789304627.485758:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785655296:0@lo:400:kworker.0 00000100:00100000:2.0:1789304627.485792:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785654784:0@lo:400:kworker.0 00010000:00010000:2.0:1789304627.538748:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304628.562522:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304629.593155:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304630.041672:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c40eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785655552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304630.041769:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304630.041826:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785655552 00000100:00100000:1.0:1789304630.041839:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785655552 00000100:00100000:1.0:1789304630.041921:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1789304630.041932:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785655552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304630.041972:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304630.042040:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785655552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304630.042046:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00080000:3.0:1789304630.042260:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304630.042415:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c40eb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785655552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304630.114444:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304630.114611:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304630.114649:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304630.114726:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304630.115139:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765583616 00000100:00100000:2.0:1789304630.115153:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765583616 00000100:00100000:2.0:1789304630.115227:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1188 00000100:00100000:2.0:1789304630.115238:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765583616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304630.115319:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765583616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304630.115328:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1188 00000100:00100000:3.0:1789304630.115489:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765583872 00000100:00100000:3.0:1789304630.115494:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765583872 00000100:00100000:3.0:1789304630.115553:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765584000 00000100:00100000:3.0:1789304630.115557:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765584000 00000100:00100000:3.0:1789304630.115584:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1111 00000100:00100000:3.0:1789304630.115592:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765583872:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304630.115622:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765583872:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304630.115629:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1111 00000100:00100000:3.0:1789304630.115643:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1112 00000100:00100000:3.0:1789304630.115650:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765584000:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304630.115675:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765584000:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304630.115685:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1112 00000100:00080000:2.0:1789304630.115908:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304630.115913:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304630.116045:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765583744 00000100:00100000:0.0:1789304630.116051:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765583744 00000100:00100000:0.0:1789304630.116183:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1475 00000100:00100000:0.0:1789304630.116192:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765583744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304630.116228:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40eb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765583744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304630.116234:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1475 00000100:00080000:2.0:1789304630.116493:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304630.610571:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304631.058559:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304631.058587:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785655680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304631.058664:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304631.059087:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785655680 00000100:00100000:2.0:1789304631.059130:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785655680 00000100:00100000:2.0:1789304631.059365:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1789304631.059376:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785655680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304631.059415:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304631.059487:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785655680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304631.059495:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1789304631.059560:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785655680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304631.059806:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304631.634578:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304632.602512:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785656064:0@lo:400:kworker.0 00000100:00100000:1.0:1789304632.602606:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304632.602676:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789304632.602683:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785655936:0@lo:400:kworker.0 00000100:00100000:1.0:1789304632.602711:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304632.602731:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785656448:0@lo:400:kworker.0 00000100:00100000:1.0:1789304632.602751:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304632.602785:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785656064 00000100:00100000:1.0:1789304632.602794:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785656064 00000100:00100000:1.0:1789304632.602846:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785656448 00000100:00100000:1.0:1789304632.602849:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785656448 00000100:00100000:1.0:1789304632.602880:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1789304632.602889:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785656064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304632.602942:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785656064:12345-0@lo:400:kworker.0 Request processed in 55us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304632.602950:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1789304632.602966:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1789304632.602972:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785656448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304632.602998:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785656448:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304632.603005:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1789304632.603509:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785656192:0@lo:400:kworker.0 00000100:00100000:0.0:1789304632.603550:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304632.603596:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789304632.603603:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785655808:0@lo:400:kworker.0 00000100:00100000:0.0:1789304632.603633:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304632.603653:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785656320:0@lo:400:kworker.0 00000100:00100000:0.0:1789304632.603675:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304632.603706:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785655936 00000100:00100000:0.0:1789304632.603711:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785655936 00000100:00100000:0.0:1789304632.603743:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785656192 00000100:00100000:0.0:1789304632.603747:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785656192 00000100:00100000:0.0:1789304632.603763:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785656320 00000100:00100000:0.0:1789304632.603765:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785656320 00000100:00100000:0.0:1789304632.603780:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1789304632.603786:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785655936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304632.603822:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785655936:12345-0@lo:400:kworker.0 Request processed in 36us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304632.603828:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1789304632.603841:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1789304632.603847:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785656192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304632.603878:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785656192:12345-0@lo:400:kworker.0 Request processed in 31us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304632.603883:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1789304632.603895:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:0.0:1789304632.603901:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785656320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304632.603929:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785656320:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304632.603935:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:0.0:1789304632.603976:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785656320:0@lo:400:kworker.0 00000100:00100000:0.0:1789304632.603986:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785656192:0@lo:400:kworker.0 00000100:00100000:3.0:1789304632.604450:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785655808 00000100:00100000:3.0:1789304632.604457:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785655808 00000100:00100000:3.0:1789304632.604494:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1789304632.604501:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785655808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304632.604549:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785655808:12345-0@lo:400:kworker.0 Request processed in 48us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304632.604556:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00080000:0.0:1789304632.604676:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304632.604682:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304632.604709:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785655808:0@lo:400:kworker.0 00000100:00100000:0.0:1789304632.604756:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785655936:0@lo:400:kworker.0 00000100:00100000:0.0:1789304632.604768:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785656448:0@lo:400:kworker.0 00000100:00100000:0.0:1789304632.604779:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785656064:0@lo:400:kworker.0 00010000:00010000:1.0:1789304632.658659:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304633.122918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304633.123078:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765584128 00000100:00100000:0.0:1789304633.123108:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765584128 00000100:00100000:0.0:1789304633.123194:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 928 00000100:00100000:0.0:1789304633.123208:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0136a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:50395:x1876219765584128:12345-192.168.202.29@tcp:48:lfs.0 00000100:00080000:3.0:1789304633.123232:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304633.123328:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0136a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:50395:x1876219765584128:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 105us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304633.123337:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 928 00000100:00100000:1.0:1789304633.125446:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304633.125528:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765584256 00000100:00100000:3.0:1789304633.125537:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765584256 00000100:00100000:3.0:1789304633.125625:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 503 00000100:00100000:3.0:1789304633.125635:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:50395:x1876219765584256:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304633.126004:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:50395:x1876219765584256:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 367us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304633.126012:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 503 00000100:00080000:0.0:1789304633.126493:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304633.128586:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304633.131863:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765584384 00000100:00100000:0.0:1789304633.131880:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765584384 00000100:00100000:0.0:1789304633.132048:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 504 00000100:00100000:0.0:1789304633.132061:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:50395:x1876219765584384:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304633.132721:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:50395:x1876219765584384:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 660us (4149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304633.132732:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 504 00000100:00080000:3.0:1789304633.137803:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304633.142886:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304633.142975:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765584512 00000100:00100000:2.0:1789304633.142985:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765584512 00000100:00100000:2.0:1789304633.143037:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 929 00000100:00100000:2.0:1789304633.143050:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:50395:x1876219765584512:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304633.144137:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:50395:x1876219765584512:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 1088us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304633.144148:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 929 00000100:00100000:1.0:1789304633.151869:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304633.151963:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765584640 00000100:00100000:0.0:1789304633.151976:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765584640 00000100:00100000:0.0:1789304633.152042:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 930 00000100:00100000:0.0:1789304633.152053:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0136a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:50395:x1876219765584640:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304633.152186:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0136a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:50395:x1876219765584640:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 135us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304633.152194:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 930 00000100:00100000:1.0:1789304633.166809:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304633.166855:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765584768 00000100:00100000:2.0:1789304633.166867:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765584768 00000100:00100000:2.0:1789304633.166940:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 505 00000100:00100000:2.0:1789304633.166952:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:50395:x1876219765584768:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304633.167958:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:50395:x1876219765584768:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 1004us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304633.167971:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 505 00000100:00100000:1.0:1789304633.172575:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304633.172718:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765584896 00000100:00100000:2.0:1789304633.172731:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765584896 00000100:00100000:2.0:1789304633.172802:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 506 00000100:00100000:2.0:1789304633.172816:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50395:x1876219765584896:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304633.173622:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50395:x1876219765584896:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 807us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304633.173633:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 506 00000100:00100000:1.0:1789304633.181848:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304633.182001:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765585024 00000100:00100000:2.0:1789304633.182012:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765585024 00000100:00100000:2.0:1789304633.182077:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 931 00000100:00100000:2.0:1789304633.182107:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:50395:x1876219765585024:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304633.182539:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:50395:x1876219765585024:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 452us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304633.182548:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 931 00010000:00010000:2.0:1789304633.691588:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304634.553055:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304634.553700:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765585152 00000100:00100000:3.0:1789304634.553713:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765585152 00000100:00100000:3.0:1789304634.553783:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 932 00000100:00100000:3.0:1789304634.553795:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:50409:x1876219765585152:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304634.553822:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304634.553850:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005cc expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304634.553925:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304634.553941:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304634.553956:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304634.553994:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:3.0:1789304634.553998:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304634.554017:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304634.554043:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005cc expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304634.554061:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005cc expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304634.554069:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:3.0:1789304634.554072:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304634.554076:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ec00, rc 0) 00000100:00100000:3.0:1789304634.554170:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:50409:x1876219765585152:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 377us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304634.554180:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 932 00000100:00100000:1.0:1789304634.560848:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304634.560920:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765585408 00000100:00100000:0.0:1789304634.560930:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765585408 00000100:00100000:0.0:1789304634.560995:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 933 00000100:00100000:0.0:1789304634.561005:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:50409:x1876219765585408:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304634.561059:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304634.561086:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296a3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005cc expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304634.561139:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312969d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005b7 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304634.561149:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:0.0:1789304634.561159:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304634.561184:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304634.561203:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304634.561213:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304634.603428:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000998c487b reply state 0000000099e200a3 transno 4294967656 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304634.603449:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304634.603467:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000100:00100000:0.0:1789304634.603583:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:50409:x1876219765585408:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 42575us (42741us total) trans 4294967656 rc 0/0 00000100:00100000:0.0:1789304634.603593:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 933 00000001:00080000:3.0:1789304634.605554:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967656 is committed 00010000:00010000:1.0:1789304634.606797:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.606812:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.606821:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.606827:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304634.606832:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.606840:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.606858:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:1.0:1789304634.606861:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304634.606866:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.606872:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231296a41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304634.660957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304634.670844:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765585536 00000100:00100000:1.0:1789304634.670864:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765585536 00000100:00100000:1.0:1789304634.670943:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 934 00000100:00100000:1.0:1789304634.670956:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c1c958450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:50413:x1876219765585536:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:1.0:1789304634.670983:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304634.671006:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296a48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005d3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671111:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296a4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671128:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296a4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671140:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296a4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671156:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296a56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671163:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671169:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671850:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296a5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671874:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671881:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304634.671906:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:1.0:1789304634.671909:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304634.671930:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671942:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296a4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671948:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296a4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671955:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296a4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671961:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304634.671965:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296a4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671973:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296a4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671984:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:1.0:1789304634.671987:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304634.671992:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296a4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.671998:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.672009:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.672019:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296a56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.672025:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.672029:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304634.672032:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.672037:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296a56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.672044:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c14add400) 00010000:00010000:1.0:1789304634.672047:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304634.672050:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296a56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.672055:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296a56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.672237:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296a48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005d3 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.672254:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296a5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005d3 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304634.672261:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:1.0:1789304634.672263:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304634.672266:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371000, rc 0) 00000100:00100000:1.0:1789304634.672397:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c1c958450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:50413:x1876219765585536:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 1443us (11448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304634.672405:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 934 00010000:00010000:1.0:1789304634.706331:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304635.158005:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304635.158029:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785656576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304635.158128:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304635.158203:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785656576 00000100:00100000:3.0:1789304635.158212:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785656576 00000100:00100000:3.0:1789304635.158272:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1789304635.158281:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785656576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304635.158333:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304635.158394:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785656576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304635.158401:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00080000:3.0:1789304635.158420:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304635.158485:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785656576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304635.244051:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304635.244118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304635.244150:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304635.244174:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765585920 00000100:00100000:2.0:1789304635.244184:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765585920 00000100:00100000:2.0:1789304635.244245:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765585792 00000100:00100000:2.0:1789304635.244249:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765585792 00000100:00100000:2.0:1789304635.244275:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1115 00000100:00100000:2.0:1789304635.244286:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765585920:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304635.244443:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1116 00000100:00100000:0.0:1789304635.244454:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765585792:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304635.244513:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765585792:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 61us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304635.244521:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1116 00000100:00100000:1.0:1789304635.244605:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765585664 00000100:00100000:1.0:1789304635.244610:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765585664 00000100:00100000:1.0:1789304635.244652:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1190 00000100:00100000:1.0:1789304635.244660:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765585664:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304635.244689:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765585664:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304635.244696:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1190 00000100:00100000:2.0:1789304635.244810:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765585920:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 525us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304635.244818:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1115 00000100:00080000:3.0:1789304635.248257:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304635.248268:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304635.637971:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304635.638134:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765586048 00000100:00100000:3.0:1789304635.638146:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765586048 00000100:00100000:3.0:1789304635.638229:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 935 00000100:00100000:3.0:1789304635.638240:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:50432:x1876219765586048:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304635.638261:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304635.638281:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296a64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005da expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789304635.638351:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304635.638586:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.638602:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.638615:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304635.638653:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:3.0:1789304635.638657:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304635.638675:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.638701:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296a64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005da expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.638734:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005da expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.638744:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:3.0:1789304635.638747:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304635.638751:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fe00, rc 0) 00000100:00100000:3.0:1789304635.638822:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04015500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:50432:x1876219765586048:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 584us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304635.638831:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 935 00000100:00100000:3.0:1789304635.643521:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304635.644270:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765586304 00000100:00100000:0.0:1789304635.644281:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765586304 00000100:00100000:0.0:1789304635.644418:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 936 00000100:00100000:0.0:1789304635.644431:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:50432:x1876219765586304:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304635.644490:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304635.644517:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296a6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005da expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304635.644546:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296a5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005d3 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304635.644559:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:0.0:1789304635.644570:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304635.644597:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304635.644610:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304635.644620:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.732540:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1789304635.745614:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b798e17 reply state 00000000fb15ef5a transno 4294967657 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304635.745636:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304635.745661:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000100:00100000:0.0:1789304635.745785:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:50432:x1876219765586304:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 101352us (102269us total) trans 4294967657 rc 0/0 00000100:00100000:0.0:1789304635.745795:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 936 00000001:00080000:0.0:1789304635.746304:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967657 is committed 00010000:00010000:1.0:1789304635.746382:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.746394:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.746403:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.746409:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304635.746414:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.746421:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.746441:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:1.0:1789304635.746445:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304635.746450:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.746457:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296a72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304635.815833:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304635.815986:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765586432 00000100:00100000:1.0:1789304635.815998:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765586432 00000100:00100000:2.0:1789304635.816337:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 937 00000100:00100000:2.0:1789304635.816350:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:50436:x1876219765586432:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:2.0:1789304635.816378:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304635.816398:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296a79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005e1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816481:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296a80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816497:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296a80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816508:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296a80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816523:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296a87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816530:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296a87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816537:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296a87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816849:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296a8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816858:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816865:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304635.816890:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:2.0:1789304635.816894:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304635.816912:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816923:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296a80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816930:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296a80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816938:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296a80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816944:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304635.816949:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296a80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816957:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296a80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816968:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:2.0:1789304635.816971:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304635.816975:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296a80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816981:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231296a80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.816992:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296a87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.817002:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296a87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.817007:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296a87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.817012:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304635.817014:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296a87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.817019:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296a87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.817040:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c421d2300) 00010000:00010000:2.0:1789304635.817043:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304635.817046:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296a87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.817052:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296a87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.817079:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296a79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005e1 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.817231:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296a8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005e1 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.817240:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304635.817242:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304635.817245:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd800, rc 0) 00000100:00100000:2.0:1789304635.817323:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:50436:x1876219765586432:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 977us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304635.817330:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 937 00000100:00100000:0.0:1789304635.822577:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304635.822902:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765586688 00000100:00100000:3.0:1789304635.822913:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765586688 00000100:00100000:3.0:1789304635.823172:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 938 00000100:00100000:3.0:1789304635.823184:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:50436:x1876219765586688:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304635.823207:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304635.823228:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296a95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005e8 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.823827:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296a9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.823846:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.823860:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.823876:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.823884:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.823890:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304635.824919:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00010000:00010000:3.0:1789304635.825312:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296aaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.825327:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.826682:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.826753:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296a9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.826762:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296a9c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.826769:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296a9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.826775:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304635.826781:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296a9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.826790:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296a9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.826804:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:3.0:1789304635.826807:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304635.826813:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296a9c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.826820:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296a9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304635.826837:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049aebdbb reply state 00000000efc711a3 transno 4294967658 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304635.826846:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304635.826886:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296a95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005e8 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.826903:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005e8 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.826910:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:3.0:1789304635.826913:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304635.826916:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fe00, rc 0) 00000100:00100000:3.0:1789304635.827006:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:50436:x1876219765586688:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 3823us (4441us total) trans 4294967658 rc 0/0 00000100:00100000:3.0:1789304635.827015:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 938 00010000:00010000:1.0:1789304635.828815:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.828835:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.828843:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.828850:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304635.828855:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.828865:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.828880:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c2ea19300) 00010000:00010000:1.0:1789304635.828883:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304635.828887:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.828898:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231296aa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304635.833317:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304635.833575:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765586944 00000100:00100000:2.0:1789304635.833585:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765586944 00000100:00100000:2.0:1789304635.833647:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 939 00000100:00100000:2.0:1789304635.833658:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:50436:x1876219765586944:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:2.0:1789304635.833718:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304635.833746:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005e8 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.833769:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:2.0:1789304635.833783:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304635.833830:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.833843:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.833853:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304635.834058:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000010aad01 reply state 00000000fc8e0c9a transno 4294967659 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304635.834069:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304635.834227:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:50436:x1876219765586944:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 571us (920us total) trans 4294967659 rc 0/0 00000100:00100000:2.0:1789304635.834235:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 939 00010000:00010000:1.0:1789304635.836850:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.836870:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.836877:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.836883:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304635.836889:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.836896:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.836912:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9e2c421d2300) 00010000:00010000:1.0:1789304635.836915:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304635.836920:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.836926:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296ab8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304635.837577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304635.837665:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765587072 00000100:00100000:2.0:1789304635.837676:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765587072 00000100:00100000:2.0:1789304635.837729:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 940 00000100:00100000:2.0:1789304635.837740:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:50436:x1876219765587072:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:2.0:1789304635.837763:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304635.837782:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296abf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.837837:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005ef expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.837848:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005ef expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.837861:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304635.837863:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789304635.837866:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd600, rc 0) 00000100:00100000:2.0:1789304635.838009:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:50436:x1876219765587072:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 207us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304635.838015:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 940 00000100:00100000:0.0:1789304635.842865:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304635.843329:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765587200 00000100:00100000:1.0:1789304635.843341:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765587200 00000100:00100000:1.0:1789304635.843407:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 507 00000100:00100000:1.0:1789304635.843417:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765587200:12345-192.168.202.29@tcp:2:touch.60003 00000100:00100000:1.0:1789304635.843721:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765587200:12345-192.168.202.29@tcp:2:touch.60003 Request processed in 304us (866us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789304635.843726:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 507 00000100:00100000:0.0:1789304635.846752:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304635.846852:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765587456 00000100:00100000:2.0:1789304635.846863:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765587456 00000100:00100000:2.0:1789304635.846960:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 96 00000100:00100000:2.0:1789304635.846970:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:50436:x1876219765587456:12345-192.168.202.29@tcp:35:touch.60003 00000100:00100000:2.0:1789304635.847397:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:50436:x1876219765587456:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 427us (652us total) trans 4294967660 rc 0/0 00000100:00100000:2.0:1789304635.847406:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 96 00000100:00100000:0.0:1789304635.916607:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304635.916747:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765587584 00000100:00100000:3.0:1789304635.916757:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765587584 00000100:00100000:3.0:1789304635.916823:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 941 00000100:00100000:3.0:1789304635.916832:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:50440:x1876219765587584:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:3.0:1789304635.916857:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304635.916878:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296ac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005f6 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.916939:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296acd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.916952:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.916966:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.916981:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296ad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.916989:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.916995:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917085:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917134:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917142:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304635.917176:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 0 00000004:00200000:3.0:1789304635.917181:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304635.917199:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917207:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917214:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917218:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296acd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917223:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296acd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917230:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304635.917233:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296acd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917238:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296acd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917246:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:3.0:1789304635.917248:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304635.917251:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296acd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917255:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296acd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917266:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917269:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917273:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917276:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304635.917277:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917280:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917301:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304635.917304:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304635.917307:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296ad4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917316:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296ad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917421:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296ac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005f6 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917437:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005f6 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304635.917444:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:3.0:1789304635.917446:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304635.917449:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304635.917622:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:50440:x1876219765587584:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 789us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304635.917630:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 941 00000100:00100000:3.0:1789304635.925073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304635.926316:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765587712 00000100:00100000:2.0:1789304635.926327:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765587712 00000100:00100000:2.0:1789304635.926507:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 508 00000100:00100000:2.0:1789304635.926520:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765587712:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:2.0:1789304635.926541:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304635.926562:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb7231296ae2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861005fd expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304635.926589:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x6aa69f3c, atime: 0x6aa69f3c, ctime: 0x6aa69f3c, blocks: 0x1 00010000:00010000:2.0:1789304635.926610:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=2085s v=(0 0) 00010000:00010000:2.0:1789304635.926615:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304635.926624:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb7231296ae2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005fd expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.926641:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb7231296ae2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005fd expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.926655:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc800, rc 0) 00000100:00100000:2.0:1789304635.926719:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765587712:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 202us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304635.926727:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 508 00000100:00100000:3.0:1789304635.933614:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304635.935884:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765587968 00000100:00100000:2.0:1789304635.935902:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765587968 00000100:00100000:2.0:1789304635.935974:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 942 00000100:00100000:2.0:1789304635.935985:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:50440:x1876219765587968:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:2.0:1789304635.936039:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304635.936068:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296adb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005f6 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936148:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296abf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005ef expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936160:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304635.936170:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304635.936193:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296ae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936207:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936217:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936232:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936239:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936246:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936345:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296af7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936353:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296af7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936363:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296af7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304635.936892:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].30, 64 off10112 00000004:00080000:2.0:1789304635.936902:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2085614811205ns, next at 2086614808976ns, rc = 0 00010000:00010000:2.0:1789304635.936959:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936969:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936978:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936985:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936991:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.936997:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937012:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304635.937032:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296af7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937038:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296af7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937045:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296af7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937051:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304635.937055:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296af7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937062:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296af7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937071:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789304635.937074:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304635.937078:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296af7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937084:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296af7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937137:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937143:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296ae9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937149:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937153:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304635.937156:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937162:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296ae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937173:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304635.937176:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304635.937179:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296ae9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304635.937184:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296ae9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304635.937193:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009337a037 reply state 0000000086077972 transno 4294967661 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304635.937201:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304635.937279:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:50440:x1876219765587968:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 1293us (3679us total) trans 4294967661 rc 0/0 00000100:00100000:2.0:1789304635.937296:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 942 00010000:00010000:0.0:1789304635.937637:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304635.937645:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304635.937652:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304635.937655:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304635.937662:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304635.937672:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:0.0:1789304635.937675:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789304635.937678:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304635.937683:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231296afe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304635.937699:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304635.937703:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304635.937707:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304635.940909:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.940928:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.940935:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.941054:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304635.941062:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.941071:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.943111:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c421d2a00) 00010000:00010000:1.0:1789304635.943122:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304635.943134:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304635.943144:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231296af0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304636.186327:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785656704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304636.186407:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304636.186550:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785656704 00000100:00100000:0.0:1789304636.186562:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785656704 00000100:00100000:0.0:1789304636.186635:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1789304636.186645:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785656704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304636.186683:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304636.186738:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785656704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304636.186745:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00080000:1.0:1789304636.187895:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304636.187961:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785656704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304636.755587:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304636.881611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304636.882130:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765588096 00000100:00100000:2.0:1789304636.882142:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765588096 00000100:00100000:2.0:1789304636.882210:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 943 00000100:00100000:2.0:1789304636.882220:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:50458:x1876219765588096:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304636.882243:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304636.882262:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100604 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304636.882351:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304636.882366:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304636.882378:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304636.882412:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:2.0:1789304636.882415:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304636.882435:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304636.882457:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100604 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304636.882473:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100604 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304636.882481:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304636.882484:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304636.882488:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc400, rc 0) 00000100:00100000:2.0:1789304636.882541:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:50458:x1876219765588096:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 323us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304636.882548:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 943 00000100:00100000:0.0:1789304636.896238:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304636.896345:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765588352 00000100:00100000:3.0:1789304636.896364:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765588352 00000100:00100000:3.0:1789304636.896427:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 944 00000100:00100000:3.0:1789304636.896439:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:50458:x1876219765588352:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304636.896498:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304636.896529:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100604 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304636.896553:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296a8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005e1 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304636.896565:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:3.0:1789304636.896575:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304636.896600:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304636.896613:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304636.896624:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304636.896871:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098803709 reply state 00000000d80fbc97 transno 4294967662 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304636.896880:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304636.896890:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000100:00100000:3.0:1789304636.896976:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:50458:x1876219765588352:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 540us (745us total) trans 4294967662 rc 0/0 00000100:00100000:3.0:1789304636.896984:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 944 00010000:00010000:3.0:1789304636.899877:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304636.899896:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304636.899910:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304636.899918:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304636.899923:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304636.899932:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304636.899949:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304636.899953:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304636.899958:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304636.899965:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304637.064524:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304637.064672:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765588480 00000100:00100000:2.0:1789304637.064684:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765588480 00000100:00100000:2.0:1789304637.064809:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 945 00000100:00100000:2.0:1789304637.064821:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:50470:x1876219765588480:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304637.064952:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:50470:x1876219765588480:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 133us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304637.064960:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 945 00000100:00100000:2.0:1789304637.066860:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:1.0:1789304637.066996:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304637.067077:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765588608 00000100:00100000:3.0:1789304637.067108:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765588608 00000100:00100000:3.0:1789304637.067314:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 509 00000100:00100000:3.0:1789304637.067339:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:50470:x1876219765588608:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304637.067769:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:50470:x1876219765588608:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 446us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.067778:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 509 00000100:00080000:1.0:1789304637.069988:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304637.070272:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304637.070520:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765588736 00000100:00100000:3.0:1789304637.070532:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765588736 00000100:00100000:3.0:1789304637.070646:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 510 00000100:00100000:3.0:1789304637.070656:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:50470:x1876219765588736:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304637.071054:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:50470:x1876219765588736:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 399us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.071063:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 510 00000100:00100000:3.0:1789304637.072765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304637.072855:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765588864 00000100:00100000:0.0:1789304637.072863:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765588864 00000100:00100000:0.0:1789304637.072918:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 946 00000100:00100000:0.0:1789304637.072927:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:50470:x1876219765588864:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304637.073489:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:50470:x1876219765588864:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 561us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304637.073497:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 946 00000100:00100000:3.0:1789304637.076429:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304637.076468:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765588992 00000100:00100000:3.0:1789304637.076479:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765588992 00000100:00100000:3.0:1789304637.076528:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 947 00000100:00100000:3.0:1789304637.076538:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:50470:x1876219765588992:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304637.076632:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:50470:x1876219765588992:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 96us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.076639:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 947 00000100:00080000:1.0:1789304637.079171:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304637.079416:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304637.079503:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765589120 00000100:00100000:3.0:1789304637.079513:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765589120 00000100:00100000:3.0:1789304637.079578:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 511 00000100:00100000:3.0:1789304637.079588:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:50470:x1876219765589120:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304637.080005:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:50470:x1876219765589120:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 418us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.080013:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 511 00000100:00100000:3.0:1789304637.083294:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304637.083517:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765589248 00000100:00100000:0.0:1789304637.083528:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765589248 00000100:00100000:0.0:1789304637.083592:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 512 00000100:00100000:0.0:1789304637.083604:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:50470:x1876219765589248:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304637.083986:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:50470:x1876219765589248:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 384us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304637.083995:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 512 00000100:00100000:1.0:1789304637.086139:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304637.086219:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765589376 00000100:00100000:3.0:1789304637.086229:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765589376 00000100:00100000:3.0:1789304637.086287:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 948 00000100:00100000:3.0:1789304637.086297:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:50470:x1876219765589376:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304637.086793:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:50470:x1876219765589376:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 497us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.086803:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 948 00000100:00100000:1.0:1789304637.141803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304637.141897:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765589504 00000100:00100000:3.0:1789304637.141911:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765589504 00000100:00100000:3.0:1789304637.141979:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 949 00000100:00100000:3.0:1789304637.141989:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:50474:x1876219765589504:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:3.0:1789304637.142013:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304637.142036:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610060b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.142148:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296b21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.142684:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296b21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.142698:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296b21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.142716:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296b28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.142734:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.142741:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143014:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296b2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143027:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143034:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304637.143056:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:3.0:1789304637.143060:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304637.143081:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143123:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296b21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143130:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296b21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143137:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296b21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143143:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304637.143147:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296b21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143324:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296b21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143348:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304637.143352:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304637.143358:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296b21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143368:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296b21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143382:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143387:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296b28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143392:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296b28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143397:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304637.143400:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296b28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143406:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296b28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143413:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304637.143416:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304637.143419:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296b28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143424:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296b28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143458:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296b1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610060b expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143472:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296b2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610060b expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.143480:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:3.0:1789304637.143483:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304637.143485:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f400, rc 0) 00000100:00100000:3.0:1789304637.143547:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:50474:x1876219765589504:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1560us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.143555:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 949 00000100:00100000:0.0:1789304637.149187:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304637.149493:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765589760 00000100:00100000:2.0:1789304637.149505:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765589760 00000100:00100000:2.0:1789304637.149566:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 950 00000100:00100000:2.0:1789304637.149576:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:50474:x1876219765589760:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:2.0:1789304637.149597:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304637.149619:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296b36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100612 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.149745:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.149759:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.149772:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.149787:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.149794:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.149801:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789304637.150795:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00010000:00010000:2.0:1789304637.150967:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.150988:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.151000:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.151038:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.151045:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.151052:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.151059:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304637.151062:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.151070:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.151081:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:2.0:1789304637.151085:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304637.151114:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.151122:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296b3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304637.151137:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fe54fb6 reply state 00000000d5157e91 transno 4294967663 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304637.151147:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304637.151303:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296b36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100612 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.151425:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100612 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304637.151435:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789304637.151437:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304637.151440:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc400, rc 0) 00000100:00100000:2.0:1789304637.151580:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+15:50474:x1876219765589760:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 2005us (2403us total) trans 4294967663 rc 0/0 00000100:00100000:2.0:1789304637.151588:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 950 00010000:00010000:0.0:1789304637.157497:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304637.157517:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304637.157524:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304637.157534:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304637.157539:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304637.157545:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304637.157563:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c421d2a00) 00010000:00010000:0.0:1789304637.157566:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304637.157571:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304637.157578:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296b44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304637.158718:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304637.158782:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765589888 00000100:00100000:3.0:1789304637.158793:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765589888 00000100:00100000:3.0:1789304637.158845:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 513 00000100:00100000:3.0:1789304637.158854:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:50474:x1876219765589888:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:3.0:1789304637.158874:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304637.158896:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231296b59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100619 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789304637.158920:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789304637.158941:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=2086s v=(0 0) 00010000:00010000:3.0:1789304637.158946:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304637.158955:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231296b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100619 expref: 6 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.158972:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231296b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100619 expref: 6 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.158983:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304637.159041:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:50474:x1876219765589888:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 187us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.159048:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 513 00000100:00100000:1.0:1789304637.181287:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304637.181599:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765590016 00000100:00100000:0.0:1789304637.181612:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765590016 00002000:00100000:0.0:1789304637.181672:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1e:0x0] (0->1048575) req@ffff9e2b04017800 x1876219765590016/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:703/0 lens 488/0 e 0 to 0 dl 1789304648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789304637.181684:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b04017800 with x1876219765590016 ext(0->1048575) 00002000:00010000:0.0:1789304637.181690:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b04017800 00000100:00100000:0.0:1789304637.181771:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:0.0:1789304637.181782:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765590016:12345-192.168.202.29@tcp:4:dd.60003 00000100:00100000:0.0:1789304637.199768:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765590016:12345-192.168.202.29@tcp:4:dd.60003 Request processed in 17974us (18489us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789304637.199786:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 23 00002000:00100000:0.0:1789304637.199801:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1e:0x0] (0->1048575) req@ffff9e2b04017800 x1876219765590016/t4294967356(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:703/0 lens 488/448 e 0 to 0 dl 1789304648 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789304637.199813:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b04017800 with x1876219765590016 ext(0->1048575) 00002000:00010000:0.0:1789304637.199819:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b04017800 00000100:00100000:1.0:1789304637.202442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304637.202537:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765590144 00000100:00100000:0.0:1789304637.202550:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765590144 00000100:00100000:0.0:1789304637.202644:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 951 00000100:00100000:0.0:1789304637.202655:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+14:50474:x1876219765590144:12345-192.168.202.29@tcp:44:dd.60003 00000001:00080000:2.0:1789304637.230186:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967663 is committed 00000004:00080000:2.0:1789304637.230205:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 77 committed 00000100:00100000:2.0:1789304637.230549:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785656832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789304637.230608:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304637.230709:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785656832 00000100:00100000:3.0:1789304637.230718:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785656832 00000100:00100000:3.0:1789304637.230762:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1789304637.230771:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785656832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789304637.230794:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:30 count 1 00010000:00010000:3.0:1789304637.230819:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.230843:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb7231296ae2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005fd expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.230852:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789304637.230857:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304637.230862:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.230887:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb7231296ae2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005fd expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.230901:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb7231296ae2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005fd expref: 6 pid: 6691 timeout: 2186 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304637.230912:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785656960:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304637.230964:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaa600 going to sleep for 11 seconds 00000100:00100000:0.0:1789304637.233755:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:50474:x1876219765590144:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 31091us (31422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304637.233770:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 951 00000100:00100000:0.0:1789304637.234047:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304637.234128:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765590272 00000100:00100000:1.0:1789304637.234136:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765590272 00010000:00010000:1.0:1789304637.234180:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb7231296ae2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005fd expref: 7 pid: 6691 timeout: 2186 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304637.234219:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 388 00000100:00100000:1.0:1789304637.234229:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765590272:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304637.234243:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304637.234249:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb7231296ae2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005fd expref: 7 pid: 6691 timeout: 2186 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304637.234262:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb7231296ae2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005fd expref: 7 pid: 6691 timeout: 2186 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304637.234300:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304637.234305:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304637.234312:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304637.234340:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304637.234365:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304637.234393:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765590272:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 165us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304637.234401:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 388 00010000:00010000:3.0:1789304637.234566:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb7231296ae2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861005fd expref: 6 pid: 6691 timeout: 2186 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304637.234579:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785656960:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304637.234593:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.234601:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.234605:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.234611:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.234616:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304637.234626:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789304637.235037:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785656832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4267us (4428us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1789304637.235043:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000004:00080000:3.0:1789304637.235254:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c38653b80/2, rc 0, transno 4294967357 00000100:00100000:3.0:1789304637.235260:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785656832:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789304637.235456:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304637.235464:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304637.235475:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304637.235480:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304637.235491:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304637.235508:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304637.235516:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003074d2dc/0xefc0bb7231296b60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304637.235538:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304637.235540:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304637.235542:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304637.237965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304637.238020:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765590400 00000100:00100000:3.0:1789304637.238029:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765590400 00000100:00100000:3.0:1789304637.238086:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 515 00000100:00100000:3.0:1789304637.238121:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765590400:12345-192.168.202.29@tcp:16:dd.60003 00000001:00080000:0.0:1789304637.257532:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967356 is committed 00000100:00100000:3.0:1789304637.257653:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765590400:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 19529us (19690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.257662:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 515 00000100:00100000:2.0:1789304637.259605:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304637.259677:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765590656 00000100:00100000:0.0:1789304637.259688:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765590656 00000100:00100000:0.0:1789304637.259747:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 97 00000100:00100000:0.0:1789304637.259755:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:50474:x1876219765590656:12345-192.168.202.29@tcp:35:dd.60003 00000100:00100000:0.0:1789304637.260248:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:50474:x1876219765590656:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 492us (650us total) trans 4294967664 rc 0/0 00000100:00100000:0.0:1789304637.260256:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 97 00000100:00100000:0.0:1789304637.714704:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785657216:0@lo:400:kworker.0 00000100:00100000:0.0:1789304637.714779:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304637.714854:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785657728:0@lo:400:kworker.0 00000100:00100000:0.0:1789304637.714879:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304637.714905:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789304637.714912:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785657088:0@lo:400:kworker.0 00000100:00100000:0.0:1789304637.714939:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304637.714960:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785657600:0@lo:400:kworker.0 00000100:00100000:0.0:1789304637.714980:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304637.715007:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785657728 00000100:00100000:0.0:1789304637.715014:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785657728 00000100:00100000:0.0:1789304637.715063:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1789304637.715071:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785657728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304637.715142:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785657728:12345-0@lo:400:kworker.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304637.715150:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1789304637.715201:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785657728:0@lo:400:kworker.0 00000100:00100000:1.0:1789304637.715341:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785657344:0@lo:400:kworker.0 00000100:00100000:1.0:1789304637.715372:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304637.715398:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304637.715404:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785657472:0@lo:400:kworker.0 00000100:00100000:1.0:1789304637.715423:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789304637.715445:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304637.715599:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785657344 00000100:00100000:0.0:1789304637.715604:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785657344 00000100:00100000:0.0:1789304637.715638:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1789304637.715645:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785657344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304637.715677:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785657344:12345-0@lo:400:kworker.0 Request processed in 33us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304637.715683:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:3.0:1789304637.715763:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785657088 00000100:00100000:3.0:1789304637.715768:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785657088 00000100:00100000:3.0:1789304637.715804:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1789304637.715811:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785657088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304637.715851:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785657088:12345-0@lo:400:kworker.0 Request processed in 42us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.715857:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1789304637.715883:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785657216 00000100:00100000:3.0:1789304637.715886:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785657216 00000100:00100000:3.0:1789304637.715906:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785657600 00000100:00100000:3.0:1789304637.715909:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785657600 00000100:00100000:3.0:1789304637.715930:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785657472 00000100:00100000:3.0:1789304637.715934:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785657472 00000100:00100000:3.0:1789304637.715948:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:3.0:1789304637.715953:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785657216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304637.715980:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785657216:12345-0@lo:400:kworker.0 Request processed in 27us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.715993:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:3.0:1789304637.716005:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:3.0:1789304637.716011:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785657600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304637.716037:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785657600:12345-0@lo:400:kworker.0 Request processed in 27us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.716044:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:3.0:1789304637.716053:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:3.0:1789304637.716059:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785657472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304637.716082:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785657472:12345-0@lo:400:kworker.0 Request processed in 24us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304637.716087:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00080000:3.0:1789304637.716139:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304637.716156:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785657088:0@lo:400:kworker.0 00000100:00100000:3.0:1789304637.716288:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785657600:0@lo:400:kworker.0 00000100:00100000:3.0:1789304637.716300:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785657216:0@lo:400:kworker.0 00000100:00100000:1.0:1789304637.716537:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785657472:0@lo:400:kworker.0 00000100:00100000:1.0:1789304637.716548:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785657344:0@lo:400:kworker.0 00010000:00010000:2.0:1789304637.781436:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304638.499600:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967664 is committed 00010000:00010000:2.0:1789304638.802351:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304639.507052:0:85691:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2089184957771ns, next at 2086614808976ns, rc = 0 00000004:00080000:3.0:1789304639.507376:0:85691:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2089185284443ns, next at 2065488420059ns, rc = 0 00000004:00080000:0.0:1789304639.514190:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 84 committed 00000004:00080000:0.0:1789304639.514216:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 78 committed 00010000:00010000:1.0:1789304639.826474:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304640.282414:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304640.282440:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785657856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304640.282513:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304640.282591:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785657856 00000100:00100000:3.0:1789304640.282599:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785657856 00000100:00100000:3.0:1789304640.282651:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1789304640.282659:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785657856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304640.282695:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789304640.282742:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785657856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304640.282749:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00080000:3.0:1789304640.282771:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304640.282813:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785657856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304640.353697:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304640.353722:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304640.353739:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304640.353753:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304640.353772:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765590912 00000100:00100000:3.0:1789304640.353791:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765590912 00000100:00100000:3.0:1789304640.353843:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1482 00000100:00100000:3.0:1789304640.353851:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765590912:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304640.353928:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765590912:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304640.353933:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1482 00000100:00100000:3.0:1789304640.354385:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765591168 00000100:00100000:3.0:1789304640.354390:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765591168 00000100:00100000:3.0:1789304640.354426:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765591040 00000100:00100000:3.0:1789304640.354429:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765591040 00000100:00100000:3.0:1789304640.354454:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1119 00000100:00100000:3.0:1789304640.354461:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765591168:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304640.354495:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765591168:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 35us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304640.354502:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1119 00000100:00100000:3.0:1789304640.354514:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1120 00000100:00100000:3.0:1789304640.354521:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765591040:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304640.354547:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765591040:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304640.354553:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1120 00000100:00100000:3.0:1789304640.354573:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765590784 00000100:00100000:3.0:1789304640.354576:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765590784 00000100:00100000:3.0:1789304640.354600:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1192 00000100:00100000:3.0:1789304640.354606:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765590784:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304640.354631:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765590784:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304640.354637:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1192 00000100:00080000:3.0:1789304640.354666:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304640.354671:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304640.354674:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789304640.372680:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00000001:00080000:2.0:1789304640.372701:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00000100:00100000:0.0:1789304640.795977:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304640.799620:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765591296 00000100:00100000:3.0:1789304640.799634:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765591296 00000100:00100000:3.0:1789304640.799701:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 952 00000100:00100000:3.0:1789304640.799711:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:50667:x1876219765591296:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304640.799829:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:50667:x1876219765591296:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 119us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304640.799837:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 952 00000100:00100000:3.0:1789304640.802008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304640.802085:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765591424 00000100:00100000:0.0:1789304640.802119:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765591424 00000100:00100000:0.0:1789304640.802187:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 516 00000100:00100000:0.0:1789304640.802197:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50667:x1876219765591424:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304640.802696:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50667:x1876219765591424:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 499us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304640.802705:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 516 00000100:00100000:1.0:1789304640.804858:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304640.804920:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765591552 00000100:00100000:0.0:1789304640.804931:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765591552 00000100:00100000:0.0:1789304640.804983:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 517 00000100:00100000:0.0:1789304640.804991:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:50667:x1876219765591552:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304640.805503:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:50667:x1876219765591552:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 510us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304640.805511:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 517 00000100:00100000:1.0:1789304640.807196:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304640.807275:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765591680 00000100:00100000:3.0:1789304640.807378:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765591680 00000100:00100000:3.0:1789304640.807444:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 953 00000100:00100000:3.0:1789304640.807453:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:50667:x1876219765591680:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304640.807838:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:50667:x1876219765591680:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 385us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304640.807846:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 953 00000100:00100000:3.0:1789304640.813694:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304640.813827:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765591808 00000100:00100000:0.0:1789304640.813837:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765591808 00000100:00100000:0.0:1789304640.813884:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 954 00000100:00100000:0.0:1789304640.813892:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:50667:x1876219765591808:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304640.813975:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:50667:x1876219765591808:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304640.813981:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 954 00000100:00100000:3.0:1789304640.819471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304640.819544:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765591936 00000100:00100000:0.0:1789304640.819558:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765591936 00000100:00100000:0.0:1789304640.819613:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 518 00000100:00100000:0.0:1789304640.819622:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50667:x1876219765591936:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304640.819947:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50667:x1876219765591936:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 326us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304640.819953:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 518 00000100:00100000:0.0:1789304640.821270:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304640.821354:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765592064 00000100:00100000:3.0:1789304640.821364:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765592064 00000100:00100000:3.0:1789304640.821414:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 519 00000100:00100000:3.0:1789304640.821424:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:50667:x1876219765592064:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304640.821758:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:50667:x1876219765592064:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 335us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304640.821766:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 519 00000100:00100000:0.0:1789304640.824055:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304640.824164:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765592192 00000100:00100000:2.0:1789304640.824174:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765592192 00000100:00100000:2.0:1789304640.824233:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 955 00000100:00100000:2.0:1789304640.824254:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:50667:x1876219765592192:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304640.824714:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:50667:x1876219765592192:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 471us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304640.824724:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 955 00010000:00010000:2.0:1789304640.852625:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304640.927502:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304640.927650:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765592448 00000100:00100000:1.0:1789304640.927661:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765592448 00000100:00100000:1.0:1789304640.927701:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 956 00000100:00100000:1.0:1789304640.927708:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:50671:x1876219765592448:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:1.0:1789304640.927761:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304640.927788:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231296b4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100612 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.927805:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:1.0:1789304640.927816:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304640.927835:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296b67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.927848:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296b67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.927855:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296b67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.927865:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.927870:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.927874:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.928321:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296b75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.928332:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.928339:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789304640.928985:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].30, 64 off10112 00000004:00080000:1.0:1789304640.928994:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2090606903015ns, next at 2091606901408ns, rc = 0 00010000:00010000:1.0:1789304640.929060:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.929069:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.929078:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.929084:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930434:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930451:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930517:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304640.930557:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930562:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296b75 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930566:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296b75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930570:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304640.930574:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296b75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930580:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296b75 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930593:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:1.0:1789304640.930595:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789304640.930599:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296b75 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930603:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296b75 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930620:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296b67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930624:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296b67 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930627:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296b67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930630:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304640.930632:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296b67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930635:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296b67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930639:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:1.0:1789304640.930640:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304640.930642:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296b67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304640.930645:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231296b67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304640.930650:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f02b639 reply state 000000005f081494 transno 4294967665 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304640.930660:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304640.930745:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:50671:x1876219765592448:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 3033us (3251us total) trans 4294967665 rc 0/0 00000100:00100000:1.0:1789304640.930752:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 956 00010000:00010000:2.0:1789304640.933509:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304640.933528:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304640.933690:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304640.933695:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304640.933708:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304640.933728:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:2.0:1789304640.933731:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789304640.933737:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304640.933744:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231296b7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304640.933776:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304640.933777:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304640.933779:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304640.937158:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304640.937450:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304640.937459:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304640.937467:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304640.937472:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304640.937482:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304640.937499:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff9e2c14add400) 00010000:00010000:3.0:1789304640.937502:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304640.937508:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304640.937514:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296b6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304641.309540:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785657984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304641.309615:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304641.310418:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785657984 00000100:00100000:1.0:1789304641.310431:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785657984 00000100:00100000:1.0:1789304641.310508:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:1.0:1789304641.310519:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785657984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304641.310563:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789304641.316054:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304641.319935:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785657984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9401us (10302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304641.319954:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1789304641.320971:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967357 gen 2 00000004:00080000:3.0:1789304641.320981:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c38653b80, transno 4294967357 00000100:00100000:3.0:1789304641.321049:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785657984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304641.875598:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304642.639883:0:85838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2092317789810ns, next at 2086614808976ns, rc = 0 00000004:00080000:3.0:1789304642.639976:0:85838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2092317884505ns, next at 2091606901408ns, rc = 0 00000001:00080000:1.0:1789304642.705805:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967665 is committed 00000004:00080000:1.0:1789304642.705820:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 85 committed 00000004:00080000:1.0:1789304642.705841:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 86 committed 00000004:00080000:1.0:1789304642.705846:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 79 committed 00000100:00100000:3.0:1789304642.706125:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304642.706145:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785658112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789304642.706218:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304642.706421:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785658112 00000100:00100000:0.0:1789304642.706429:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785658112 00000100:00100000:0.0:1789304642.706489:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1789304642.706500:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785658112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789304642.706528:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:30 count 1 00010000:00010000:0.0:1789304642.706553:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304642.706574:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231296b59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100619 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304642.706584:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1789304642.706588:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304642.706593:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304642.706621:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231296b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100619 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304642.706636:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231296b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100619 expref: 5 pid: 17212 timeout: 2192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304642.706647:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785658240:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304642.706708:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c207520c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789304642.706827:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304642.709548:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785658240:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304642.709579:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304642.710853:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304642.710952:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765592576 00000100:00100000:1.0:1789304642.710961:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765592576 00010000:00010000:1.0:1789304642.711029:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231296b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100619 expref: 6 pid: 17212 timeout: 2192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304642.711075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 389 00000100:00100000:1.0:1789304642.711084:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765592576:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304642.711134:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304642.711141:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231296b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100619 expref: 6 pid: 17212 timeout: 2192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304642.711154:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231296b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100619 expref: 6 pid: 17212 timeout: 2192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304642.711177:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1b25883/0xefc0bb7231296b59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100619 expref: 6 pid: 17212 timeout: 2192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304642.711194:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304642.711199:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304642.711204:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304642.711214:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304642.711247:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304642.711302:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765592576:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 218us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304642.711310:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 389 00010000:00010000:0.0:1789304642.711596:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304642.711607:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304642.711618:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304642.711627:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304642.711654:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304642.712561:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304642.712572:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304642.712583:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304642.712588:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304642.712606:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304642.712626:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304642.712634:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b95cbb7/0xefc0bb7231296b83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304642.712658:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304642.712660:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304642.712662:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789304642.713001:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304642.713136:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785658112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6634us (6914us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789304642.713147:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000004:00080000:2.0:1789304642.713928:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c385c7480/2, rc 0, transno 4294967357 00000100:00100000:2.0:1789304642.714063:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785658112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789304642.837514:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785658496:0@lo:400:kworker.0 00000100:00100000:1.0:1789304642.837588:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304642.837647:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304642.837653:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785658624:0@lo:400:kworker.0 00000100:00100000:1.0:1789304642.837682:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304642.837721:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785658496 00000100:00100000:1.0:1789304642.837729:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785658496 00000100:00100000:1.0:1789304642.837784:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1789304642.837794:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785658496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304642.837853:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785658496:12345-0@lo:400:kworker.0 Request processed in 59us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304642.837860:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1789304642.837885:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785658624 00000100:00100000:1.0:1789304642.837889:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785658624 00000100:00100000:1.0:1789304642.837915:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1789304642.837920:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785658624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304642.837950:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785658624:12345-0@lo:400:kworker.0 Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304642.837956:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1789304642.837994:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04015f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785658624:0@lo:400:kworker.0 00000100:00100000:1.0:1789304642.838005:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04015c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785658496:0@lo:400:kworker.0 00000100:00100000:0.0:1789304642.838121:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785658752:0@lo:400:kworker.0 00000100:00100000:0.0:1789304642.838152:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304642.838179:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789304642.838185:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785658368:0@lo:400:kworker.0 00000100:00100000:0.0:1789304642.838212:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304642.838249:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785658880:0@lo:400:kworker.0 00000100:00100000:0.0:1789304642.838284:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304642.838311:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785658368 00000100:00100000:0.0:1789304642.838315:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785658368 00000100:00100000:0.0:1789304642.838342:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1789304642.838349:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785658368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304642.838387:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785658368:12345-0@lo:400:kworker.0 Request processed in 38us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304642.838393:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1789304642.838419:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785658752 00000100:00100000:0.0:1789304642.838423:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785658752 00000100:00100000:0.0:1789304642.838448:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785658880 00000100:00100000:0.0:1789304642.838451:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785658880 00000100:00100000:0.0:1789304642.838468:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:0.0:1789304642.838474:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785658752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304642.838501:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785658752:12345-0@lo:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304642.838506:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:0.0:1789304642.838517:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:0.0:1789304642.838522:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785658880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304642.838546:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785658880:12345-0@lo:400:kworker.0 Request processed in 24us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304642.838551:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:0.0:1789304642.838573:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785658368:0@lo:400:kworker.0 00000100:00100000:0.0:1789304642.838582:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785658880:0@lo:400:kworker.0 00000100:00100000:0.0:1789304642.838590:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785658752:0@lo:400:kworker.0 00000100:00080000:3.0:1789304642.838801:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304642.904686:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304643.922288:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304644.947113:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304645.397056:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785659008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304645.397148:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304645.397414:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785659008 00000100:00100000:3.0:1789304645.397423:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785659008 00000100:00100000:3.0:1789304645.397491:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1789304645.397501:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785659008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304645.397534:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789304645.397584:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785659008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304645.397595:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00080000:1.0:1789304645.397682:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304645.397723:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785659008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304645.475788:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304645.475870:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304645.475906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304645.475935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304645.475972:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765592832 00000100:00100000:0.0:1789304645.475984:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765592832 00000100:00100000:0.0:1789304645.476063:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1486 00000100:00100000:0.0:1789304645.476076:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765592832:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304645.476176:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765592832:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 103us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304645.476185:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1486 00000100:00100000:0.0:1789304645.476227:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765592960 00000100:00100000:0.0:1789304645.476231:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765592960 00000100:00100000:0.0:1789304645.476259:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765593088 00000100:00100000:0.0:1789304645.476263:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765593088 00000100:00100000:0.0:1789304645.476286:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1122 00000100:00100000:0.0:1789304645.476293:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765592960:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304645.476320:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765592960:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304645.476327:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1122 00000100:00100000:0.0:1789304645.476341:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1123 00000100:00100000:0.0:1789304645.476348:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765593088:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304645.476377:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765593088:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304645.476384:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1123 00000100:00080000:0.0:1789304645.476401:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304645.476405:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304645.476407:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304645.477257:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765592704 00000100:00100000:1.0:1789304645.477266:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765592704 00000100:00100000:1.0:1789304645.477337:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1194 00000100:00100000:1.0:1789304645.477345:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765592704:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304645.477404:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765592704:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 59us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304645.477412:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1194 00000001:00080000:0.0:1789304645.968593:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967357 is committed 00010000:00010000:2.0:1789304645.972379:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304646.422783:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785659136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304646.422878:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304646.423742:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785659136 00000100:00100000:3.0:1789304646.423754:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785659136 00000100:00100000:3.0:1789304646.423845:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1789304646.423855:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785659136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304646.423901:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304646.423970:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785659136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304646.423977:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1789304646.424083:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785659136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304646.424387:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304646.994568:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304647.956820:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785659392:0@lo:400:kworker.0 00000100:00100000:1.0:1789304647.956833:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785659520:0@lo:400:kworker.0 00000100:00100000:2.0:1789304647.956890:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785659264:0@lo:400:kworker.0 00000100:00100000:3.0:1789304647.956947:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304647.957005:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785659904:0@lo:400:kworker.0 00000100:00100000:3.0:1789304647.957026:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304647.957056:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785659392 00000100:00100000:3.0:1789304647.957063:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785659392 00000100:00100000:3.0:1789304647.957149:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1789304647.957169:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785659392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304647.957246:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785659392:12345-0@lo:400:kworker.0 Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304647.957253:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1789304647.957275:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785659904 00000100:00100000:3.0:1789304647.957279:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785659904 00000100:00100000:3.0:1789304647.957316:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:3.0:1789304647.957322:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785659904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304647.957352:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785659904:12345-0@lo:400:kworker.0 Request processed in 31us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304647.957359:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00080000:3.0:1789304647.957376:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304647.957625:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967357 gen 2 00000004:00080000:3.0:1789304647.957631:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c385c7480, transno 4294967357 00000100:00100000:3.0:1789304647.957642:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785659904:0@lo:400:kworker.0 00000100:00100000:3.0:1789304647.957653:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785659392:0@lo:400:kworker.0 00000100:00100000:1.0:1789304647.958713:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304647.958796:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304647.958805:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785659648:0@lo:400:kworker.0 00000100:00100000:1.0:1789304647.958842:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304647.958989:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785659648 00000100:00100000:3.0:1789304647.958996:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785659648 00000100:00100000:0.0:1789304647.959015:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785659520 00000100:00100000:0.0:1789304647.959019:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785659520 00000100:00100000:3.0:1789304647.959049:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:3.0:1789304647.959056:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785659648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304647.959126:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785659648:12345-0@lo:400:kworker.0 Request processed in 70us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304647.959132:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00080000:1.0:1789304647.959136:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304647.959179:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785659648:0@lo:400:kworker.0 00000100:00100000:0.0:1789304647.959340:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:0.0:1789304647.959349:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785659520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304647.959455:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785659520:12345-0@lo:400:kworker.0 Request processed in 108us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304647.959462:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1789304647.959759:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785659520:0@lo:400:kworker.0 00000100:00100000:2.0:1789304647.961453:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304647.961555:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785659776:0@lo:400:kworker.0 00000100:00100000:2.0:1789304647.961594:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304647.961678:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785659776 00000100:00100000:1.0:1789304647.961686:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785659776 00000100:00100000:1.0:1789304647.961746:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:1.0:1789304647.961753:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785659776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304647.961801:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785659776:12345-0@lo:400:kworker.0 Request processed in 48us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304647.961808:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00080000:2.0:1789304647.961860:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304647.961886:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785659776:0@lo:400:kworker.0 00000100:00100000:3.0:1789304647.961928:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785659264 00000100:00100000:3.0:1789304647.961932:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785659264 00000100:00100000:3.0:1789304647.961998:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1789304647.962005:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785659264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304647.962105:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785659264:12345-0@lo:400:kworker.0 Request processed in 84us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304647.962113:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1789304647.962433:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785659264:0@lo:400:kworker.0 00010000:00010000:1.0:1789304648.018409:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304649.043359:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304650.066598:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304650.514630:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785660032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304650.514766:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304650.514932:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785660032 00000100:00100000:2.0:1789304650.514941:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785660032 00000100:00100000:2.0:1789304650.515013:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1789304650.515023:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785660032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304650.515057:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789304650.515781:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304650.515896:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785660032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 872us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304650.515905:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1789304650.515980:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785660032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304650.596300:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304650.596349:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304650.596381:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304650.596382:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765593216 00000100:00100000:1.0:1789304650.596392:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765593216 00000100:00100000:1.0:1789304650.596444:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1196 00000100:00100000:1.0:1789304650.596455:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765593216:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304650.596532:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765593216:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304650.596534:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304650.596543:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1196 00000100:00100000:3.0:1789304650.596984:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765593472 00000100:00100000:3.0:1789304650.596990:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765593472 00000100:00100000:3.0:1789304650.597042:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765593600 00000100:00100000:3.0:1789304650.597046:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765593600 00000100:00100000:3.0:1789304650.597078:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1126 00000100:00100000:3.0:1789304650.597087:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765593472:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304650.597165:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765593472:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304650.597167:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1127 00000100:00100000:3.0:1789304650.597172:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1126 00000100:00100000:1.0:1789304650.597175:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765593600:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304650.597219:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765593600:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304650.597226:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1127 00000100:00080000:2.0:1789304650.597641:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304650.597646:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304650.599653:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765593344 00000100:00100000:0.0:1789304650.599669:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765593344 00000100:00080000:2.0:1789304650.599799:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304650.599847:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1490 00000100:00100000:0.0:1789304650.599858:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765593344:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304650.599956:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765593344:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 99us (3572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304650.599964:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1490 00010000:00010000:1.0:1789304651.090387:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304651.538529:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304651.538909:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785660160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304651.539036:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304651.539312:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785660160 00000100:00100000:1.0:1789304651.539321:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785660160 00000100:00100000:1.0:1789304651.539429:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1789304651.539439:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785660160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304651.539474:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304651.539572:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785660160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304651.539580:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00080000:2.0:1789304651.539748:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304651.539803:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785660160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304652.114530:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304653.075901:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785660544:0@lo:400:kworker.0 00000100:00100000:0.0:1789304653.076003:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304653.076468:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304653.076481:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785660672:0@lo:400:kworker.0 00000100:00100000:0.0:1789304653.076514:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304653.076551:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785660672 00000100:00100000:0.0:1789304653.076559:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785660672 00000100:00100000:0.0:1789304653.076622:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1789304653.076634:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785660672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304653.076692:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785660672:12345-0@lo:400:kworker.0 Request processed in 61us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304653.076699:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00080000:0.0:1789304653.076728:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304653.076763:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785660544 00000100:00100000:0.0:1789304653.076767:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785660544 00000100:00100000:0.0:1789304653.076859:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:0.0:1789304653.076865:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785660544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304653.076896:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785660544:12345-0@lo:400:kworker.0 Request processed in 31us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304653.076901:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00080000:0.0:1789304653.076917:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304653.076954:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785660672:0@lo:400:kworker.0 00000100:00100000:0.0:1789304653.076965:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785660544:0@lo:400:kworker.0 00000100:00100000:2.0:1789304653.078225:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785660288:0@lo:400:kworker.0 00000100:00100000:2.0:1789304653.078281:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304653.078333:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785660800:0@lo:400:kworker.0 00000100:00100000:2.0:1789304653.078359:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304653.078384:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789304653.078391:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785660416:0@lo:400:kworker.0 00000100:00100000:2.0:1789304653.078411:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304653.078429:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785660928:0@lo:400:kworker.0 00000100:00100000:2.0:1789304653.078452:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304653.078482:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785660800 00000100:00100000:2.0:1789304653.078487:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785660800 00000100:00100000:2.0:1789304653.078530:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785660416 00000100:00100000:2.0:1789304653.078534:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785660416 00000100:00100000:2.0:1789304653.078553:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:2.0:1789304653.078560:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785660800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304653.078606:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785660800:12345-0@lo:400:kworker.0 Request processed in 46us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304653.078612:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:2.0:1789304653.078626:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:2.0:1789304653.078632:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785660416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304653.078658:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785660416:12345-0@lo:400:kworker.0 Request processed in 26us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304653.078667:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:2.0:1789304653.078687:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785660928 00000100:00100000:2.0:1789304653.078690:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785660928 00000100:00100000:2.0:1789304653.078716:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1789304653.078722:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785660928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304653.078752:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785660928:12345-0@lo:400:kworker.0 Request processed in 30us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304653.078758:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00080000:2.0:1789304653.078795:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304653.078799:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304653.078824:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785660416:0@lo:400:kworker.0 00000100:00100000:2.0:1789304653.078831:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785660928:0@lo:400:kworker.0 00000100:00100000:2.0:1789304653.078837:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785660800:0@lo:400:kworker.0 00000100:00100000:0.0:1789304653.079232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785660288 00000100:00100000:0.0:1789304653.079238:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785660288 00000100:00100000:0.0:1789304653.079274:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1789304653.079281:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785660288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304653.079326:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785660288:12345-0@lo:400:kworker.0 Request processed in 46us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304653.079332:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1789304653.079372:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785660288:0@lo:400:kworker.0 00010000:00010000:2.0:1789304653.138342:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304654.162660:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304655.186872:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304655.635721:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785661056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304655.635791:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304655.637142:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785661056 00000100:00100000:2.0:1789304655.637155:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785661056 00000100:00100000:2.0:1789304655.637242:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1789304655.637254:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785661056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304655.637293:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304655.637394:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304655.640138:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785661056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2877us (4337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304655.640162:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1789304655.640741:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785661056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304655.721526:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304655.721642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304655.721676:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304655.721734:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304655.722140:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765593856 00000100:00100000:3.0:1789304655.722161:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765593856 00000100:00100000:3.0:1789304655.722228:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1494 00000100:00100000:3.0:1789304655.722238:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765593856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304655.722311:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765593856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304655.722318:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1494 00000100:00080000:1.0:1789304655.722630:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304655.723324:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765593984 00000100:00100000:0.0:1789304655.723331:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765593984 00000100:00080000:1.0:1789304655.723635:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304655.723813:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765594112 00000100:00100000:0.0:1789304655.723827:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765594112 00000100:00100000:2.0:1789304655.725595:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765593728 00000100:00100000:2.0:1789304655.725609:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765593728 00000100:00100000:2.0:1789304655.725675:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1198 00000100:00100000:2.0:1789304655.725697:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765593728:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304655.725789:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765593728:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 94us (4271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304655.725796:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1198 00000100:00080000:2.0:1789304655.726644:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304655.727527:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1130 00000100:00100000:1.0:1789304655.727545:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765593984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304655.727630:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765593984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 92us (5987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304655.727638:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1130 00000100:00100000:1.0:1789304655.727660:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1131 00000100:00100000:1.0:1789304655.727668:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765594112:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304655.729591:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765594112:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (5971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304655.729612:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1131 00010000:00010000:2.0:1789304656.210529:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304656.658771:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785661184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304656.658852:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304656.658981:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785661184 00000100:00100000:3.0:1789304656.658990:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785661184 00000100:00100000:3.0:1789304656.659506:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1789304656.659519:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c4112a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785661184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304656.659555:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304656.659625:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c4112a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785661184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304656.659633:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1789304656.659682:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785661184:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304656.659903:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304657.236370:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304658.200698:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785661568:0@lo:400:kworker.0 00000100:00100000:2.0:1789304658.200794:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304658.200864:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304658.200871:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785661696:0@lo:400:kworker.0 00000100:00100000:2.0:1789304658.200897:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304658.200933:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785661696 00000100:00100000:2.0:1789304658.200942:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785661696 00000100:00100000:2.0:1789304658.201006:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1789304658.201018:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785661696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304658.201085:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785661696:12345-0@lo:400:kworker.0 Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304658.201117:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00080000:2.0:1789304658.201141:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304658.201176:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785661696:0@lo:400:kworker.0 00000100:00100000:1.0:1789304658.201309:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785661440:0@lo:400:kworker.0 00000100:00100000:1.0:1789304658.201340:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304658.201374:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785661952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304658.201397:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304658.201420:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789304658.201426:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785661312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304658.201451:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304658.201471:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785661824:0@lo:400:kworker.0 00000100:00100000:1.0:1789304658.201491:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304658.201516:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785661568 00000100:00100000:1.0:1789304658.201521:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785661568 00000100:00100000:1.0:1789304658.201556:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785661952 00000100:00100000:1.0:1789304658.201559:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785661952 00000100:00100000:1.0:1789304658.201578:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1789304658.201584:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785661568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304658.201621:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785661568:12345-0@lo:400:kworker.0 Request processed in 37us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304658.201628:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1789304658.201640:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:1.0:1789304658.201647:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785661952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304658.201677:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785661952:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304658.201683:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00080000:1.0:1789304658.201701:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304658.201704:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304658.201722:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785661952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304658.201743:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785661568:0@lo:400:kworker.0 00000100:00100000:0.0:1789304658.201877:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785661312 00000100:00100000:0.0:1789304658.201882:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785661312 00000100:00100000:0.0:1789304658.201920:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1789304658.201927:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785661312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304658.201967:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785661312:12345-0@lo:400:kworker.0 Request processed in 40us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304658.201973:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1789304658.202007:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785661312:0@lo:400:kworker.0 00000100:00100000:3.0:1789304658.202124:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785661440 00000100:00100000:3.0:1789304658.202129:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785661440 00000100:00100000:3.0:1789304658.202165:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785661824 00000100:00100000:3.0:1789304658.202169:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785661824 00000100:00100000:3.0:1789304658.202197:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:3.0:1789304658.202203:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785661440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304658.202244:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785661440:12345-0@lo:400:kworker.0 Request processed in 41us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304658.202253:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:3.0:1789304658.202266:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1789304658.202271:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785661824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304658.202297:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785661824:12345-0@lo:400:kworker.0 Request processed in 26us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304658.202302:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00080000:3.0:1789304658.202316:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304658.202725:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785661824:0@lo:400:kworker.0 00000100:00100000:0.0:1789304658.202736:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785661440:0@lo:400:kworker.0 00010000:00010000:2.0:1789304658.258363:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304659.282290:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304660.195029:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304660.195082:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765594240 00000100:00100000:1.0:1789304660.195107:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765594240 00000100:00100000:1.0:1789304660.195172:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 957 00000100:00100000:1.0:1789304660.195183:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:50929:x1876219765594240:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304660.195286:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:50929:x1876219765594240:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304660.195295:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 957 00000100:00080000:1.0:1789304660.195317:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304660.199210:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304660.199245:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765594368 00000100:00100000:3.0:1789304660.199256:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765594368 00000100:00100000:3.0:1789304660.199320:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 521 00000100:00100000:3.0:1789304660.199331:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:50929:x1876219765594368:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304660.199763:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:50929:x1876219765594368:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 433us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304660.199771:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 521 00000100:00080000:3.0:1789304660.199796:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304660.203661:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304660.205664:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765594496 00000100:00100000:3.0:1789304660.205677:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765594496 00000100:00100000:3.0:1789304660.205750:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 522 00000100:00100000:3.0:1789304660.205761:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50929:x1876219765594496:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:1.0:1789304660.206297:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304660.206482:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50929:x1876219765594496:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 720us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304660.206490:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 522 00000100:00100000:3.0:1789304660.219613:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304660.219781:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765594624 00000100:00100000:2.0:1789304660.219795:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765594624 00000100:00100000:2.0:1789304660.219866:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 958 00000100:00100000:2.0:1789304660.219876:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:50929:x1876219765594624:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304660.220414:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:50929:x1876219765594624:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 538us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304660.220423:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 958 00000100:00100000:3.0:1789304660.230516:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304660.230730:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765594752 00000100:00100000:2.0:1789304660.230741:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765594752 00000100:00100000:2.0:1789304660.230799:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 959 00000100:00100000:2.0:1789304660.230810:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:50929:x1876219765594752:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304660.230957:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:50929:x1876219765594752:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 148us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304660.230965:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 959 00000100:00100000:3.0:1789304660.241773:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304660.241863:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765594880 00000100:00100000:0.0:1789304660.241874:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765594880 00000100:00100000:0.0:1789304660.241933:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 523 00000100:00100000:0.0:1789304660.241943:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:50929:x1876219765594880:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304660.251520:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:50929:x1876219765594880:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 9566us (9749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304660.251535:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 523 00000100:00100000:0.0:1789304660.265465:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304660.265569:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765595008 00000100:00100000:3.0:1789304660.265581:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765595008 00000100:00100000:3.0:1789304660.265644:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 524 00000100:00100000:3.0:1789304660.265655:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50929:x1876219765595008:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304660.266669:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:50929:x1876219765595008:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1012us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304660.266679:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 524 00000100:00100000:3.0:1789304660.289268:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304660.289316:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765595136 00000100:00100000:3.0:1789304660.289328:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765595136 00000100:00100000:3.0:1789304660.289389:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 960 00000100:00100000:3.0:1789304660.289398:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:50929:x1876219765595136:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304660.289880:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:50929:x1876219765595136:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 482us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304660.289888:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 960 00010000:00010000:0.0:1789304660.324662:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304660.369327:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304660.374278:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765595264 00000100:00100000:0.0:1789304660.374301:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765595264 00000100:00100000:0.0:1789304660.378450:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 961 00000100:00100000:0.0:1789304660.378473:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:50930:x1876219765595264:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304660.378501:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304660.378522:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100620 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.378593:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.378608:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.378620:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304660.378656:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:0.0:1789304660.378660:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304660.378678:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.378703:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100620 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.378720:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100620 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.378727:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:0.0:1789304660.378730:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304660.378735:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb800, rc 0) 00000100:00100000:0.0:1789304660.378819:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:50930:x1876219765595264:12345-192.168.202.29@tcp:101:rm.0 Request processed in 353us (9504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304660.378826:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 961 00000100:00100000:0.0:1789304660.386305:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304660.387211:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765595520 00000100:00100000:2.0:1789304660.387227:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765595520 00000100:00100000:2.0:1789304660.387295:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 962 00000100:00100000:2.0:1789304660.387307:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:50930:x1876219765595520:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304660.387331:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304660.387355:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296b98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100627 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304660.387731:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00010000:2.0:1789304660.387986:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296b98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100627 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304660.388002:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:2.0:1789304660.388005:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789304660.388010:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296b98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100627 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304660.388024:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40eccc00, rc 0) 00000100:00100000:2.0:1789304660.388135:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:50930:x1876219765595520:12345-192.168.202.29@tcp:101:rm.0 Request processed in 830us (1839us total) trans 4294967666 rc 301/301 00000100:00100000:2.0:1789304660.388143:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 962 00000100:00100000:1.0:1789304660.395881:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304660.395929:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765595648 00000100:00100000:1.0:1789304660.395940:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765595648 00000100:00100000:1.0:1789304660.395992:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 98 00000100:00100000:1.0:1789304660.396003:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:50930:x1876219765595648:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:1.0:1789304660.405890:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:50930:x1876219765595648:12345-192.168.202.29@tcp:37:rm.0 Request processed in 9876us (10006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304660.405906:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 98 00000100:00100000:3.0:1789304660.414523:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304660.416516:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765595904 00000100:00100000:0.0:1789304660.416529:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765595904 00000100:00100000:0.0:1789304660.416601:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 99 00000100:00100000:0.0:1789304660.416613:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:50930:x1876219765595904:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:0.0:1789304660.416922:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:50930:x1876219765595904:12345-192.168.202.29@tcp:35:rm.0 Request processed in 310us (2411us total) trans 4294967667 rc 0/0 00000100:00100000:0.0:1789304660.416930:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 99 00000100:00100000:3.0:1789304660.427257:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304660.427297:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765596160 00000100:00100000:0.0:1789304660.427308:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765596160 00000100:00100000:0.0:1789304660.427633:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 963 00000100:00100000:0.0:1789304660.427646:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:50930:x1876219765596160:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:0.0:1789304660.427727:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789304660.427763:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231296b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100620 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.427785:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296b2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610060b expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.427795:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:0.0:1789304660.427811:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296850 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100555 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.427819:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:0.0:1789304660.427825:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304660.427853:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296ba6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.427870:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.427880:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.427891:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.427898:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.427903:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.429206:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296bb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.429223:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.429233:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304660.430027:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00010000:0.0:1789304660.430047:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430067:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296bb4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430075:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296bb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430082:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304660.430086:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296bb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430118:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296bb4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430132:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304660.430135:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789304660.430140:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296bb4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430146:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296bb4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430168:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430174:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296ba6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430179:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296ba6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430185:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304660.430188:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296ba6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430194:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296ba6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430205:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789304660.430207:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304660.430210:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296ba6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304660.430215:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296ba6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304660.430227:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f032405b reply state 000000008e36cf62 transno 4294967668 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304660.430235:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304660.430342:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:50930:x1876219765596160:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2695us (3093us total) trans 4294967668 rc 0/0 00000100:00100000:0.0:1789304660.430351:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 963 00010000:00010000:1.0:1789304660.437235:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304660.437253:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304660.437261:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304660.437268:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304660.437274:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304660.437283:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304660.437302:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9e2c0558d900) 00010000:00010000:1.0:1789304660.437305:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304660.437310:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304660.437317:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296bad lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304660.755756:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304660.755786:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785662080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304660.755875:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304660.756801:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785662080 00000100:00100000:3.0:1789304660.756815:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785662080 00000100:00100000:3.0:1789304660.756892:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1789304660.756902:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785662080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304660.756939:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304660.757120:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304660.757340:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785662080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304660.758286:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785662080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304660.758298:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1789304660.838570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304660.838743:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765596416 00000100:00100000:1.0:1789304660.838754:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765596416 00000100:00100000:1.0:1789304660.838813:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1134 00000100:00100000:1.0:1789304660.838824:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765596416:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304660.838908:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765596416:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304660.838917:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1134 00000100:00100000:0.0:1789304660.839881:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304660.839917:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304660.839945:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765596544 00000100:00100000:0.0:1789304660.839952:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765596544 00000100:00100000:0.0:1789304660.839984:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1135 00000100:00100000:0.0:1789304660.839991:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765596544:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304660.840035:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765596544:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304660.840042:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1135 00000100:00100000:1.0:1789304660.840585:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765596288 00000100:00100000:1.0:1789304660.840592:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765596288 00000100:00100000:1.0:1789304660.840722:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1200 00000100:00100000:1.0:1789304660.840731:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765596288:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304660.843793:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765596288:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 3052us (3905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304660.843809:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1200 00010000:00010000:3.0:1789304661.331491:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304661.778758:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785662208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304661.778836:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304661.779990:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785662208 00000100:00100000:1.0:1789304661.780001:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785662208 00000100:00100000:1.0:1789304661.780075:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:1.0:1789304661.780084:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785662208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304661.780147:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789304661.780270:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304661.786149:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785662208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6054us (7301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304661.786165:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:2.0:1789304661.788325:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785662208:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1789304661.912419:0:86104:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6516f900 20000000:00000080:2.0:1789304661.912439:0:86104:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b0208d400 uarg=0000000000000000 00010000:00010000:2.0:1789304661.915350:0:86104:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304661.915370:0:86104:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304661.915409:0:86104:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304661.915428:0:86104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304661.915444:0:86104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231296842 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129683b expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304661.915452:0:86104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304661.915495:0:86104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231296842 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129683b expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304661.915508:0:86104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231296842 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129683b expref: 18 pid: 5847 timeout: 2261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304661.915522:0:86104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86104:1876219785662336:0@lo:104: 00000100:00100000:2.0:1789304661.915584:0:86104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304661.915711:0:86104:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c205b5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789304661.915855:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785662336 00000100:00100000:0.0:1789304661.915863:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785662336 00000100:00100000:0.0:1789304661.915950:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789304661.915960:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:86104:x1876219785662336:12345-0@lo:104: 00010000:00010000:0.0:1789304661.915974:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304661.916052:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304661.916058:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:86104:x1876219785662336:12345-0@lo:104: Request processed in 101us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304661.916065:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789304661.916154:0:86104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86104:1876219785662336:0@lo:104: 00010000:00010000:2.0:1789304661.916170:0:86104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916241:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304661.916249:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916256:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304661.916260:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916267:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304661.916273:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304661.916277:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304661.916316:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916322:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304661.916345:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916351:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129683b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296842 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916368:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304661.916369:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304661.916371:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304661.916381:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785662464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304661.916414:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304661.916456:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785662464 00000100:00100000:3.0:1789304661.916460:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785662464 00010000:00010000:3.0:1789304661.916478:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231296842 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129683b expref: 19 pid: 5847 timeout: 2261 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304661.916498:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789304661.916504:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785662464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304661.916514:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304661.916518:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231296842 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129683b expref: 19 pid: 5847 timeout: 2261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916526:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231296842 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129683b expref: 19 pid: 5847 timeout: 2261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916538:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231296842 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129683b expref: 19 pid: 5847 timeout: 2261 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916549:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916556:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916568:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916575:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916581:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916591:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916597:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304661.916601:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916607:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916616:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304661.916624:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304661.916652:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785662464:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304661.916659:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789304661.916733:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785662464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304661.916790:0:86104:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304661.916811:0:86104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304661.916817:0:86104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296bbb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304662.355294:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304662.782386:0:86153:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe9f021ed0 20000000:00000080:2.0:1789304662.782404:0:86153:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c40f3b000 uarg=0000000000000000 00010000:00010000:2.0:1789304662.782637:0:86153:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304662.782652:0:86153:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304662.782671:0:86153:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304662.782692:0:86153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304662.782708:0:86153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304662.782720:0:86153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304662.782727:0:86153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304662.782734:0:86153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304662.782741:0:86153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304662.782747:0:86153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304662.782751:0:86153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304662.782759:0:86153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304662.782772:0:86153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304662.782780:0:86153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304662.782787:0:86153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231296bc2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304663.250201:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304663.250210:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304663.250217:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304663.250271:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304663.250284:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304663.250297:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304663.250345:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785662592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304663.250431:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304663.250491:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304663.250577:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785662592 00000100:00100000:1.0:1789304663.250586:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785662592 00000100:00100000:1.0:1789304663.250644:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1789304663.250654:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785662592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304663.250668:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304663.250683:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371000/0xefc0bb7231296bd0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296bc9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304663.250718:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371000/0xefc0bb7231296bd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296bc9 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304663.250730:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371000/0xefc0bb7231296bd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296bc9 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304663.250738:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371000, rc 0) 00000100:00100000:1.0:1789304663.250794:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785662592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304663.250801:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1789304663.251151:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785662592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304663.251167:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304663.251177:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304663.251196:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304663.251201:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304663.251209:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304663.317075:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785662720:0@lo:400:kworker.0 00000100:00100000:0.0:1789304663.317162:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785663104:0@lo:400:kworker.0 00000100:00100000:1.0:1789304663.317163:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304663.317211:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785663232:0@lo:400:kworker.0 00000100:00100000:0.0:1789304663.319611:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304663.319664:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304663.319736:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785662720 00000100:00100000:1.0:1789304663.319745:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785662720 00000100:00100000:1.0:1789304663.319789:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785663104 00000100:00100000:1.0:1789304663.319791:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785663104 00000100:00100000:1.0:1789304663.319819:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1789304663.319828:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785662720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304663.319887:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785662720:12345-0@lo:400:kworker.0 Request processed in 60us (2724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304663.319898:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1789304663.319914:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:1.0:1789304663.319921:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785663104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304663.319949:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785663104:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304663.319955:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:1.0:1789304663.319976:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785663232 00000100:00100000:1.0:1789304663.319980:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785663232 00000100:00100000:1.0:1789304663.320006:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1789304663.320012:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785663232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304663.320060:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785663232:12345-0@lo:400:kworker.0 Request processed in 48us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304663.320066:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00080000:1.0:1789304663.320086:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304663.320109:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304663.320147:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785662720:0@lo:400:kworker.0 00000100:00100000:1.0:1789304663.320157:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785663232:0@lo:400:kworker.0 00000100:00100000:0.0:1789304663.322219:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785662976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304663.322289:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304663.322836:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785662976 00000100:00100000:1.0:1789304663.322844:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785662976 00000100:00100000:1.0:1789304663.322903:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:1.0:1789304663.322911:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785662976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304663.322965:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785662976:12345-0@lo:400:kworker.0 Request processed in 56us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304663.322973:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:0.0:1789304663.323207:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785662976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304663.323231:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304663.323239:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785662848:0@lo:400:kworker.0 00000100:00100000:0.0:1789304663.323269:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304663.323327:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785663104:0@lo:400:kworker.0 00000100:00080000:3.0:1789304663.323556:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304663.323605:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785662848 00000100:00100000:1.0:1789304663.323610:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785662848 00000100:00100000:1.0:1789304663.323650:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1789304663.323657:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785662848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304663.323699:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785662848:12345-0@lo:400:kworker.0 Request processed in 43us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304663.323705:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00080000:3.0:1789304663.323831:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304663.323918:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785662848:0@lo:400:kworker.0 00010000:00010000:3.0:1789304663.381123:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304663.386172:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967668 is committed 00000020:00000080:2.0:1789304663.740424:0:86203:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff8cebbe70 20000000:00000080:2.0:1789304663.740442:0:86203:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c40f3a400 uarg=0000000000000000 00010000:00010000:2.0:1789304663.740913:0:86203:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304663.741383:0:86203:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304663.741408:0:86203:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304663.741429:0:86203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304663.741448:0:86203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41371000/0xefc0bb7231296bd0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296bc9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304663.741457:0:86203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304663.741504:0:86203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41371000/0xefc0bb7231296bd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296bc9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304663.741518:0:86203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41371000/0xefc0bb7231296bd0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296bc9 expref: 18 pid: 5846 timeout: 2263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304663.741534:0:86203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86203:1876219785663360:0@lo:104: 00000100:00100000:2.0:1789304663.741604:0:86203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304663.741661:0:86203:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3874c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789304663.741748:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785663360 00000100:00100000:3.0:1789304663.741757:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785663360 00000100:00100000:3.0:1789304663.741813:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789304663.741823:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:86203:x1876219785663360:12345-0@lo:104: 00010000:00010000:3.0:1789304663.741837:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304663.741907:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304663.741914:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:86203:x1876219785663360:12345-0@lo:104: Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304663.741922:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789304663.741926:0:86203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86203:1876219785663360:0@lo:104: 00010000:00010000:0.0:1789304663.741970:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304663.741979:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.741999:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304663.742004:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742013:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304663.742020:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304663.742038:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304663.742074:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742088:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304663.742137:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742145:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296bc9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296bd0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742161:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304663.742162:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304663.742164:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304663.742172:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304663.742182:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785663488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304663.742216:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304663.742256:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785663488 00000100:00100000:0.0:1789304663.742260:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785663488 00010000:00010000:0.0:1789304663.742280:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41371000/0xefc0bb7231296bd0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296bc9 expref: 19 pid: 5846 timeout: 2263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304663.742299:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1789304663.742305:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785663488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304663.742315:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304663.742321:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41371000/0xefc0bb7231296bd0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296bc9 expref: 19 pid: 5846 timeout: 2263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742332:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41371000/0xefc0bb7231296bd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296bc9 expref: 19 pid: 5846 timeout: 2263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742343:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371000/0xefc0bb7231296bd0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296bc9 expref: 19 pid: 5846 timeout: 2263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742355:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742362:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742374:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742382:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742388:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742394:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742400:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304663.742404:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742411:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742419:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304663.742427:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304663.742461:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785663488:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304663.742467:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789304663.742520:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785663488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304663.743229:0:86203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304663.743241:0:86203:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304663.743247:0:86203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304663.743253:0:86203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231296bd7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304664.404321:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304665.433139:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304665.557448:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304665.557457:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304665.557462:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304665.557515:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304665.557527:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304665.557538:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304665.557568:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785663616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304665.557644:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304665.557718:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e166c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304665.557794:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785663616 00000100:00100000:1.0:1789304665.557804:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785663616 00000100:00100000:1.0:1789304665.557856:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1789304665.557866:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785663616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304665.557879:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304665.557894:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296be5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296bde expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304665.557916:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296be5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296bde expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304665.557927:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296be5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296bde expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304665.557935:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370400, rc 0) 00000100:00100000:1.0:1789304665.557985:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785663616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304665.557991:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1789304665.558560:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785663616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304665.558574:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304665.558584:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304665.558603:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304665.558608:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304665.558616:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304665.877214:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785663744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304665.877319:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304665.877459:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785663744 00000100:00100000:3.0:1789304665.877468:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785663744 00000100:00100000:3.0:1789304665.877532:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1789304665.877542:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785663744:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304665.877553:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789304665.877592:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304665.877657:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785663744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304665.877664:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1789304665.877749:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785663744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304665.954115:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304665.954177:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765596672 00000100:00100000:3.0:1789304665.954191:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765596672 00000100:00100000:0.0:1789304665.954232:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304665.954251:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1203 00000100:00100000:3.0:1789304665.954263:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765596672:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304665.954295:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304665.954348:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765596672:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304665.954356:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304665.954363:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1203 00000100:00100000:0.0:1789304665.954805:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765596800 00000100:00100000:0.0:1789304665.954812:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765596800 00000100:00100000:0.0:1789304665.954920:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1501 00000100:00100000:0.0:1789304665.954929:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765596800:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304665.954989:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765596800:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 60us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304665.954999:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1501 00000100:00100000:0.0:1789304665.955042:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765596928 00000100:00100000:0.0:1789304665.955047:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765596928 00000100:00080000:3.0:1789304665.960364:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304665.961430:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765597056 00000100:00100000:0.0:1789304665.961442:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765597056 00000100:00100000:0.0:1789304665.961506:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1138 00000100:00100000:0.0:1789304665.961516:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765597056:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304665.961601:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765597056:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (7251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304665.961609:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1138 00000100:00100000:0.0:1789304665.961907:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1139 00000100:00100000:0.0:1789304665.961914:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765596928:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304665.961951:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765596928:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (7658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304665.961957:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1139 00000100:00080000:3.0:1789304665.969483:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304665.969494:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304666.453198:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304666.899456:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785663872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304666.899531:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304666.899760:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785663872 00000100:00100000:0.0:1789304666.899769:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785663872 00000100:00100000:0.0:1789304666.899843:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1789304666.899854:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785663872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304666.899890:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304666.899943:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785663872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304666.899950:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00080000:3.0:1789304666.900073:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304666.900132:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785663872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304667.474193:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304667.864006:0:86398:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff59274dc0 20000000:00000080:0.0:1789304667.864024:0:86398:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f654800 uarg=0000000000000000 00010000:00010000:0.0:1789304667.864685:0:86398:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304667.864701:0:86398:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304667.864718:0:86398:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304667.864739:0:86398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304667.864757:0:86398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296be5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296bde expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304667.864765:0:86398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304667.864804:0:86398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296be5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296bde expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304667.864893:0:86398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296be5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296bde expref: 18 pid: 5845 timeout: 2267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304667.864910:0:86398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86398:1876219785664000:0@lo:104: 00000100:00100000:0.0:1789304667.864979:0:86398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304667.865185:0:86398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789304667.866505:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789304667.866530:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785664000 00000100:00100000:1.0:1789304667.866542:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785664000 00000100:00100000:1.0:1789304667.866634:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789304667.866645:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:86398:x1876219785664000:12345-0@lo:104: 00010000:00010000:1.0:1789304667.866663:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304667.866753:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304667.866760:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:86398:x1876219785664000:12345-0@lo:104: Request processed in 117us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304667.866767:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789304667.866972:0:86398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86398:1876219785664000:0@lo:104: 00010000:00010000:0.0:1789304667.867025:0:86398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867229:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304667.867237:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867245:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304667.867249:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867258:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304667.867265:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304667.867272:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304667.867355:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867363:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304667.867394:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867401:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ec00/0xefc0bb7231296bde lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296be5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867417:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304667.867419:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304667.867421:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304667.867427:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304667.867491:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785664128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304667.867531:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304667.867576:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785664128 00000100:00100000:3.0:1789304667.867582:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785664128 00010000:00010000:3.0:1789304667.867603:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296be5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296bde expref: 19 pid: 5845 timeout: 2267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304667.867625:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789304667.867631:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785664128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304667.867642:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304667.867647:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296be5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296bde expref: 19 pid: 5845 timeout: 2267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867657:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296be5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296bde expref: 19 pid: 5845 timeout: 2267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867670:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296be5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296bde expref: 19 pid: 5845 timeout: 2267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867685:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867693:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867707:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867714:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867721:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867727:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867732:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304667.867735:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867742:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867753:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304667.867760:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304667.867787:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785664128:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304667.867794:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00010000:00010000:0.0:1789304667.867917:0:86398:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304667.867925:0:86398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304667.867931:0:86398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296bec lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304667.869709:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785664128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304668.436451:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785664256:0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.436526:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304668.436575:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785664768:0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.436615:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304668.436642:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789304668.436648:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785664384:0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.436669:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304668.436686:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785664896:0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.436706:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304668.436728:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785664512:0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.436807:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304668.436972:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304668.436988:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785664640:0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.437012:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304668.437040:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785664256 00000100:00100000:2.0:1789304668.437048:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785664256 00000100:00100000:2.0:1789304668.437112:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1789304668.437121:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785664256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.437165:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785664256:12345-0@lo:400:kworker.0 Request processed in 46us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304668.437172:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1789304668.437201:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785664768 00000100:00100000:2.0:1789304668.437204:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785664768 00000100:00100000:2.0:1789304668.437232:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785664384 00000100:00100000:2.0:1789304668.437234:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785664384 00000100:00100000:2.0:1789304668.437247:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785664640 00000100:00100000:2.0:1789304668.437249:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785664640 00000100:00100000:2.0:1789304668.437262:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1789304668.437267:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785664768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.437294:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785664768:12345-0@lo:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304668.437299:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1789304668.437310:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:2.0:1789304668.437315:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785664384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.437336:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785664384:12345-0@lo:400:kworker.0 Request processed in 21us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304668.437342:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:2.0:1789304668.437351:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:2.0:1789304668.437356:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785664640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.437380:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785664640:12345-0@lo:400:kworker.0 Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304668.437385:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00080000:2.0:1789304668.437401:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304668.437426:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785664640:0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.437448:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785664384:0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.437456:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785664256:0@lo:400:kworker.0 00000100:00100000:2.0:1789304668.437463:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785664768:0@lo:400:kworker.0 00000100:00100000:0.0:1789304668.438006:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785664896 00000100:00100000:0.0:1789304668.438013:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785664896 00000100:00100000:0.0:1789304668.438055:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785664512 00000100:00100000:0.0:1789304668.438059:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785664512 00000100:00100000:0.0:1789304668.438082:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1789304668.438110:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785664896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304668.438161:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785664896:12345-0@lo:400:kworker.0 Request processed in 73us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304668.438168:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1789304668.438181:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1789304668.438187:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785664512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304668.438217:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785664512:12345-0@lo:400:kworker.0 Request processed in 31us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304668.438223:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1789304668.438277:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785664512:0@lo:400:kworker.0 00000100:00100000:0.0:1789304668.438311:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785664896:0@lo:400:kworker.0 00000100:00080000:1.0:1789304668.438455:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304668.438458:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789304668.500418:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304669.523131:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304669.912985:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304669.912993:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304669.912997:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304669.913047:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304669.913060:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304669.913072:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304669.913114:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785665024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304669.913185:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304669.913230:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785665024 00000100:00100000:3.0:1789304669.913239:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785665024 00000100:00100000:3.0:1789304669.913284:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1789304669.913292:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785665024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304669.913304:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304669.913316:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231296bfa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296bf3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304669.913337:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231296bfa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296bf3 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304669.913347:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231296bfa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296bf3 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304669.913356:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ec00, rc 0) 00000100:00100000:3.0:1789304669.913387:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785665024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304669.913392:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1789304669.913437:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05a083c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304669.913460:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785665024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304669.913474:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304669.913483:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304669.913500:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304669.913505:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304669.913512:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304670.546430:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304670.994435:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304670.994458:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785665152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304670.994534:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304670.994841:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785665152 00000100:00100000:3.0:1789304670.994849:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785665152 00000100:00100000:3.0:1789304670.994919:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1789304670.994929:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785665152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304670.995007:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304670.995201:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785665152:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304670.995311:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304670.995370:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785665152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304670.995388:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1789304671.082776:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304671.082818:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304671.082868:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304671.082899:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304671.082924:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765597184 00000100:00100000:0.0:1789304671.082934:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765597184 00000100:00100000:0.0:1789304671.082990:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1206 00000100:00100000:0.0:1789304671.083001:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765597184:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304671.083066:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765597184:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 68us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304671.083074:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1206 00000100:00100000:1.0:1789304671.083357:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765597568 00000100:00100000:1.0:1789304671.083363:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765597568 00000100:00100000:1.0:1789304671.083403:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765597440 00000100:00100000:1.0:1789304671.083406:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765597440 00000100:00100000:1.0:1789304671.083430:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1142 00000100:00100000:1.0:1789304671.083438:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765597568:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304671.083470:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765597568:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 34us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304671.083477:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1142 00000100:00100000:1.0:1789304671.083500:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1143 00000100:00100000:1.0:1789304671.083507:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765597440:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304671.083532:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765597440:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304671.083538:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1143 00000100:00080000:1.0:1789304671.083559:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304671.083563:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304671.084261:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765597312 00000100:00100000:2.0:1789304671.084269:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765597312 00000100:00100000:2.0:1789304671.084335:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1505 00000100:00100000:2.0:1789304671.084344:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765597312:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304671.084400:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765597312:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 56us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304671.084406:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1505 00000100:00080000:1.0:1789304671.085286:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304671.571485:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304672.032553:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304672.032578:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785665280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304672.032648:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304672.032755:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785665280 00000100:00100000:1.0:1789304672.032764:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785665280 00000100:00100000:1.0:1789304672.032829:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:1.0:1789304672.032839:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785665280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304672.032878:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304672.032925:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785665280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304672.032932:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00080000:3.0:1789304672.037420:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304672.037503:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785665280:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304672.600598:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304673.560896:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785665664:0@lo:400:kworker.0 00000100:00100000:0.0:1789304673.561020:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304673.561120:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304673.561128:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785665792:0@lo:400:kworker.0 00000100:00100000:0.0:1789304673.561168:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304673.561207:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785665664 00000100:00100000:0.0:1789304673.561215:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785665664 00000100:00100000:0.0:1789304673.561269:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1789304673.561278:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785665664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304673.561335:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785665664:12345-0@lo:400:kworker.0 Request processed in 58us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304673.561343:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1789304673.561368:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785665792 00000100:00100000:0.0:1789304673.561372:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785665792 00000100:00100000:0.0:1789304673.561406:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1789304673.561413:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785665792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304673.561443:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785665792:12345-0@lo:400:kworker.0 Request processed in 30us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304673.561449:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00080000:0.0:1789304673.561469:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304673.561505:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785665792:0@lo:400:kworker.0 00000100:00100000:0.0:1789304673.561517:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785665664:0@lo:400:kworker.0 00000100:00100000:2.0:1789304673.561666:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785665408:0@lo:400:kworker.0 00000100:00100000:2.0:1789304673.561707:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304673.561747:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785665920:0@lo:400:kworker.0 00000100:00100000:2.0:1789304673.561771:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304673.561794:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789304673.561800:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785665536:0@lo:400:kworker.0 00000100:00100000:2.0:1789304673.561822:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304673.561840:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785666048:0@lo:400:kworker.0 00000100:00100000:2.0:1789304673.561863:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304673.561895:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785665920 00000100:00100000:2.0:1789304673.561900:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785665920 00000100:00100000:2.0:1789304673.561948:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785665536 00000100:00100000:2.0:1789304673.561952:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785665536 00000100:00100000:2.0:1789304673.561972:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1789304673.561980:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785665920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304673.562033:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785665920:12345-0@lo:400:kworker.0 Request processed in 54us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304673.562039:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1789304673.562054:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:2.0:1789304673.562061:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785665536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304673.562125:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785665536:12345-0@lo:400:kworker.0 Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304673.562132:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:2.0:1789304673.562154:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785666048 00000100:00100000:2.0:1789304673.562158:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785666048 00000100:00100000:2.0:1789304673.562184:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1789304673.562189:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785666048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304673.562221:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785666048:12345-0@lo:400:kworker.0 Request processed in 32us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304673.562227:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1789304673.562255:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785665536:0@lo:400:kworker.0 00000100:00100000:2.0:1789304673.562265:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785666048:0@lo:400:kworker.0 00000100:00100000:2.0:1789304673.562272:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785665920:0@lo:400:kworker.0 00000100:00080000:2.0:1789304673.562315:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304673.562319:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304673.562820:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785665408 00000100:00100000:0.0:1789304673.562826:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785665408 00000100:00100000:0.0:1789304673.562871:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1789304673.562878:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785665408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304673.562946:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785665408:12345-0@lo:400:kworker.0 Request processed in 68us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304673.562952:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1789304673.563180:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785665408:0@lo:400:kworker.0 00010000:00010000:3.0:1789304673.619208:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304674.644776:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304675.666965:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304676.115419:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785666176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304676.115497:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304676.115695:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785666176 00000100:00100000:3.0:1789304676.115703:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785666176 00000100:00100000:3.0:1789304676.115776:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1789304676.115797:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785666176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304676.115832:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304676.115881:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785666176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304676.115888:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00080000:0.0:1789304676.116283:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304676.116326:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785666176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304676.204122:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304676.204297:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765597696 00000100:00100000:3.0:1789304676.204310:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765597696 00000100:00100000:3.0:1789304676.204380:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1208 00000100:00100000:3.0:1789304676.204391:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765597696:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304676.207394:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765597696:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 2994us (3303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304676.207409:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1208 00000100:00100000:0.0:1789304676.210237:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304676.210327:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304676.210468:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765597824 00000100:00100000:2.0:1789304676.210479:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765597824 00000100:00100000:2.0:1789304676.210569:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1509 00000100:00100000:2.0:1789304676.210581:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765597824:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304676.210658:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765597824:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304676.210666:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1509 00000100:00100000:1.0:1789304676.210743:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765597952 00000100:00100000:1.0:1789304676.210748:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765597952 00000100:00100000:1.0:1789304676.210802:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1146 00000100:00100000:1.0:1789304676.210810:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765597952:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304676.210840:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765597952:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304676.210847:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1146 00000100:00080000:0.0:1789304676.212863:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304676.212874:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304676.218850:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304676.218947:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765598080 00000100:00100000:2.0:1789304676.218959:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765598080 00000100:00100000:2.0:1789304676.219207:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1147 00000100:00100000:2.0:1789304676.219219:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765598080:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304676.219442:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765598080:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 225us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304676.219451:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1147 00000100:00080000:0.0:1789304676.224835:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789304676.693967:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789304677.084482:0:86742:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 21: test nodemap mapped_trusted_noadmin fileops ========================================================== 09:04:36 (1789304676) 00000100:00100000:0.0:1789304677.139420:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304677.139444:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785666304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304677.139512:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304677.139577:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785666304 00000100:00100000:0.0:1789304677.139586:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785666304 00000100:00100000:0.0:1789304677.139638:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1789304677.139647:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785666304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304677.139680:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304677.139726:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785666304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304677.139733:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00080000:0.0:1789304677.139754:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304677.139789:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785666304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304677.714326:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:2.0:1789304678.501854:0:86791:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1789304678.507374:0:86791:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000100:00100000:2.0:1789304678.678405:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785666560:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.678473:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304678.678516:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785667072:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.678539:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304678.678566:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789304678.678572:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785666432:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.678599:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304678.678607:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785666688:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.678618:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785666944:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.678635:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304678.678658:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785666816:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.678693:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304678.679332:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304678.679346:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785666560 00000100:00100000:2.0:1789304678.679359:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785666560 00000100:00100000:2.0:1789304678.679401:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785666944 00000100:00100000:2.0:1789304678.679404:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785666944 00000100:00100000:2.0:1789304678.679430:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785666816 00000100:00100000:2.0:1789304678.679433:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785666816 00000100:00100000:2.0:1789304678.679448:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1789304678.679456:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785666560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.679512:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785666560:12345-0@lo:400:kworker.0 Request processed in 56us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304678.679518:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1789304678.679533:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1789304678.679539:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785666944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.679565:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785666944:12345-0@lo:400:kworker.0 Request processed in 27us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304678.679574:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1789304678.679584:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:2.0:1789304678.679590:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785666816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.679618:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785666816:12345-0@lo:400:kworker.0 Request processed in 29us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304678.679624:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00080000:0.0:1789304678.679653:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304678.683014:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785666432 00000100:00100000:0.0:1789304678.683027:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785666432 00000100:00100000:0.0:1789304678.683070:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1789304678.683077:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785666432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304678.683155:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785666432:12345-0@lo:400:kworker.0 Request processed in 79us (4556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304678.683159:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1789304678.685272:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785667072 00000100:00100000:2.0:1789304678.685286:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785667072 00000100:00100000:2.0:1789304678.685358:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1789304678.685369:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785667072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.685449:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785667072:12345-0@lo:400:kworker.0 Request processed in 82us (6907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304678.685457:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1789304678.685472:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785666688 00000100:00100000:2.0:1789304678.685476:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785666688 00000100:00100000:2.0:1789304678.685492:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1789304678.685496:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785666688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.685523:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785666688:12345-0@lo:400:kworker.0 Request processed in 27us (6195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304678.685526:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1789304678.685559:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785666432:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.685571:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785666944:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.685578:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785666560:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.685584:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785667072:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.685615:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785666816:0@lo:400:kworker.0 00000100:00100000:2.0:1789304678.685804:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785666688:0@lo:400:kworker.0 00000100:00080000:0.0:1789304678.685947:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789304678.738257:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304679.412805:0:86839:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe358c0f80 20000000:00000080:1.0:1789304679.412824:0:86839:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3846a000 uarg=0000000000000000 10000000:01000000:1.0:1789304679.415958:0:86839:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304679.415991:0:86839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304679.416014:0:86839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231296bfa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296bf3 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304679.416022:0:86839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304679.416065:0:86839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231296bfa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296bf3 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304679.416083:0:86839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231296bfa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296bf3 expref: 18 pid: 5845 timeout: 2279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304679.417581:0:86839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86839:1876219785667200:0@lo:104: 00000100:00100000:1.0:1789304679.417667:0:86839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304679.417738:0:86839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789304679.417810:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785667200 00000100:00100000:3.0:1789304679.417822:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785667200 00000100:00100000:3.0:1789304679.417896:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789304679.417908:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:86839:x1876219785667200:12345-0@lo:104: 00010000:00010000:3.0:1789304679.417927:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304679.418012:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304679.418018:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:86839:x1876219785667200:12345-0@lo:104: Request processed in 113us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304679.418025:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00010000:2.0:1789304679.418078:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304679.418086:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418121:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304679.418134:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418145:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304679.418153:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304679.418161:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304679.418196:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418203:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304679.418224:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418231:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb7231296bf3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296bfa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418248:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304679.418250:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304679.418253:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304679.418264:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785667328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304679.418293:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304679.418337:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785667328 00000100:00100000:2.0:1789304679.418342:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785667328 00010000:00010000:2.0:1789304679.418364:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231296bfa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296bf3 expref: 19 pid: 5845 timeout: 2279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304679.418388:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789304679.418394:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785667328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304679.418406:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304679.418412:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231296bfa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296bf3 expref: 19 pid: 5845 timeout: 2279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418423:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231296bfa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296bf3 expref: 19 pid: 5845 timeout: 2279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418440:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418449:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418465:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418474:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418483:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418495:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418501:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304679.418505:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418512:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418520:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304679.418529:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304679.418556:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785667328:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304679.418562:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789304679.418596:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785667328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304679.418792:0:86839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231296bfa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296bf3 expref: 18 pid: 5845 timeout: 2279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304679.418805:0:86839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86839:1876219785667200:0@lo:104: 00010000:00010000:0.0:1789304679.418819:0:86839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304679.418827:0:86839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304679.418832:0:86839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304679.418842:0:86839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371200/0xefc0bb7231296c01 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304679.762321:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304680.194266:0:86887:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffedebb1af0 20000000:00000080:2.0:1789304680.194286:0:86887:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c371f3800 uarg=0000000000000000 10000000:01000000:2.0:1789304680.194582:0:86887:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304680.194607:0:86887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.194625:0:86887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.194637:0:86887:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.194649:0:86887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.194657:0:86887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.194743:0:86887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.194750:0:86887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304680.194755:0:86887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.194764:0:86887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.194779:0:86887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.194787:0:86887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.194794:0:86887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296c08 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304680.793958:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304680.942590:0:86935:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde201d800 20000000:00000080:2.0:1789304680.942608:0:86935:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c371f1800 uarg=0000000000000000 10000000:01000000:2.0:1789304680.942789:0:86935:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304680.942810:0:86935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.942830:0:86935:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.942841:0:86935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.942847:0:86935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.942853:0:86935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.942860:0:86935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.943056:0:86935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304680.943062:0:86935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.943071:0:86935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.943083:0:86935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.943328:0:86935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304680.943334:0:86935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231296c0f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304681.044182:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304681.044191:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304681.044196:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304681.044251:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304681.044264:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304681.044276:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304681.044301:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785667456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304681.044430:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304681.044544:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f703300 going to sleep for 11 seconds 00000100:00100000:0.0:1789304681.044609:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785667456 00000100:00100000:0.0:1789304681.044617:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785667456 00000100:00100000:0.0:1789304681.044675:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:0.0:1789304681.044686:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785667456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304681.044698:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304681.044711:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c1d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296c16 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.044733:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296c16 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.044743:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c16 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.044753:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa800, rc 0) 00000100:00100000:0.0:1789304681.044806:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785667456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304681.044814:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:1.0:1789304681.045008:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785667456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304681.045024:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304681.045033:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304681.045053:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304681.045058:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304681.045065:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304681.234366:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304681.235002:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785667584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304681.235081:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304681.238043:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785667584 00000100:00100000:1.0:1789304681.238060:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785667584 00000100:00080000:0.0:1789304681.238569:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304681.239259:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1789304681.239275:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785667584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304681.239317:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304681.239416:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785667584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (4334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304681.239424:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1789304681.239527:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785667584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304681.328000:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304681.328045:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304681.328075:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304681.328136:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304681.328164:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765598464 00000100:00100000:0.0:1789304681.328175:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765598464 00000100:00100000:0.0:1789304681.328231:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765598592 00000100:00100000:0.0:1789304681.328234:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765598592 00000100:00100000:0.0:1789304681.328257:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 525 00000100:00100000:0.0:1789304681.328266:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765598464:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:0.0:1789304681.328301:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb72312964ad 00000100:00080000:0.0:1789304681.328312:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9e2b01e99000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789304681.328355:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967357 00000100:00100000:1.0:1789304681.328382:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 526 00000100:00100000:1.0:1789304681.328391:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765598592:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:1.0:1789304681.328404:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb723129655c 00000100:00080000:1.0:1789304681.328409:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2b02ecb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789304681.328433:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967357 00000100:00100000:0.0:1789304681.328739:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765598464:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 473us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304681.328748:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 525 00000100:00100000:0.0:1789304681.328772:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765598208 00000100:00100000:0.0:1789304681.328776:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765598208 00000100:00100000:0.0:1789304681.328798:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1211 00000100:00100000:0.0:1789304681.328805:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765598208:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304681.332072:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765598592:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 3671us (4015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304681.332087:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 526 00010000:00010000:1.0:1789304681.332139:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304681.332277:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789304681.332293:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304681.332298:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304681.332313:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765598336 00000100:00100000:3.0:1789304681.332323:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765598336 00000100:00100000:3.0:1789304681.332399:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1513 00000100:00100000:3.0:1789304681.332408:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765598336:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304681.332471:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765598336:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 65us (4333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304681.332478:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1513 00000100:00080000:3.0:1789304681.332520:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304681.336949:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765598208:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 8131us (8859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304681.336965:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1211 00000020:00000080:1.0:1789304681.740203:0:86983:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc9bd95500 20000000:00000080:1.0:1789304681.740222:0:86983:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c411efc00 uarg=0000000000000000 10000000:01000000:1.0:1789304681.740420:0:86983:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304681.740443:0:86983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304681.740462:0:86983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c16 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304681.740471:0:86983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304681.740513:0:86983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296c16 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304681.740529:0:86983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c1d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296c16 expref: 18 pid: 5845 timeout: 2281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304681.740543:0:86983:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86983:1876219785667712:0@lo:104: 00000100:00100000:1.0:1789304681.740678:0:86983:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304681.740796:0:86983:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304681.740846:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785667712 00000100:00100000:2.0:1789304681.740864:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785667712 00000100:00100000:2.0:1789304681.741040:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789304681.741051:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:86983:x1876219785667712:12345-0@lo:104: 00010000:00010000:2.0:1789304681.741066:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304681.741169:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304681.741176:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:86983:x1876219785667712:12345-0@lo:104: Request processed in 128us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304681.741183:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789304681.741269:0:86983:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86983:1876219785667712:0@lo:104: 00010000:00010000:1.0:1789304681.741290:0:86983:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741376:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304681.741385:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741393:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304681.741397:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741406:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304681.741414:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304681.741419:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304681.741453:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741460:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304681.741482:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741489:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecdc00/0xefc0bb7231296c16 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c1d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741506:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304681.741508:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304681.741509:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304681.741529:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785667840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304681.741563:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304681.741618:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785667840 00000100:00100000:0.0:1789304681.741623:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785667840 00010000:00010000:0.0:1789304681.741644:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c1d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c16 expref: 19 pid: 5845 timeout: 2281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304681.741667:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789304681.741675:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785667840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304681.741686:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304681.741691:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c1d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c16 expref: 19 pid: 5845 timeout: 2281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741702:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296c16 expref: 19 pid: 5845 timeout: 2281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741714:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c1d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296c16 expref: 19 pid: 5845 timeout: 2281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741725:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741734:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741747:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741754:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741761:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741767:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741773:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304681.741777:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741789:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741800:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304681.741808:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304681.741836:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785667840:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304681.741843:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789304681.741881:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785667840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304681.741949:0:86983:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304681.741957:0:86983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304681.741964:0:86983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370000/0xefc0bb7231296c24 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789304681.810672:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789304681.810681:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2b02ecf800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789304681.810702:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b02ecf800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:0.0:1789304681.810749:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b02ecb000 for lustre-OST0001 00010000:00010000:1.0:1789304681.819361:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789304681.826469:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:2.0:1789304681.826489:0:6723:0:(genops.c:885:class_export_put()) final put ffff9e2b01e98800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789304681.828132:0:83748:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b01e98800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0000 00000020:00000080:0.0:1789304681.833311:0:83748:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b01e99000 for lustre-OST0000 00000100:00100000:0.0:1789304682.259323:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785667968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304682.259401:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304682.259521:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785667968 00000100:00100000:3.0:1789304682.259532:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785667968 00000100:00100000:3.0:1789304682.259603:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1789304682.259612:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785667968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304682.259650:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304682.259704:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785667968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304682.259712:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1789304682.259762:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785667968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304682.259821:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789304682.626450:0:87032:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc8998ca50 20000000:00000080:2.0:1789304682.626471:0:87032:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3fb2b400 uarg=0000000000000000 10000000:01000000:2.0:1789304682.626682:0:87032:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304682.626704:0:87032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304682.626721:0:87032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304682.626731:0:87032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304682.626738:0:87032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304682.626746:0:87032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304682.626752:0:87032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304682.626758:0:87032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304682.626763:0:87032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304682.626771:0:87032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304682.626784:0:87032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304682.626791:0:87032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304682.626798:0:87032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231296c2b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304682.850338:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304683.219148:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304683.219158:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304683.219166:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304683.219221:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.219236:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.219249:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304683.219277:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785668096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304683.219347:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304683.219425:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c205b5540 going to sleep for 11 seconds 00000100:00100000:3.0:1789304683.219562:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785668096 00000100:00100000:3.0:1789304683.219570:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785668096 00000100:00100000:3.0:1789304683.219624:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1789304683.219633:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785668096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304683.219645:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304683.219659:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231296c39 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296c32 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304683.219683:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231296c39 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296c32 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304683.219695:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231296c39 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c32 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304683.219704:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304683.219761:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785668096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304683.219768:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1789304683.219810:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785668096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304683.219823:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304683.219831:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304683.219865:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304683.219871:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304683.219878:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789304683.582883:0:87080:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1bbc4e60 20000000:00000080:1.0:1789304683.582903:0:87080:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02ec4400 uarg=0000000000000000 10000000:01000000:1.0:1789304683.584568:0:87080:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304683.584589:0:87080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304683.584675:0:87080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231296c39 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c32 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304683.584695:0:87080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304683.584734:0:87080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231296c39 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296c32 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304683.584748:0:87080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231296c39 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296c32 expref: 18 pid: 5847 timeout: 2283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304683.584763:0:87080:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87080:1876219785668224:0@lo:104: 00000100:00100000:1.0:1789304683.584827:0:87080:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304683.584930:0:87080:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c36e549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304683.588024:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785668224 00000100:00100000:0.0:1789304683.588042:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785668224 00000100:00100000:0.0:1789304683.588141:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789304683.588153:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:87080:x1876219785668224:12345-0@lo:104: 00010000:00010000:0.0:1789304683.588173:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.588272:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304683.588279:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:87080:x1876219785668224:12345-0@lo:104: Request processed in 130us (3452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304683.588286:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789304683.588521:0:87080:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87080:1876219785668224:0@lo:104: 00010000:00010000:1.0:1789304683.588542:0:87080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304683.588590:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304683.588596:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304683.588601:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304683.588604:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304683.588618:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304683.588623:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304683.588627:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304683.588658:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304683.588665:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789304683.588754:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785668352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304683.588792:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789304683.588855:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304683.588864:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231296c32 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c39 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304683.588881:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304683.588883:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304683.588884:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304683.588963:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785668352 00000100:00100000:0.0:1789304683.588969:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785668352 00010000:00010000:0.0:1789304683.588989:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231296c39 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c32 expref: 19 pid: 5847 timeout: 2283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304683.589021:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789304683.589030:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785668352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304683.589041:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304683.589046:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231296c39 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c32 expref: 19 pid: 5847 timeout: 2283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589062:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231296c39 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296c32 expref: 19 pid: 5847 timeout: 2283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589076:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231296c39 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296c32 expref: 19 pid: 5847 timeout: 2283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589109:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589118:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589133:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589141:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589153:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589160:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589166:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304683.589170:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589177:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589195:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304683.589202:0:87080:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304683.589203:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304683.589208:0:87080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304683.589215:0:87080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296c40 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304683.589242:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785668352:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304683.589249:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789304683.589469:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785668352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304683.796542:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785668864:0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.796609:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304683.796663:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789304683.796670:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785668480:0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.796696:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304683.796727:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785668992:0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.796752:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304683.796777:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785668608:0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.796798:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304683.796817:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304683.796821:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785668736:0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.796850:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304683.796883:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785668864 00000100:00100000:0.0:1789304683.796889:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785668864 00000100:00100000:0.0:1789304683.796940:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785668480 00000100:00100000:0.0:1789304683.796943:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785668480 00000100:00100000:0.0:1789304683.796962:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785668736 00000100:00100000:0.0:1789304683.796964:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785668736 00000100:00100000:0.0:1789304683.796979:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1789304683.796987:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785668864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.797037:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785668864:12345-0@lo:400:kworker.0 Request processed in 50us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304683.797043:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1789304683.797060:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1789304683.797067:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785668480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.797119:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785668480:12345-0@lo:400:kworker.0 Request processed in 53us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304683.797125:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1789304683.797138:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1789304683.797144:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785668736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.797173:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785668736:12345-0@lo:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304683.797178:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1789304683.797196:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785668992 00000100:00100000:0.0:1789304683.797200:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785668992 00000100:00100000:0.0:1789304683.797222:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785668608 00000100:00100000:0.0:1789304683.797225:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785668608 00000100:00100000:0.0:1789304683.797241:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1789304683.797247:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785668992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.797273:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785668992:12345-0@lo:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304683.797279:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1789304683.797289:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1789304683.797294:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785668608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.797319:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785668608:12345-0@lo:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304683.797328:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00080000:0.0:1789304683.797348:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304683.797352:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304683.797388:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785668736:0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.797398:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785668608:0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.797425:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785668480:0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.797432:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785668992:0@lo:400:kworker.0 00000100:00100000:0.0:1789304683.797439:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785668864:0@lo:400:kworker.0 00010000:00010000:1.0:1789304683.859831:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304684.894200:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304685.202174:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304685.202183:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304685.202190:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304685.202243:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304685.202257:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304685.202269:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304685.202297:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785669120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304685.202394:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304685.202465:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304685.202542:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785669120 00000100:00100000:1.0:1789304685.202550:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785669120 00000100:00100000:1.0:1789304685.202615:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1789304685.202625:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785669120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304685.202640:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304685.202656:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296c4e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296c47 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304685.202680:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296c4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296c47 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304685.202693:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296c4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c47 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304685.202702:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370400, rc 0) 00000100:00100000:1.0:1789304685.202759:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785669120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304685.202766:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1789304685.203011:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785669120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304685.203027:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304685.203036:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304685.203056:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304685.203062:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304685.203070:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304685.907227:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304686.360821:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304686.360843:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785669248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304686.360907:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304686.360974:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785669248 00000100:00100000:0.0:1789304686.360980:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785669248 00000100:00100000:0.0:1789304686.361037:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1789304686.361046:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785669248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304686.361082:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304686.361145:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785669248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304686.361152:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00080000:0.0:1789304686.361175:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304686.361220:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785669248:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1789304686.366690:0:87229:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd7d24960 20000000:00000080:1.0:1789304686.366707:0:87229:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3860a800 uarg=0000000000000000 10000000:01000000:1.0:1789304686.369022:0:87229:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304686.369049:0:87229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304686.369069:0:87229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296c4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c47 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304686.369082:0:87229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304686.369404:0:87229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296c4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296c47 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304686.369418:0:87229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296c4e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296c47 expref: 18 pid: 5846 timeout: 2286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304686.369432:0:87229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87229:1876219785669376:0@lo:104: 00000100:00100000:1.0:1789304686.369489:0:87229:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304686.369572:0:87229:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0621f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789304686.372184:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785669376 00000100:00100000:2.0:1789304686.372198:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785669376 00000100:00100000:2.0:1789304686.372256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789304686.372266:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:87229:x1876219785669376:12345-0@lo:104: 00010000:00010000:2.0:1789304686.372285:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304686.373530:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304686.373543:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:87229:x1876219785669376:12345-0@lo:104: Request processed in 1276us (4050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304686.373552:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00010000:00010000:3.0:1789304686.373658:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304686.373666:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304686.373676:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304686.373680:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304686.373691:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304686.373698:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304686.373704:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304686.373750:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304686.373756:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304686.373779:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304686.373786:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb7231296c47 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304686.373802:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304686.373804:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304686.373806:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304686.373824:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304686.373837:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785669504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304686.373876:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304686.373963:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785669504 00000100:00100000:0.0:1789304686.373972:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785669504 00010000:00010000:0.0:1789304686.374004:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296c4e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c47 expref: 19 pid: 5846 timeout: 2286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304686.374035:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789304686.374043:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785669504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304686.374055:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304686.374060:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296c4e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c47 expref: 19 pid: 5846 timeout: 2286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374070:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296c4e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296c47 expref: 19 pid: 5846 timeout: 2286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374087:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374130:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374157:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374164:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374171:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374177:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374182:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304686.374187:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374195:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374203:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304686.374212:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304686.374241:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785669504:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304686.374247:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789304686.374280:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785669504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304686.375997:0:87229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296c4e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296c47 expref: 18 pid: 5846 timeout: 2286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304686.376016:0:87229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87229:1876219785669376:0@lo:104: 00010000:00010000:1.0:1789304686.376035:0:87229:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304686.376045:0:87229:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304686.376051:0:87229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304686.376057:0:87229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370600/0xefc0bb7231296c55 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304686.438249:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304686.438564:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304686.438625:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765598848 00000100:00100000:3.0:1789304686.438635:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765598848 00000100:00100000:3.0:1789304686.438704:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1517 00000100:00100000:3.0:1789304686.438716:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765598848:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304686.438788:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765598848:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304686.438797:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1517 00000100:00080000:2.0:1789304686.440440:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304686.442007:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765598720 00000100:00100000:0.0:1789304686.442021:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765598720 00000100:00100000:0.0:1789304686.443083:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1214 00000100:00100000:0.0:1789304686.443126:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765598720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304686.443221:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765598720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 102us (4978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304686.443229:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1214 00010000:00010000:2.0:1789304686.930269:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304687.119251:0:87278:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe36d80000 20000000:00000080:2.0:1789304687.119268:0:87278:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854dc00 uarg=0000000000000000 10000000:01000000:2.0:1789304687.120239:0:87278:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304687.120551:0:87278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.120570:0:87278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.120580:0:87278:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.120586:0:87278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.120593:0:87278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.120605:0:87278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.120616:0:87278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304687.120622:0:87278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.120629:0:87278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.120644:0:87278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.120651:0:87278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.120660:0:87278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecce00/0xefc0bb7231296c5c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304687.381353:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304687.381377:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785669632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304687.381447:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304687.381551:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785669632 00000100:00100000:1.0:1789304687.381561:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785669632 00000100:00100000:1.0:1789304687.381631:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1789304687.381641:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785669632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304687.381680:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304687.381731:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785669632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304687.381738:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00080000:2.0:1789304687.384919:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304687.385028:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785669632:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789304687.570153:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304687.570160:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304687.570164:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304687.570211:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.570228:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.570239:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304687.570264:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38652300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785669760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304687.571124:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304687.571172:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b04091e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789304687.571231:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785669760 00000100:00100000:0.0:1789304687.571240:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785669760 00000100:00100000:0.0:1789304687.571364:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1789304687.571375:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785669760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304687.571390:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304687.571406:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296c6a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296c63 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304687.571438:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296c6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296c63 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304687.571450:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296c6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c63 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304687.571460:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304687.571500:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785669760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304687.571507:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1789304687.571595:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38652300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785669760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304687.571611:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.571620:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304687.571639:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304687.571645:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304687.571651:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304687.954994:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304688.920106:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785670272:0@lo:400:kworker.0 00000100:00100000:1.0:1789304688.920181:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304688.920241:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789304688.920247:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785669888:0@lo:400:kworker.0 00000100:00100000:1.0:1789304688.920279:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304688.920302:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785670400:0@lo:400:kworker.0 00000100:00100000:1.0:1789304688.920322:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304688.921069:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785670016:0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.923113:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785670144:0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.923179:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304688.923243:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785670272 00000100:00100000:0.0:1789304688.923252:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785670272 00000100:00100000:0.0:1789304688.923305:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785670400 00000100:00100000:0.0:1789304688.923309:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785670400 00000100:00100000:0.0:1789304688.923332:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:0.0:1789304688.923341:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785670272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.923400:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785670272:12345-0@lo:400:kworker.0 Request processed in 60us (3219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304688.923407:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:0.0:1789304688.923423:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:0.0:1789304688.923429:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785670400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.923455:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785670400:12345-0@lo:400:kworker.0 Request processed in 27us (3133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304688.923461:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00100000:0.0:1789304688.923481:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785669888 00000100:00100000:0.0:1789304688.923485:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785669888 00000100:00100000:0.0:1789304688.923510:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:0.0:1789304688.923516:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785669888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.923557:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785669888:12345-0@lo:400:kworker.0 Request processed in 28us (3264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304688.923564:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:0.0:1789304688.923618:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785669888:0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.923632:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785670400:0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.923643:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785670272:0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.923679:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304688.923821:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785670528:0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.923849:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304688.923878:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785670016 00000100:00100000:0.0:1789304688.923882:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785670016 00000100:00100000:0.0:1789304688.923904:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1789304688.923910:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785670016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.923942:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785670016:12345-0@lo:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304688.923948:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1789304688.923962:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785670144 00000100:00100000:0.0:1789304688.923965:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785670144 00000100:00100000:0.0:1789304688.923983:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785670528 00000100:00100000:0.0:1789304688.923985:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785670528 00000100:00100000:0.0:1789304688.924001:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1789304688.924006:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785670144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.924033:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785670144:12345-0@lo:400:kworker.0 Request processed in 27us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304688.924039:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1789304688.924047:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:0.0:1789304688.924052:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785670528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.924074:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785670528:12345-0@lo:400:kworker.0 Request processed in 22us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304688.924079:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:0.0:1789304688.924129:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785670144:0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.924148:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785670016:0@lo:400:kworker.0 00000100:00100000:0.0:1789304688.924156:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785670528:0@lo:400:kworker.0 00000100:00080000:2.0:1789304688.924684:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304688.924689:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304688.991010:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304690.004006:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304690.367685:0:87475:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffbf5941b0 20000000:00000080:0.0:1789304690.367782:0:87475:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02f31000 uarg=0000000000000000 00010000:00010000:0.0:1789304690.368791:0:87475:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304690.368809:0:87475:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304690.368823:0:87475:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304690.368842:0:87475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304690.368860:0:87475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296c6a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c63 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304690.368869:0:87475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304690.368914:0:87475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296c6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296c63 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304690.368929:0:87475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296c6a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296c63 expref: 18 pid: 5847 timeout: 2290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304690.368945:0:87475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87475:1876219785670656:0@lo:104: 00000100:00100000:0.0:1789304690.369011:0:87475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304690.369159:0:87475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13d74840 going to sleep for 11 seconds 00000100:00100000:1.0:1789304690.369403:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785670656 00000100:00100000:1.0:1789304690.369411:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785670656 00000100:00100000:1.0:1789304690.369496:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789304690.369507:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:87475:x1876219785670656:12345-0@lo:104: 00010000:00010000:1.0:1789304690.369528:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304690.369592:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789304690.369710:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304690.369718:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304690.369726:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304690.369730:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304690.369739:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304690.369746:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304690.369752:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304690.369794:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304690.369800:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789304690.369809:0:87475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87475:1876219785670656:0@lo:104: 00010000:00010000:2.0:1789304690.369821:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.369828:0:87475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304690.369828:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb7231296c63 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304690.369846:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304690.369848:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304690.369850:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304690.369868:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785670784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304690.369869:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:87475:x1876219785670656:12345-0@lo:104: Request processed in 94us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304690.369876:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789304690.369898:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304690.369953:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785670784 00000100:00100000:3.0:1789304690.369958:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785670784 00010000:00010000:3.0:1789304690.369979:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296c6a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c63 expref: 19 pid: 5847 timeout: 2290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304690.370002:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789304690.370008:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785670784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304690.370021:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304690.370026:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296c6a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c63 expref: 19 pid: 5847 timeout: 2290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370038:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296c6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296c63 expref: 19 pid: 5847 timeout: 2290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370050:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa000/0xefc0bb7231296c6a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296c63 expref: 19 pid: 5847 timeout: 2290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370062:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370069:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370087:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370115:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370123:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370129:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370135:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304690.370139:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370147:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370168:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304690.370177:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304690.370183:0:87475:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304690.370195:0:87475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304690.370201:0:87475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231296c71 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304690.370217:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785670784:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304690.370224:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789304690.370256:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785670784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304691.028478:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304691.474286:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304691.474311:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785670912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304691.474383:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304691.476210:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785670912 00000100:00100000:0.0:1789304691.476224:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785670912 00000100:00100000:0.0:1789304691.476353:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1789304691.476364:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785670912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304691.476402:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304691.476481:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785670912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304691.476490:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00080000:1.0:1789304691.476771:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304691.476893:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785670912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304691.553383:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304691.553422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304691.553462:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765598976 00000100:00100000:2.0:1789304691.553472:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765598976 00000100:00100000:0.0:1789304691.553538:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765599104 00000100:00100000:0.0:1789304691.553542:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765599104 00000100:00100000:0.0:1789304691.553598:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1521 00000100:00100000:0.0:1789304691.553610:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765599104:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304691.553618:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1217 00000100:00100000:2.0:1789304691.553626:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765598976:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304691.553682:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765599104:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304691.553690:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1521 00000100:00100000:2.0:1789304691.553744:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765598976:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 119us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304691.553750:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1217 00000100:00080000:3.0:1789304691.553868:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1789304691.923271:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304691.923278:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304691.923282:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304691.923319:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304691.923329:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304691.923338:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304691.923357:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785671040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304691.923426:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304691.923476:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785671040 00000100:00100000:2.0:1789304691.923480:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789304691.923484:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785671040 00000100:00100000:0.0:1789304691.923536:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:0.0:1789304691.923542:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785671040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304691.923553:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304691.923571:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296c7f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296c78 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304691.923589:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296c7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296c78 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304691.923597:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296c7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c78 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304691.923606:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:0.0:1789304691.923654:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785671040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304691.923661:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1789304691.923810:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785671040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304691.923824:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304691.923833:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304691.923852:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304691.923857:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304691.923864:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304692.050401:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304692.510540:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785671168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304692.510617:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304692.510768:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785671168 00000100:00100000:0.0:1789304692.510777:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785671168 00000100:00100000:0.0:1789304692.510854:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1789304692.510864:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785671168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304692.510898:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304692.517786:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785671168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6915us (7159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304692.517813:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00080000:0.0:1789304692.517854:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304692.519485:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785671168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304693.078198:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304693.756084:0:87672:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0597f300 20000000:00000080:3.0:1789304693.756137:0:87672:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c40c77800 uarg=0000000000000000 10000000:01000000:3.0:1789304693.756186:0:87672:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304693.756206:0:87672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304693.756224:0:87672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296c7f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c78 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304693.756234:0:87672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304693.756273:0:87672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296c7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296c78 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304693.756288:0:87672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296c7f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296c78 expref: 18 pid: 5847 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304693.756303:0:87672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87672:1876219785671296:0@lo:104: 00000100:00100000:3.0:1789304693.757192:0:87672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304693.757308:0:87672:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789304693.757493:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785671296 00000100:00100000:2.0:1789304693.757716:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785671296 00000100:00100000:2.0:1789304693.757932:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789304693.757944:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:87672:x1876219785671296:12345-0@lo:104: 00010000:00010000:2.0:1789304693.757961:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304693.758045:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304693.758051:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:87672:x1876219785671296:12345-0@lo:104: Request processed in 111us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304693.758059:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789304693.758165:0:87672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87672:1876219785671296:0@lo:104: 00010000:00010000:3.0:1789304693.758188:0:87672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304693.758251:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304693.758259:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304693.758266:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304693.758270:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304693.758278:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304693.758285:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304693.758291:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304693.758341:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304693.758348:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304693.758371:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304693.758379:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb7231296c78 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304693.758398:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304693.758400:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304693.758402:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304693.758859:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785671424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304693.758900:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304693.759010:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785671424 00000100:00100000:0.0:1789304693.759016:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785671424 00010000:00010000:0.0:1789304693.759041:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296c7f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c78 expref: 19 pid: 5847 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304693.759154:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1789304693.759162:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785671424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304693.759174:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304693.759179:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296c7f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c78 expref: 19 pid: 5847 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.759189:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296c7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296c78 expref: 19 pid: 5847 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.759204:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296c7f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296c78 expref: 19 pid: 5847 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.759218:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.759225:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.759239:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.759247:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.759254:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.759261:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.759272:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304693.759277:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.759285:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304693.759869:0:87672:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304693.759879:0:87672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.762289:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.762308:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231296c86 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304693.762330:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304693.762552:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785671424:12345-0@lo:103:ldlm_bl.0 Request processed in 3386us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304693.762562:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789304693.762865:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785671424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304694.035489:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304694.035517:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785671936:0@lo:400:kworker.0 00000100:00100000:0.0:1789304694.035526:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785672064:0@lo:400:kworker.0 00000100:00100000:0.0:1789304694.035659:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304694.035727:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785671680:0@lo:400:kworker.0 00000100:00100000:0.0:1789304694.035776:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304694.036132:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785671808:0@lo:400:kworker.0 00000100:00100000:1.0:1789304694.037954:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304694.041355:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785671552:0@lo:400:kworker.0 00000100:00100000:1.0:1789304694.041436:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304694.041710:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785671936 00000100:00100000:0.0:1789304694.041719:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785671936 00000100:00100000:0.0:1789304694.041891:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785671552 00000100:00100000:0.0:1789304694.041896:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785671552 00000100:00100000:0.0:1789304694.041918:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1789304694.041927:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785671936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304694.041987:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785671936:12345-0@lo:400:kworker.0 Request processed in 61us (4037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304694.041997:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1789304694.042013:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:0.0:1789304694.042019:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785671552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304694.042046:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785671552:12345-0@lo:400:kworker.0 Request processed in 27us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304694.042052:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:0.0:1789304694.042071:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785672064 00000100:00100000:0.0:1789304694.042076:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785672064 00000100:00100000:0.0:1789304694.042118:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785671680 00000100:00100000:0.0:1789304694.042122:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785671680 00000100:00100000:0.0:1789304694.042143:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1789304694.042151:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785672064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304694.042187:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785672064:12345-0@lo:400:kworker.0 Request processed in 37us (6529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304694.042192:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1789304694.044549:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1789304694.044575:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785671680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304694.044655:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785671680:12345-0@lo:400:kworker.0 Request processed in 94us (8878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304694.044662:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00080000:1.0:1789304694.046125:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304694.046134:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304694.046137:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304694.047518:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785671680:0@lo:400:kworker.0 00000100:00100000:2.0:1789304694.047564:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785672064:0@lo:400:kworker.0 00000100:00100000:2.0:1789304694.047587:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785671936:0@lo:400:kworker.0 00000100:00100000:2.0:1789304694.047598:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785671552:0@lo:400:kworker.0 00000100:00100000:0.0:1789304694.051195:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304694.051240:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785671808 00000100:00100000:0.0:1789304694.051250:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785671808 00000100:00100000:0.0:1789304694.051307:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1789304694.051317:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785671808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304694.051378:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785671808:12345-0@lo:400:kworker.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304694.051386:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00080000:0.0:1789304694.051423:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304694.051499:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785671808:0@lo:400:kworker.0 00010000:00010000:3.0:1789304694.099863:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304694.505012:0:87721:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffcc8b87c0 20000000:00000080:3.0:1789304694.505032:0:87721:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c40c76c00 uarg=0000000000000000 00010000:00010000:3.0:1789304694.505951:0:87721:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789304694.505969:0:87721:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789304694.505984:0:87721:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304694.506007:0:87721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304694.506024:0:87721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304694.506034:0:87721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304694.506041:0:87721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304694.506049:0:87721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304694.506057:0:87721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304694.506063:0:87721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304694.506067:0:87721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304694.506075:0:87721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304694.506299:0:87721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304694.506310:0:87721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304694.506321:0:87721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fc00/0xefc0bb7231296c8d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304695.123320:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304695.449358:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304695.449365:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304695.449371:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304695.449412:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304695.449423:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304695.449436:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304695.449465:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785672192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304695.451337:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304695.451658:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789304695.451783:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785672192 00000100:00100000:1.0:1789304695.451794:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785672192 00000100:00100000:1.0:1789304695.451858:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1789304695.451868:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785672192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304695.451884:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304695.451901:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231296c9b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296c94 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304695.452238:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231296c9b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296c94 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304695.452251:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231296c9b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c94 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304695.452260:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370a00, rc 0) 00000100:00100000:1.0:1789304695.452321:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785672192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 455us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304695.452329:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:2.0:1789304695.452738:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785672192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304695.452755:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304695.452766:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304695.452785:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304695.452791:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304695.452799:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304696.146381:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304696.594247:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785672320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304696.594319:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304696.594406:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785672320 00000100:00100000:2.0:1789304696.594416:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785672320 00000100:00100000:2.0:1789304696.594469:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1789304696.594479:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785672320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304696.594514:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304696.594570:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785672320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304696.594577:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1789304696.594678:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785672320:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304696.594753:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304696.673183:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304696.673218:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304696.673337:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765599360 00000100:00100000:1.0:1789304696.673345:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765599360 00000100:00100000:1.0:1789304696.673399:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1525 00000100:00100000:1.0:1789304696.673406:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765599360:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304696.673466:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765599360:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 61us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304696.673471:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1525 00000100:00080000:0.0:1789304696.673593:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304696.673677:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765599232 00000100:00100000:3.0:1789304696.673681:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765599232 00000100:00100000:3.0:1789304696.673710:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1220 00000100:00100000:3.0:1789304696.673726:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765599232:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304696.673801:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765599232:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 84us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304696.673808:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1220 00010000:00010000:3.0:1789304697.173162:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304697.619348:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304697.619369:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785672448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304697.619433:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304697.619497:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785672448 00000100:00100000:3.0:1789304697.619504:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785672448 00000100:00100000:3.0:1789304697.619552:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1789304697.619560:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785672448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304697.619591:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304697.619630:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785672448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304697.619637:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00080000:3.0:1789304697.619654:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304697.619687:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785672448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304698.200180:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304699.155147:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785672704:0@lo:400:kworker.0 00000100:00100000:1.0:1789304699.155402:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785672576:0@lo:400:kworker.0 00000100:00100000:1.0:1789304699.155539:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304699.155586:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785673088:0@lo:400:kworker.0 00000100:00100000:1.0:1789304699.155613:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304699.155652:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785672576 00000100:00100000:1.0:1789304699.155660:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785672576 00000100:00100000:1.0:1789304699.155715:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:1.0:1789304699.155724:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785672576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304699.155876:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785672960:0@lo:400:kworker.0 00000100:00100000:3.0:1789304699.155907:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304699.155932:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304699.155939:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785672832:0@lo:400:kworker.0 00000100:00100000:3.0:1789304699.155965:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304699.155995:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785673088 00000100:00100000:3.0:1789304699.155999:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785673088 00000100:00100000:3.0:1789304699.156034:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785672960 00000100:00100000:3.0:1789304699.156036:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785672960 00000100:00100000:3.0:1789304699.156059:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:3.0:1789304699.156064:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785673088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304699.156124:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785673088:12345-0@lo:400:kworker.0 Request processed in 60us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304699.156131:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:3.0:1789304699.156146:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:3.0:1789304699.156151:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785672960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304699.156511:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304699.156544:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785673216:0@lo:400:kworker.0 00000100:00100000:2.0:1789304699.156578:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304699.156648:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785672832 00000100:00100000:2.0:1789304699.156653:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785672832 00000100:00100000:2.0:1789304699.156706:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785673216 00000100:00100000:2.0:1789304699.156710:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785673216 00000100:00100000:2.0:1789304699.156739:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1789304699.157493:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785672576:12345-0@lo:400:kworker.0 Request processed in 1767us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304699.157503:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:1.0:1789304699.157541:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785672704 00000100:00100000:1.0:1789304699.157546:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785672704 00000100:00100000:1.0:1789304699.157578:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1789304699.157586:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785672704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304699.157643:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785672704:12345-0@lo:400:kworker.0 Request processed in 58us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304699.157649:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1789304699.157727:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785672576:0@lo:400:kworker.0 00000100:00100000:1.0:1789304699.157743:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785673088:0@lo:400:kworker.0 00000100:00100000:2.0:1789304699.158030:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785672832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304699.158076:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785672832:12345-0@lo:400:kworker.0 Request processed in 1330us (2109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304699.158083:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1789304699.158113:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1789304699.158121:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785673216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304699.158150:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785673216:12345-0@lo:400:kworker.0 Request processed in 30us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304699.158156:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1789304699.158496:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785672960:12345-0@lo:400:kworker.0 Request processed in 2343us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304699.158503:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00080000:3.0:1789304699.158532:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304699.158537:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304699.158539:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304699.159553:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785672832:0@lo:400:kworker.0 00000100:00100000:2.0:1789304699.159569:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785672960:0@lo:400:kworker.0 00000100:00100000:1.0:1789304699.159896:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785672704:0@lo:400:kworker.0 00000100:00100000:1.0:1789304699.159910:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785673216:0@lo:400:kworker.0 00010000:00010000:2.0:1789304699.223967:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304699.539022:0:88015:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda24ba810 20000000:00000080:2.0:1789304699.539041:0:88015:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c371f3800 uarg=0000000000000000 00010000:00010000:2.0:1789304699.539533:0:88015:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304699.539550:0:88015:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304699.539564:0:88015:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304699.539581:0:88015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304699.539600:0:88015:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231296c9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296c94 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304699.539609:0:88015:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304699.539648:0:88015:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231296c9b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296c94 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304699.539662:0:88015:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231296c9b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296c94 expref: 18 pid: 5846 timeout: 2299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304699.539676:0:88015:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88015:1876219785673344:0@lo:104: 00000100:00100000:2.0:1789304699.540202:0:88015:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304699.540264:0:88015:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c412a2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789304699.540331:0:52683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789304699.540346:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785673344 00000100:00100000:3.0:1789304699.540353:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785673344 00000100:00100000:3.0:1789304699.540406:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789304699.540417:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3846ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:88015:x1876219785673344:12345-0@lo:104: 00010000:00010000:3.0:1789304699.540438:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304699.540508:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304699.540514:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3846ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:88015:x1876219785673344:12345-0@lo:104: Request processed in 101us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304699.540521:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00010000:1.0:1789304699.540669:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304699.540677:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.540685:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304699.540700:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.540708:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304699.540715:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304699.540721:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304699.540815:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.540828:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789304699.540881:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785673472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304699.540914:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304699.540964:0:88015:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88015:1876219785673344:0@lo:104: 00010000:00010000:2.0:1789304699.540984:0:88015:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541035:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541043:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd200/0xefc0bb7231296c94 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296c9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541059:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304699.541060:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304699.541062:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304699.541267:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785673472 00000100:00100000:1.0:1789304699.541272:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785673472 00010000:00010000:1.0:1789304699.541293:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231296c9b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c94 expref: 19 pid: 5846 timeout: 2299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304699.541323:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789304699.541330:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785673472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304699.541341:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304699.541346:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231296c9b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296c94 expref: 19 pid: 5846 timeout: 2299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541357:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231296c9b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296c94 expref: 19 pid: 5846 timeout: 2299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541384:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231296c9b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296c94 expref: 19 pid: 5846 timeout: 2299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541396:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541409:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541423:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541430:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541438:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541444:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541450:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304699.541454:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541460:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541482:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304699.541492:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304699.541559:0:88015:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304699.541567:0:88015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304699.541571:0:88015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231296ca2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304699.541972:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785673472:12345-0@lo:103:ldlm_bl.0 Request processed in 642us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304699.541980:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789304699.542080:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785673472:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304700.244048:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304700.344406:0:88063:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe951d1e30 20000000:00000080:1.0:1789304700.344425:0:88063:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412e8800 uarg=0000000000000000 10000000:01000000:1.0:1789304700.344467:0:88063:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304700.344486:0:88063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.344501:0:88063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.344511:0:88063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.344518:0:88063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.344524:0:88063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.344530:0:88063:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.344536:0:88063:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304700.344540:0:88063:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.344548:0:88063:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.344560:0:88063:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.344567:0:88063:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.344577:0:88063:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371800/0xefc0bb7231296ca9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304700.754710:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304700.754718:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304700.754723:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304700.754769:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304700.754782:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304700.754798:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304700.754824:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785673600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304700.754889:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304700.754983:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789304700.762047:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785673600 00000100:00100000:1.0:1789304700.762062:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785673600 00000100:00100000:1.0:1789304700.762570:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1789304700.762581:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785673600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304700.762606:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304700.762626:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371600/0xefc0bb7231296cb7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296cb0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.762655:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371600/0xefc0bb7231296cb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296cb0 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.762667:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371600/0xefc0bb7231296cb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296cb0 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.762686:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371600, rc 0) 00000100:00100000:1.0:1789304700.762772:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785673600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (7882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304700.762780:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1789304700.762827:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785673600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304700.762847:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.762857:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304700.762885:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304700.762891:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304700.762899:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304701.266384:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304701.715636:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785673728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304701.715733:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304701.715851:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785673728 00000100:00100000:3.0:1789304701.715859:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785673728 00000100:00100000:3.0:1789304701.715931:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1789304701.715943:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785673728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304701.715980:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304701.716032:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785673728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304701.716039:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1789304701.716066:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785673728:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304701.716086:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304701.793898:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304701.793947:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304701.794049:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765599488 00000100:00100000:1.0:1789304701.794060:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765599488 00000100:00100000:1.0:1789304701.794162:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1223 00000100:00100000:1.0:1789304701.794173:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765599488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304701.794248:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765599488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 77us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304701.794256:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1223 00000100:00100000:3.0:1789304701.794346:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765599616 00000100:00100000:3.0:1789304701.794351:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765599616 00000100:00100000:3.0:1789304701.794396:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1529 00000100:00100000:3.0:1789304701.794405:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765599616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304701.794440:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765599616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304701.794447:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1529 00000100:00080000:0.0:1789304701.794540:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304702.294272:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304702.741216:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785673856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304702.741305:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304702.741753:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785673856 00000100:00100000:3.0:1789304702.741764:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785673856 00000100:00100000:3.0:1789304702.741842:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:3.0:1789304702.741854:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785673856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304702.741895:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304702.741963:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785673856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304702.741971:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:3.0:1789304702.742031:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785673856:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304702.742177:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304703.219718:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304703.219843:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765599744 00000100:00100000:1.0:1789304703.219854:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765599744 00000100:00100000:1.0:1789304703.219969:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 964 00000100:00100000:1.0:1789304703.219979:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:52161:x1876219765599744:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304703.220003:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304703.220032:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231296cbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610062e expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304703.220140:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296cc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304703.220168:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304703.220183:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304703.220223:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789304703.220228:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304703.220252:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304703.220277:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231296cbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610062e expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304703.220297:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610062e expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304703.220305:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:1.0:1789304703.220308:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304703.220313:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371c00, rc 0) 00000100:00100000:1.0:1789304703.220372:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52161:x1876219765599744:12345-192.168.202.29@tcp:101:rm.0 Request processed in 394us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304703.220380:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 964 00000100:00080000:0.0:1789304703.220742:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304703.223692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304703.223783:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765599872 00000100:00100000:3.0:1789304703.223794:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765599872 00000100:00100000:3.0:1789304703.223858:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 965 00000100:00100000:3.0:1789304703.223869:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:52161:x1876219765599872:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304703.223891:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304703.224037:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ccc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100635 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224142:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296cd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224157:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224168:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224246:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224255:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224263:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224478:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224486:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296cd3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224493:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224500:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304703.224504:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224512:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296cd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224761:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:3.0:1789304703.224765:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304703.224771:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296cd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224778:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296cd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224793:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224799:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224805:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224811:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304703.224813:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224819:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224826:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304703.224829:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304703.224831:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224837:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224868:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ccc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100635 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224878:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:3.0:1789304703.224881:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304703.224885:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ccc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100635 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.224895:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304703.225262:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:52161:x1876219765599872:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1393us (1578us total) trans 0 rc 301/301 00000100:00100000:3.0:1789304703.225270:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 965 00000100:00100000:2.0:1789304703.303647:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304703.303693:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304703.303877:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765600000 00000100:00100000:3.0:1789304703.303888:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765600000 00000100:00100000:3.0:1789304703.303956:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765600256 00000100:00100000:3.0:1789304703.303960:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765600256 00000100:00100000:3.0:1789304703.304001:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 966 00000100:00100000:3.0:1789304703.304012:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765600000:12345-192.168.202.29@tcp:41:mkdir.0 00000004:00000024:3.0:1789304703.304057:0:7654:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789304703.304165:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765600000:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 154us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304703.304172:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 966 00000100:00100000:3.0:1789304703.304192:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 967 00000100:00100000:3.0:1789304703.304198:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52165:x1876219765600256:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:3.0:1789304703.304238:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304703.304268:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296cc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610062e expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.304288:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:3.0:1789304703.304299:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304703.304516:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ce1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.304534:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.304545:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.304558:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.304564:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.304570:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304703.322080:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:3.0:1789304703.322580:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00010000:3.0:1789304703.322598:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.322609:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ce1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.322616:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.322621:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304703.322626:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.322634:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ce1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.322665:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304703.322669:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304703.322675:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ce1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.322681:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296ce1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304703.323614:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f30925a reply state 000000004378f9c7 transno 4294967669 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304703.323629:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304703.324274:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:52165:x1876219765600256:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 20068us (20573us total) trans 4294967669 rc 0/0 00000100:00100000:3.0:1789304703.324285:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 967 00010000:00010000:3.0:1789304703.327940:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.327956:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.327964:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.327971:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304703.327975:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.327988:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.328012:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304703.328015:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304703.328020:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.328027:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296ce8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304703.439507:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304703.439979:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765600384 00000100:00100000:3.0:1789304703.439999:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765600384 00000100:00100000:3.0:1789304703.440065:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 968 00000100:00100000:3.0:1789304703.440077:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:52169:x1876219765600384:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:3.0:1789304703.440146:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304703.440170:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610063c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.440241:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296cf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.440255:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.440266:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304703.440304:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789304703.440308:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304703.440330:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.440357:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296cef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610063c expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.440376:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610063c expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.440383:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304703.440386:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304703.440390:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304703.440444:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:52169:x1876219765600384:12345-192.168.202.29@tcp:101:chown.0 Request processed in 370us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304703.440452:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 968 00000100:00100000:2.0:1789304703.446407:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304703.446510:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765600512 00000100:00100000:0.0:1789304703.446520:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765600512 00000100:00100000:0.0:1789304703.446579:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 969 00000100:00100000:0.0:1789304703.446589:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:52169:x1876219765600512:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:0.0:1789304703.446625:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304703.446646:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100643 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.446947:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.446964:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.446977:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.446992:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447000:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447006:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447353:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447363:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447370:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304703.447403:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:0.0:1789304703.447408:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304703.447431:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447443:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447450:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447457:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447463:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304703.447467:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447476:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447487:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:0.0:1789304703.447490:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304703.447495:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447501:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447513:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447519:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447529:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447534:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304703.447537:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447543:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447550:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c0558de00) 00010000:00010000:0.0:1789304703.447553:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304703.447555:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447561:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447593:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100643 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447608:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100643 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.447615:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304703.447617:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304703.447620:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789304703.447918:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:52169:x1876219765600512:12345-192.168.202.29@tcp:101:chown.0 Request processed in 1329us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304703.447931:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 969 00000100:00100000:0.0:1789304703.453592:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304703.453894:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765600768 00000100:00100000:3.0:1789304703.453905:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765600768 00000100:00100000:3.0:1789304703.453997:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 970 00000100:00100000:3.0:1789304703.454008:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:52169:x1876219765600768:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:3.0:1789304703.454061:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304703.454131:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100643 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.454153:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:3.0:1789304703.454267:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304703.454295:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.454309:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304703.454319:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304703.454523:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f4bc62d reply state 00000000a529c763 transno 4294967670 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304703.454534:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304703.454542:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000100:00100000:3.0:1789304703.455012:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:52169:x1876219765600768:12345-192.168.202.29@tcp:36:chown.0 Request processed in 1004us (1427us total) trans 4294967670 rc 0/0 00000100:00100000:3.0:1789304703.455021:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 970 00010000:00010000:0.0:1789304703.462276:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.462295:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.462304:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.462311:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304703.462316:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.462324:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.462340:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:0.0:1789304703.462343:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304703.462348:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304703.462354:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296d19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789304704.179174:0:88258:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd58594580 20000000:00000080:0.0:1789304704.179195:0:88258:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36f24400 uarg=0000000000000000 00010000:00010000:0.0:1789304704.179422:0:88258:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789304704.179455:0:88258:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:0.0:1789304704.179460:0:88258:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304704.179471:0:88258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296cf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610063c expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304704.179492:0:88258:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789304704.179508:0:88258:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304704.179522:0:88258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304704.179614:0:88258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41371600/0xefc0bb7231296cb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296cb0 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304704.179625:0:88258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304704.179674:0:88258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41371600/0xefc0bb7231296cb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296cb0 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304704.179688:0:88258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41371600/0xefc0bb7231296cb7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296cb0 expref: 18 pid: 5846 timeout: 2303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304704.179834:0:88258:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88258:1876219785673984:0@lo:104: 00000100:00100000:0.0:1789304704.179906:0:88258:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304704.180086:0:88258:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789304704.180199:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785673984 00000100:00100000:2.0:1789304704.180206:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785673984 00000100:00100000:2.0:1789304704.180419:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789304704.180431:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:88258:x1876219785673984:12345-0@lo:104: 00010000:00010000:2.0:1789304704.180446:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304704.180552:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304704.180559:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:88258:x1876219785673984:12345-0@lo:104: Request processed in 130us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304704.180566:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:1.0:1789304704.180615:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304704.180623:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.180630:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304704.180635:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.180654:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304704.180661:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304704.180665:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304704.180712:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.180718:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304704.180739:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.180746:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd400/0xefc0bb7231296cb0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296cb7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.180762:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304704.180764:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304704.180765:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304704.180868:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785674112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304704.180906:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304704.180994:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785674112 00000100:00100000:1.0:1789304704.180998:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785674112 00010000:00010000:1.0:1789304704.181030:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41371600/0xefc0bb7231296cb7 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296cb0 expref: 19 pid: 5846 timeout: 2303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304704.181056:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789304704.181063:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785674112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304704.181075:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304704.181081:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41371600/0xefc0bb7231296cb7 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296cb0 expref: 19 pid: 5846 timeout: 2303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181111:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41371600/0xefc0bb7231296cb7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296cb0 expref: 19 pid: 5846 timeout: 2303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181125:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181133:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181147:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181155:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181162:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181169:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181174:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304704.181177:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181185:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181193:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304704.181203:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304704.181232:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785674112:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304704.181237:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1789304704.181320:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785674112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304704.183222:0:88258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371600/0xefc0bb7231296cb7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296cb0 expref: 18 pid: 5846 timeout: 2303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304704.183242:0:88258:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88258:1876219785673984:0@lo:104: 00010000:00010000:0.0:1789304704.183265:0:88258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304704.183280:0:88258:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304704.183288:0:88258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304704.183294:0:88258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231296d20 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304704.274839:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785674240:0@lo:400:kworker.0 00000100:00100000:0.0:1789304704.274910:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304704.274960:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785674752:0@lo:400:kworker.0 00000100:00100000:0.0:1789304704.274983:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304704.275008:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304704.275014:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785674368:0@lo:400:kworker.0 00000100:00100000:0.0:1789304704.275034:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304704.275066:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785674240 00000100:00100000:0.0:1789304704.275074:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785674240 00000100:00100000:0.0:1789304704.275143:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:0.0:1789304704.275152:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785674240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304704.275204:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785674240:12345-0@lo:400:kworker.0 Request processed in 53us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304704.275211:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:0.0:1789304704.275252:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785674240:0@lo:400:kworker.0 00000100:00100000:3.0:1789304704.275298:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785674496:0@lo:400:kworker.0 00000100:00100000:3.0:1789304704.275331:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304704.275369:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304704.275375:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785674624:0@lo:400:kworker.0 00000100:00100000:3.0:1789304704.275396:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304704.275616:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785674752 00000100:00100000:3.0:1789304704.275620:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785674752 00000100:00100000:3.0:1789304704.275668:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785674368 00000100:00100000:3.0:1789304704.275671:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785674368 00000100:00100000:3.0:1789304704.275706:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:3.0:1789304704.275713:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785674752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304704.275753:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785674752:12345-0@lo:400:kworker.0 Request processed in 41us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304704.275759:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:3.0:1789304704.275772:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1789304704.275778:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785674368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304704.275805:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785674368:12345-0@lo:400:kworker.0 Request processed in 27us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304704.275810:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1789304704.280013:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785674496 00000100:00100000:0.0:1789304704.280029:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785674496 00000100:00100000:0.0:1789304704.280121:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785674624 00000100:00100000:0.0:1789304704.280125:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785674624 00000100:00100000:0.0:1789304704.280156:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:0.0:1789304704.280167:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785674496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304704.280262:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785674496:12345-0@lo:400:kworker.0 Request processed in 97us (4929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304704.280269:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:0.0:1789304704.280285:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:0.0:1789304704.280291:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785674624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304704.280318:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785674624:12345-0@lo:400:kworker.0 Request processed in 28us (4921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304704.280323:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:2.0:1789304704.282518:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785674624:0@lo:400:kworker.0 00000100:00100000:2.0:1789304704.282540:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785674496:0@lo:400:kworker.0 00000100:00080000:2.0:1789304704.282593:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304704.282599:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304704.282602:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304704.282624:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785674368:0@lo:400:kworker.0 00000100:00100000:2.0:1789304704.282637:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785674752:0@lo:400:kworker.0 00010000:00010000:0.0:1789304704.344170:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304704.414425:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967670 is committed 00000020:00000080:0.0:1789304705.196025:0:88307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd710576c0 20000000:00000080:0.0:1789304705.196044:0:88307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02f31000 uarg=0000000000000000 10000000:01000000:0.0:1789304705.196166:0:88307:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304705.196188:0:88307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304705.196203:0:88307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304705.196213:0:88307:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304705.196221:0:88307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304705.196228:0:88307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304705.196239:0:88307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304705.196245:0:88307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304705.196250:0:88307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304705.196257:0:88307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304705.196270:0:88307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304705.196279:0:88307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304705.196285:0:88307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231296d27 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304705.363487:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304705.554220:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304705.554228:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304705.554234:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304705.554288:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304705.554302:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304705.554314:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304705.554335:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785674880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304705.554398:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304705.554458:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c04c22540 going to sleep for 11 seconds 00000100:00100000:2.0:1789304705.554539:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785674880 00000100:00100000:2.0:1789304705.554548:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785674880 00000100:00100000:2.0:1789304705.554674:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:2.0:1789304705.554699:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785674880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304705.554715:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304705.554730:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231296d35 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296d2e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304705.554755:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231296d35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296d2e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304705.554764:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231296d35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296d2e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304705.554772:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc200, rc 0) 00000100:00100000:2.0:1789304705.554818:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785674880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304705.554823:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1789304705.554894:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785674880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304705.554907:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304705.554913:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304705.554927:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304705.554930:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304705.554936:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304706.392608:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304706.836251:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304706.836273:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785675008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304706.836339:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304706.836503:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785675008 00000100:00100000:3.0:1789304706.836512:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785675008 00000100:00100000:3.0:1789304706.836573:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:3.0:1789304706.836582:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785675008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304706.836633:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304706.836690:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785675008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304706.836697:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:3.0:1789304706.836749:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785675008:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304706.836813:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304706.930083:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304706.930168:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304706.930245:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765601024 00000100:00100000:1.0:1789304706.930257:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765601024 00000100:00100000:1.0:1789304706.930328:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1533 00000100:00100000:1.0:1789304706.930338:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765601024:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304706.930419:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765601024:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304706.930427:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1533 00000100:00080000:0.0:1789304706.930482:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304706.932173:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765600896 00000100:00100000:3.0:1789304706.932188:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765600896 00000100:00100000:3.0:1789304706.932267:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1225 00000100:00100000:3.0:1789304706.932277:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765600896:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304706.932336:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765600896:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 61us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304706.932343:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1225 00010000:00010000:2.0:1789304707.414314:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304707.858393:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785675136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304707.858471:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304707.858891:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785675136 00000100:00100000:3.0:1789304707.858901:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785675136 00000100:00100000:3.0:1789304707.858972:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1789304707.858983:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785675136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304707.859019:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304707.859083:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785675136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304707.859114:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1789304707.859164:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785675136:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304707.859243:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304708.336034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304708.336185:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765601152 00000100:00100000:0.0:1789304708.336194:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765601152 00000100:00100000:0.0:1789304708.336259:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:0.0:1789304708.336270:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:5593:x1876219765601152:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789304708.336287:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304708.336289:0:5839:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231296cf6) 00010000:00010000:0.0:1789304708.336292:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304708.336345:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:5593:x1876219765601152:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 78us (321us total) trans 0 rc 116/116 00000100:00100000:0.0:1789304708.336350:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00080000:1.0:1789304708.336528:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304708.434544:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304709.400590:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785675264:0@lo:400:kworker.0 00000100:00100000:0.0:1789304709.400681:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304709.400748:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785675264 00000100:00100000:0.0:1789304709.400758:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785675264 00000100:00100000:0.0:1789304709.400804:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:0.0:1789304709.400814:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785675264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304709.400863:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785675264:12345-0@lo:400:kworker.0 Request processed in 51us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304709.400871:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:0.0:1789304709.401926:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785675264:0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.408283:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785675648:0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.408353:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304709.408395:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304709.408401:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785675776:0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.408424:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304709.408460:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785675392:0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.408481:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304709.408498:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785675904:0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.408518:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304709.408536:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304709.408541:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785675520:0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.408560:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304709.408835:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785675648 00000100:00100000:3.0:1789304709.408842:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785675648 00000100:00100000:3.0:1789304709.408896:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785675776 00000100:00100000:3.0:1789304709.408900:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785675776 00000100:00100000:3.0:1789304709.408920:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785675392 00000100:00100000:3.0:1789304709.408922:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785675392 00000100:00100000:3.0:1789304709.408936:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:3.0:1789304709.408944:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785675648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.408997:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785675648:12345-0@lo:400:kworker.0 Request processed in 53us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304709.409004:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00100000:3.0:1789304709.409020:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:3.0:1789304709.409026:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785675776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.409053:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785675776:12345-0@lo:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304709.409060:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00100000:3.0:1789304709.409071:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:3.0:1789304709.409077:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785675392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.409133:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785675392:12345-0@lo:400:kworker.0 Request processed in 56us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304709.409143:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:3.0:1789304709.409164:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785675904 00000100:00100000:3.0:1789304709.409168:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785675904 00000100:00100000:3.0:1789304709.409193:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785675520 00000100:00100000:3.0:1789304709.409195:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785675520 00000100:00100000:3.0:1789304709.409210:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1789304709.409216:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785675904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.409246:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785675904:12345-0@lo:400:kworker.0 Request processed in 30us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304709.409252:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1789304709.409262:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1789304709.409267:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785675520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.409291:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785675520:12345-0@lo:400:kworker.0 Request processed in 24us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304709.409297:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1789304709.409334:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785675520:0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.409344:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785675392:0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.409351:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785675904:0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.409393:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785675776:0@lo:400:kworker.0 00000100:00100000:3.0:1789304709.409402:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785675648:0@lo:400:kworker.0 00000100:00080000:1.0:1789304709.412135:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304709.412145:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304709.412149:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304709.460491:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304710.038943:0:88551:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd274aff70 20000000:00000080:0.0:1789304710.038961:0:88551:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02f32400 uarg=0000000000000000 00010000:00010000:0.0:1789304710.040039:0:88551:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304710.040058:0:88551:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304710.040074:0:88551:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304710.040278:0:88551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304710.040297:0:88551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231296d35 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296d2e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304710.040306:0:88551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304710.040349:0:88551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231296d35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296d2e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304710.040364:0:88551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231296d35 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296d2e expref: 18 pid: 5847 timeout: 2309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304710.040378:0:88551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88551:1876219785676032:0@lo:104: 00000100:00100000:0.0:1789304710.040579:0:88551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304710.040802:0:88551:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13d74540 going to sleep for 11 seconds 00000100:00100000:1.0:1789304710.040849:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785676032 00000100:00100000:1.0:1789304710.040858:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785676032 00000100:00100000:1.0:1789304710.040950:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789304710.040961:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:88551:x1876219785676032:12345-0@lo:104: 00010000:00010000:1.0:1789304710.040977:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304710.041046:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304710.041052:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:88551:x1876219785676032:12345-0@lo:104: Request processed in 94us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304710.041059:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:2.0:1789304710.041127:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304710.041135:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041142:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304710.041147:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041156:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304710.041163:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304710.041170:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304710.041204:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041212:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304710.041233:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041241:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41370800/0xefc0bb7231296d2e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296d35 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041257:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304710.041260:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304710.041261:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304710.041280:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785676160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304710.041313:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304710.041350:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785676160 00000100:00100000:2.0:1789304710.041354:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785676160 00010000:00010000:2.0:1789304710.041374:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231296d35 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296d2e expref: 19 pid: 5847 timeout: 2309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304710.041396:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789304710.041402:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785676160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304710.041413:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304710.041430:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231296d35 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296d2e expref: 19 pid: 5847 timeout: 2309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041440:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231296d35 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296d2e expref: 19 pid: 5847 timeout: 2309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041456:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041474:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041489:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041496:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041503:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041510:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041516:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304710.041520:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041527:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041537:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.041546:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304710.041576:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785676160:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304710.041583:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789304710.041631:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785676160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304710.041828:0:88551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231296d35 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296d2e expref: 18 pid: 5847 timeout: 2309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304710.041840:0:88551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88551:1876219785676032:0@lo:104: 00010000:00010000:0.0:1789304710.041858:0:88551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304710.041866:0:88551:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304710.041872:0:88551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304710.041878:0:88551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231296d3c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304710.482298:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304711.058235:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304711.058243:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304711.058250:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304711.058300:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304711.058314:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304711.058326:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304711.058354:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03688000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785676288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304711.058424:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304711.058481:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05a083c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304711.058906:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785676288 00000100:00100000:1.0:1789304711.058916:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785676288 00000100:00100000:1.0:1789304711.058976:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:1.0:1789304711.058986:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785676288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304711.059001:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304711.059016:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296d4a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296d43 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304711.059039:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296d4a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296d43 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304711.059050:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296d4a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296d43 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304711.059064:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370400, rc 0) 00000100:00100000:1.0:1789304711.059220:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785676288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304711.059227:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:2.0:1789304711.059811:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03688000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785676288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304711.059833:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304711.059844:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304711.059864:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304711.059869:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304711.059876:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304711.509951:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304711.960161:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304711.960186:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785676416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304711.960253:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304711.960323:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785676416 00000100:00100000:3.0:1789304711.960331:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785676416 00000100:00100000:3.0:1789304711.960380:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1789304711.960388:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785676416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304711.960423:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304711.960471:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785676416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304711.960478:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:3.0:1789304711.960525:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785676416:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304711.960635:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304712.039331:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304712.039373:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765601280 00000100:00100000:2.0:1789304712.039374:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304712.039385:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765601280 00000100:00100000:2.0:1789304712.039400:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765601408 00000100:00100000:2.0:1789304712.039404:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765601408 00000100:00100000:0.0:1789304712.039441:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1228 00000100:00100000:2.0:1789304712.039447:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1537 00000100:00100000:0.0:1789304712.039451:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765601280:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304712.039453:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765601408:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304712.039534:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765601280:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304712.039543:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1228 00000100:00080000:1.0:1789304712.039880:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304712.045927:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765601408:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 6462us (6540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304712.045941:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1537 00010000:00010000:2.0:1789304712.530356:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304712.979606:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785676544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304712.979692:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304712.983013:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785676544 00000100:00100000:2.0:1789304712.983033:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785676544 00000100:00100000:2.0:1789304712.983191:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:2.0:1789304712.983203:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785676544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304712.983241:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304712.983385:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304712.985448:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304712.985583:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785676544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2381us (5888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304712.985596:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1789304712.986907:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785676544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304712.986957:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765601536 00000100:00100000:3.0:1789304712.986966:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765601536 00000100:00100000:3.0:1789304712.987030:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 971 00000100:00100000:3.0:1789304712.987040:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:52347:x1876219765601536:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304712.987061:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304712.987086:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296d51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610064a expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304712.987187:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296d58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304712.987203:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304712.987217:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304712.987257:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789304712.987262:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304712.987832:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304712.987861:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296d51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610064a expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304712.987879:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296d58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610064a expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304712.987888:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304712.987891:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304712.987894:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f000, rc 0) 00000100:00100000:3.0:1789304712.987962:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:52347:x1876219765601536:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 924us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304712.987969:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 971 00000100:00100000:0.0:1789304712.993803:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304712.994079:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765601664 00000100:00100000:0.0:1789304712.994110:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765601664 00000100:00100000:0.0:1789304712.994166:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 972 00000100:00100000:0.0:1789304712.994177:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:52347:x1876219765601664:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304712.994196:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304712.994218:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296d5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100651 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.994286:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.994300:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.994311:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.994325:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.994332:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.994338:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996186:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296d74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996211:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996222:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304712.996264:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:0.0:1789304712.996449:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304712.996479:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996493:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996500:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996508:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996513:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304712.996517:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996524:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996536:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:0.0:1789304712.996540:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304712.996545:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996551:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296d66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996574:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996580:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996586:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996591:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304712.996594:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996600:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996607:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c0558da00) 00010000:00010000:0.0:1789304712.996610:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304712.996613:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996618:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296d6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996661:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296d5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100651 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996681:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100651 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304712.996687:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:0.0:1789304712.996689:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304712.996692:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb400, rc 0) 00000100:00100000:0.0:1789304712.996784:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:52347:x1876219765601664:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 2609us (2993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304712.996793:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 972 00000100:00100000:1.0:1789304713.009348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304713.009415:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765601920 00000100:00100000:1.0:1789304713.009425:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765601920 00000100:00100000:1.0:1789304713.009475:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 973 00000100:00100000:1.0:1789304713.009484:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:52347:x1876219765601920:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789304713.009535:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304713.009578:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296d74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100651 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304713.009599:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:1.0:1789304713.010715:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304713.010755:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304713.010774:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304713.010786:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304713.066631:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebba309e reply state 00000000e3569cf5 transno 4294967671 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304713.066650:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304713.066665:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000100:00100000:3.0:1789304713.066770:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:52347:x1876219765601920:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 57282us (57429us total) trans 4294967671 rc 0/0 00000100:00100000:3.0:1789304713.066779:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 973 00000001:00080000:3.0:1789304713.066831:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967671 is committed 00010000:00010000:3.0:1789304713.066848:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304713.066857:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304713.066865:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304713.066872:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304713.066877:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304713.066885:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304713.066899:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:3.0:1789304713.066902:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304713.066907:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304713.066913:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296d7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304713.559184:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304713.998541:0:88748:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff78dc0b70 20000000:00000080:1.0:1789304713.999294:0:88748:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412e8000 uarg=0000000000000000 00010000:00010000:1.0:1789304713.999858:0:88748:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304714.000306:0:88748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:1.0:1789304714.000312:0:88748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304714.000323:0:88748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296d58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610064a expref: 5 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.000350:0:88748:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304714.000369:0:88748:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304714.000385:0:88748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.000398:0:88748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296d4a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296d43 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.000406:0:88748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.000445:0:88748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296d4a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296d43 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.000460:0:88748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296d4a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296d43 expref: 18 pid: 5846 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304714.000475:0:88748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88748:1876219785676672:0@lo:104: 00000100:00100000:1.0:1789304714.000562:0:88748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304714.000620:0:88748:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd7840 going to sleep for 11 seconds 00000100:00100000:2.0:1789304714.000723:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785676672 00000100:00100000:2.0:1789304714.000731:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785676672 00000100:00100000:2.0:1789304714.000789:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789304714.000799:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:88748:x1876219785676672:12345-0@lo:104: 00010000:00010000:2.0:1789304714.000812:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304714.000879:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304714.000886:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:88748:x1876219785676672:12345-0@lo:104: Request processed in 89us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304714.000892:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:0.0:1789304714.000936:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304714.000943:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304714.000950:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304714.000954:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304714.000963:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304714.000971:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304714.000976:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304714.001010:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304714.001017:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304714.001051:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304714.001058:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb7231296d43 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296d4a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304714.001072:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304714.001073:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785676800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304714.001074:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304714.001076:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304714.001124:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304714.001286:0:88748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88748:1876219785676672:0@lo:104: 00010000:00010000:1.0:1789304714.001305:0:88748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304714.003701:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785676800 00000100:00100000:0.0:1789304714.003716:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785676800 00010000:00010000:1.0:1789304714.003835:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296d4a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296d43 expref: 19 pid: 5846 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304714.004014:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789304714.004025:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785676800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304714.004040:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304714.004045:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296d4a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296d43 expref: 19 pid: 5846 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.004056:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296d4a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296d43 expref: 19 pid: 5846 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.004073:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370400/0xefc0bb7231296d4a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296d43 expref: 19 pid: 5846 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.004088:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.004413:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.004432:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.004438:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.004449:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.004455:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.004461:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304714.004464:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.004473:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304714.004729:0:88748:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304714.004739:0:88748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.005762:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.005773:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231296d82 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304714.005791:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304714.005879:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785676800:12345-0@lo:103:ldlm_bl.0 Request processed in 1853us (4752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304714.005888:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789304714.005982:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785676800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304714.515252:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785676928:0@lo:400:kworker.0 00000100:00100000:3.0:1789304714.515258:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785677312:0@lo:400:kworker.0 00000100:00100000:3.0:1789304714.519114:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304714.519223:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785677056:0@lo:400:kworker.0 00000100:00100000:1.0:1789304714.519224:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785677312 00000100:00100000:1.0:1789304714.519233:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785677312 00000100:00100000:3.0:1789304714.519262:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304714.519285:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785677056 00000100:00100000:3.0:1789304714.519287:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785677568:0@lo:400:kworker.0 00000100:00100000:1.0:1789304714.519289:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785677056 00000100:00100000:1.0:1789304714.519310:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:1.0:1789304714.519318:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785677312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304714.519324:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304714.519343:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304714.519349:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785677184:0@lo:400:kworker.0 00000100:00100000:3.0:1789304714.519367:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304714.519375:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785677312:12345-0@lo:400:kworker.0 Request processed in 58us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304714.519383:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00100000:3.0:1789304714.519396:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:3.0:1789304714.519404:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785677056:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789304714.519416:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304714.519436:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785677056:12345-0@lo:400:kworker.0 Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304714.519442:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:3.0:1789304714.519460:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785677568 00000100:00100000:3.0:1789304714.519464:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785677568 00000100:00100000:3.0:1789304714.519501:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785677184 00000100:00100000:2.0:1789304714.519503:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304714.519504:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785677184 00000100:00100000:3.0:1789304714.519522:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00080000:1.0:1789304714.519567:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304714.519570:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304714.519881:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785677440:0@lo:400:kworker.0 00000100:00100000:2.0:1789304714.519912:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304714.519984:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1789304714.519993:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785677184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304714.520025:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785677184:12345-0@lo:400:kworker.0 Request processed in 34us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304714.520032:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:2.0:1789304714.520054:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785676928 00000100:00100000:2.0:1789304714.520057:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785676928 00000100:00100000:2.0:1789304714.520083:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1789304714.520105:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785676928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304714.520140:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785676928:12345-0@lo:400:kworker.0 Request processed in 51us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304714.520146:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1789304714.520204:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785676928:0@lo:400:kworker.0 00000100:00100000:3.0:1789304714.522789:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785677568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304714.522900:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785677568:12345-0@lo:400:kworker.0 Request processed in 3368us (3570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304714.522910:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:3.0:1789304714.522983:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785677184:0@lo:400:kworker.0 00000100:00100000:3.0:1789304714.522996:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785677056:0@lo:400:kworker.0 00000100:00100000:3.0:1789304714.523006:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785677568:0@lo:400:kworker.0 00000100:00100000:3.0:1789304714.523042:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785677312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304714.523792:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785677440 00000100:00100000:1.0:1789304714.523816:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785677440 00000100:00100000:0.0:1789304714.524020:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1789304714.524031:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785677440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304714.524110:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785677440:12345-0@lo:400:kworker.0 Request processed in 81us (4198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304714.524116:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1789304714.524149:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785677440:0@lo:400:kworker.0 00000100:00080000:1.0:1789304714.524645:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304714.578991:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304715.603815:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304715.666532:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304715.666550:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304715.666556:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304715.666622:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304715.666634:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304715.666652:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304715.666680:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785677696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304715.666751:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304715.666827:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c012549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304715.666915:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785677696 00000100:00100000:1.0:1789304715.666923:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785677696 00000100:00100000:1.0:1789304715.666983:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1789304715.666993:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785677696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304715.667007:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304715.667021:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231296d90 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296d89 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304715.667045:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231296d90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296d89 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304715.667055:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231296d90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296d89 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304715.667064:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371a00, rc 0) 00000100:00100000:1.0:1789304715.667370:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785677696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 377us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304715.667377:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1789304715.667552:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785677696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304715.667572:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304715.667583:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304715.667672:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304715.667678:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304715.667686:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304716.629846:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304717.085345:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304717.085366:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785677824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304717.085434:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304717.085498:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785677824 00000100:00100000:0.0:1789304717.085505:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785677824 00000100:00100000:0.0:1789304717.085570:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1789304717.085580:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785677824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304717.085633:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304717.085681:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785677824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304717.085688:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00080000:0.0:1789304717.085712:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304717.085747:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785677824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304717.140117:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304717.140588:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765602048 00000100:00100000:0.0:1789304717.140601:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765602048 00000100:00100000:0.0:1789304717.140689:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 974 00000100:00100000:0.0:1789304717.140702:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:52424:x1876219765602048:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789304717.140729:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304717.140752:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296d97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100658 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.140833:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296d9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.140849:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296d9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.140860:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296d9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.140870:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296da5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.140874:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.140878:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141157:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296dac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141169:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141176:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304717.141199:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:0.0:1789304717.141204:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304717.141224:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141237:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296d9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141244:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296d9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141250:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296d9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141256:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304717.141261:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296d9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141269:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296d9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141280:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:0.0:1789304717.141283:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304717.141288:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296d9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141298:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231296d9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141309:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141315:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296da5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141321:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296da5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141327:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304717.141330:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296da5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141336:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296da5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141342:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c0558d300) 00010000:00010000:0.0:1789304717.141345:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304717.141347:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296da5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141353:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231296da5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141383:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231296d97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100658 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141399:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100658 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.141408:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:0.0:1789304717.141410:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304717.141413:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afac00, rc 0) 00000100:00100000:0.0:1789304717.141468:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:52424:x1876219765602048:12345-192.168.202.29@tcp:101:touch.0 Request processed in 769us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304717.141476:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 974 00000100:00080000:1.0:1789304717.142330:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304717.147544:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304717.147870:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765602304 00000100:00100000:3.0:1789304717.147881:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765602304 00000100:00100000:3.0:1789304717.147941:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 975 00000100:00100000:3.0:1789304717.147953:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:52424:x1876219765602304:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304717.147975:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304717.147998:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231296db3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610065f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.148842:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296dba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.148861:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.148874:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.148890:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.148898:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.148904:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304717.150032:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f:0x0], index 0: 0 00010000:00010000:3.0:1789304717.150664:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296dc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150678:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150688:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150727:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150746:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296dba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150753:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150760:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304717.150765:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150772:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296dba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150797:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:3.0:1789304717.150800:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304717.150805:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296dba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150812:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296dba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304717.150827:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e18f27ee reply state 000000001fd0487a transno 4294967672 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304717.150836:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304717.150870:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231296db3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610065f expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150884:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610065f expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.150892:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304717.150894:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304717.150897:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304717.150975:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:52424:x1876219765602304:12345-192.168.202.29@tcp:101:touch.0 Request processed in 3024us (3450us total) trans 4294967672 rc 0/0 00000100:00100000:3.0:1789304717.150984:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 975 00010000:00010000:0.0:1789304717.152562:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.152588:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.152596:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.152603:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304717.152607:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.152796:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.152812:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c2ea19b00) 00010000:00010000:0.0:1789304717.152815:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304717.152819:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.152825:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231296dc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304717.153496:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304717.153609:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765602432 00000100:00100000:2.0:1789304717.153629:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765602432 00000100:00100000:2.0:1789304717.153682:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1231 00000100:00100000:2.0:1789304717.153692:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765602432:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304717.153766:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765602432:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304717.153774:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1231 00000100:00100000:3.0:1789304717.160748:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304717.161217:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765602688 00000100:00100000:1.0:1789304717.161229:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765602688 00000100:00100000:1.0:1789304717.161378:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 976 00000100:00100000:1.0:1789304717.161390:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:52424:x1876219765602688:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:1.0:1789304717.161449:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304717.161476:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231296dc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610065f expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.161501:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:1.0:1789304717.161512:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304717.161625:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.161642:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.161653:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304717.161788:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003be5cfc reply state 00000000e2cee02b transno 4294967673 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304717.161797:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304717.161944:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:52424:x1876219765602688:12345-192.168.202.29@tcp:36:touch.0 Request processed in 556us (1205us total) trans 4294967673 rc 0/0 00000100:00100000:1.0:1789304717.161952:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 976 00010000:00010000:3.0:1789304717.163425:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.163438:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.163445:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.163451:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304717.163455:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.163463:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.163476:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:3.0:1789304717.163479:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304717.163483:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.163489:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231296dd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304717.166903:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304717.167676:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765602816 00000100:00100000:2.0:1789304717.167686:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765602816 00000100:00100000:2.0:1789304717.167778:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 977 00000100:00100000:2.0:1789304717.167789:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:52424:x1876219765602816:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789304717.167814:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304717.167837:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296ddd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100666 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304717.167897:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296ddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100666 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304717.167912:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296ddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100666 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304717.167933:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789304717.167936:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789304717.167940:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd800, rc 0) 00000100:00100000:2.0:1789304717.168006:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:52424:x1876219765602816:12345-192.168.202.29@tcp:101:touch.0 Request processed in 219us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304717.168013:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 977 00000100:00100000:0.0:1789304717.170040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304717.170177:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765602944 00000100:00100000:2.0:1789304717.170187:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765602944 00000100:00100000:2.0:1789304717.170229:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 527 00000100:00100000:2.0:1789304717.170236:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876219765602944:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:2.0:1789304717.170264:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 2166 last 0 00000020:00000080:2.0:1789304717.170300:0:6691:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231296de4 00002000:00100000:2.0:1789304717.170313:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b02ecc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789304717.170351:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789304717.174823:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789304717.174874:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2b02ec9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789304717.174961:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765602944:12345-192.168.202.29@tcp:8:touch.0 Request processed in 4722us (4926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304717.174973:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 527 00000100:00100000:1.0:1789304717.186506:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304717.186594:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765603072 00000100:00100000:3.0:1789304717.186606:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765603072 00000100:00100000:3.0:1789304717.186690:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 528 00000100:00100000:3.0:1789304717.186702:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765603072:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:1.0:1789304717.187726:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1789304717.238026:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00080000:2.0:1789304717.238044:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00000100:00100000:3.0:1789304717.238230:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:0:x1876219765603072:12345-192.168.202.29@tcp:2:touch.0 Request processed in 51525us (51730us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1789304717.238241:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 528 00000100:00100000:3.0:1789304717.240494:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304717.240593:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765603328 00000100:00100000:1.0:1789304717.240603:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765603328 00000100:00100000:1.0:1789304717.240664:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 100 00000100:00100000:1.0:1789304717.240674:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:52424:x1876219765603328:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:1.0:1789304717.241015:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:52424:x1876219765603328:12345-192.168.202.29@tcp:35:touch.0 Request processed in 342us (527us total) trans 4294967674 rc 0/0 00000100:00100000:1.0:1789304717.241024:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 100 00000100:00100000:2.0:1789304717.313590:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304717.313682:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765603456 00000100:00100000:3.0:1789304717.313694:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765603456 00000100:00100000:3.0:1789304717.313819:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 978 00000100:00100000:3.0:1789304717.313830:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:52428:x1876219765603456:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304717.313867:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304717.313891:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231296deb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610066d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.313970:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296df2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.313986:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296df2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.313998:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296df2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314025:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314033:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314039:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314180:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296e00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314189:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314196:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304717.314227:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x50:0x0]: returning size 0 00000004:00200000:3.0:1789304717.314231:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304717.314249:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314260:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296e00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314268:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296df2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314274:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296df2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314621:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314629:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304717.314633:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314641:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296df2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314716:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:3.0:1789304717.314719:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304717.314724:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296df2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314730:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314749:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314756:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296df9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314762:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314768:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304717.314771:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.314777:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296df9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.315483:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304717.315486:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304717.315490:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296df9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.315498:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231296df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.315553:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231296deb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610066d expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.315568:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296e00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610066d expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.315581:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:3.0:1789304717.315583:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304717.315587:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789304717.316394:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:52428:x1876219765603456:12345-192.168.202.29@tcp:101:rm.0 Request processed in 2561us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304717.316403:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 978 00000100:00100000:2.0:1789304717.323237:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304717.323548:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765603584 00000100:00100000:0.0:1789304717.323559:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765603584 00000100:00100000:0.0:1789304717.323630:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 529 00000100:00100000:0.0:1789304717.323641:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765603584:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304717.323668:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304717.323689:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231296e07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100674 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304717.323721:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x6aa69f8d, atime: 0x6aa69f8d, ctime: 0x6aa69f8d, blocks: 0x1 00010000:00010000:0.0:1789304717.323743:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=2167s v=(0 0) 00010000:00010000:0.0:1789304717.323748:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304717.323758:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231296e07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100674 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.323777:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231296e07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100674 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.323802:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afba00, rc 0) 00000100:00100000:0.0:1789304717.323871:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765603584:12345-192.168.202.29@tcp:101:rm.0 Request processed in 231us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304717.323878:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 529 00000100:00100000:2.0:1789304717.336234:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304717.336508:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765603840 00000100:00100000:1.0:1789304717.336519:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765603840 00000100:00100000:1.0:1789304717.336637:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 979 00000100:00100000:1.0:1789304717.336649:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:52428:x1876219765603840:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:1.0:1789304717.336706:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304717.336738:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231296e00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610066d expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.336764:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231296ddd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100666 expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.336775:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:1.0:1789304717.336792:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304717.336811:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296e0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.336821:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.336831:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.336841:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.336845:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.336849:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.336950:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296e1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.336956:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296e1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.336960:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296e1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789304717.337495:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].31, 64 off10176 00000004:00080000:1.0:1789304717.337504:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2167015413325ns, next at 2168015411258ns, rc = 0 00010000:00010000:1.0:1789304717.337576:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337587:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337595:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337612:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337619:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337626:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337652:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304717.337673:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296e1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337679:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296e1c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337686:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296e1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337692:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304717.337696:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296e1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337704:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296e1c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337713:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff9e2c14addf00) 00010000:00010000:1.0:1789304717.337716:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789304717.337720:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296e1c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337731:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296e1c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337747:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296e0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337753:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296e0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337759:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296e0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337765:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304717.337767:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296e0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337774:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296e0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337782:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:1.0:1789304717.337784:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304717.337787:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296e0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304717.337793:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231296e0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304717.337803:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009ca90f1 reply state 00000000203a5368 transno 4294967675 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304717.337813:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304717.337892:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:52428:x1876219765603840:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1244us (1667us total) trans 4294967675 rc 0/0 00000100:00100000:1.0:1789304717.337901:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 979 00010000:00010000:3.0:1789304717.338169:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304717.338176:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.338183:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304717.338186:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.338193:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.338202:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff9e2c14addf00) 00010000:00010000:3.0:1789304717.338205:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304717.338208:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.338213:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231296e23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304717.338227:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304717.338229:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304717.338231:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304717.344744:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.344763:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.344772:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.344779:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371c00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304717.344783:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.344792:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.344810:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c14adde00) 00010000:00010000:0.0:1789304717.344813:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304717.344817:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304717.344823:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231296e15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304717.651696:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304718.098419:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785677952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304718.098497:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304718.098763:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785677952 00000100:00100000:1.0:1789304718.098771:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785677952 00000100:00100000:1.0:1789304718.098844:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1789304718.098854:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785677952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304718.098877:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789304718.098950:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304718.101055:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785677952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2193us (2549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304718.101070:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1789304718.101477:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785677952:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789304718.165301:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967675 is committed 00000004:00080000:3.0:1789304718.165312:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 80 committed 00000100:00100000:1.0:1789304718.166121:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785678080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789304718.166188:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304718.166983:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785678080 00000100:00100000:0.0:1789304718.166993:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785678080 00000100:00100000:0.0:1789304718.167050:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1789304718.167061:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785678080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789304718.167104:0:17212:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:31 count 1 00010000:00010000:0.0:1789304718.167130:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304718.167937:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231296e07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100674 expref: 5 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304718.167953:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304718.167957:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304718.167962:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304718.167997:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231296e07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100674 expref: 5 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304718.168013:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231296e07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100674 expref: 5 pid: 6691 timeout: 2267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304718.168028:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785678208:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304718.179313:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c11baf840 going to sleep for 11 seconds 00000100:00100000:1.0:1789304718.183040:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304718.183143:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785678208:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789304718.183173:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304718.186715:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765603968 00000100:00100000:3.0:1789304718.186729:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765603968 00010000:00010000:3.0:1789304718.187302:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231296e07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100674 expref: 6 pid: 6691 timeout: 2267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304718.187417:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 403 00000100:00100000:3.0:1789304718.187426:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765603968:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789304718.187439:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304718.187444:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231296e07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100674 expref: 6 pid: 6691 timeout: 2267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304718.187456:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231296e07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100674 expref: 6 pid: 6691 timeout: 2267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304718.187474:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb7231296e07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100674 expref: 6 pid: 6691 timeout: 2267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304718.187486:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304718.187489:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304718.187493:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304718.187504:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304718.187541:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304718.187982:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765603968:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 555us (4954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304718.187990:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 403 00010000:00010000:2.0:1789304718.190712:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304718.190731:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304718.190743:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304718.190752:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304718.190783:0:17212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789304718.192059:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785678080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24995us (25865us total) trans 4294967359 rc 0/0 00000100:00100000:2.0:1789304718.192071:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00010000:00010000:2.0:1789304718.192165:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304718.192174:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304718.192186:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304718.192191:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304718.192202:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304718.192222:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304718.192229:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000505e9677/0xefc0bb7231296e2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304718.192249:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304718.192251:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304718.192253:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304718.192623:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c36e84700/2, rc 0, transno 4294967359 00000100:00100000:0.0:1789304718.192631:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785678080:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789304718.675269:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304719.421986:0:88995:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd2860af0 20000000:00000080:0.0:1789304719.422006:0:88995:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02071c00 uarg=0000000000000000 00010000:00010000:0.0:1789304719.425450:0:88995:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789304719.425498:0:88995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:0.0:1789304719.425514:0:88995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304719.425526:0:88995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231296dac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100658 expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304719.425725:0:88995:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789304719.425748:0:88995:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304719.425765:0:88995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304719.425780:0:88995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231296d90 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296d89 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304719.425788:0:88995:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304719.425829:0:88995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231296d90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296d89 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304719.425920:0:88995:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231296d90 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296d89 expref: 18 pid: 5846 timeout: 2319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304719.425937:0:88995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88995:1876219785678336:0@lo:104: 00000100:00100000:0.0:1789304719.426008:0:88995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304719.426069:0:88995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c18373d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789304719.426769:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785678336 00000100:00100000:2.0:1789304719.426781:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785678336 00000100:00100000:2.0:1789304719.426849:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789304719.426860:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:88995:x1876219785678336:12345-0@lo:104: 00010000:00010000:2.0:1789304719.426875:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.426948:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304719.426955:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:88995:x1876219785678336:12345-0@lo:104: Request processed in 98us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304719.426962:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00010000:2.0:1789304719.426984:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304719.426992:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.427001:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304719.427005:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.427015:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304719.427022:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304719.427028:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304719.427061:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.427068:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304719.427112:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.427120:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecce00/0xefc0bb7231296d89 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296d90 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.427136:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304719.427137:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304719.427139:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304719.427158:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785678464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304719.427190:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304719.427231:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785678464 00000100:00100000:2.0:1789304719.427235:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785678464 00010000:00010000:2.0:1789304719.427252:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231296d90 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296d89 expref: 19 pid: 5846 timeout: 2319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304719.427913:0:88995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88995:1876219785678336:0@lo:104: 00010000:00010000:0.0:1789304719.427937:0:88995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304719.429964:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1789304719.429984:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785678464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304719.430004:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304719.430014:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231296d90 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296d89 expref: 19 pid: 5846 timeout: 2319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430029:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231296d90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296d89 expref: 19 pid: 5846 timeout: 2319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430048:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231296d90 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296d89 expref: 19 pid: 5846 timeout: 2319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430065:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430075:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430200:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430208:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430216:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430223:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430229:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304719.430233:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430246:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430264:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304719.430273:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304719.430376:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785678464:12345-0@lo:103:ldlm_bl.0 Request processed in 402us (3185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304719.430383:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00010000:00010000:0.0:1789304719.430434:0:88995:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304719.430443:0:88995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304719.430449:0:88995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231296e31 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304719.438382:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785678464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304719.636238:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785678976:0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.636307:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304719.636369:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789304719.636376:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785678592:0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.636398:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304719.636415:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785679104:0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.636437:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304719.636463:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785678720:0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.636485:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304719.636516:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304719.636520:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785678848:0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.636541:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304719.636652:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785678976 00000100:00100000:1.0:1789304719.636660:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785678976 00000100:00100000:1.0:1789304719.636715:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:1.0:1789304719.636725:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785678976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.636774:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785678976:12345-0@lo:400:kworker.0 Request processed in 52us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304719.636781:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:1.0:1789304719.636797:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785678592 00000100:00100000:1.0:1789304719.636800:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785678592 00000100:00100000:1.0:1789304719.636817:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785678848 00000100:00100000:1.0:1789304719.636819:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785678848 00000100:00100000:1.0:1789304719.636837:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:1.0:1789304719.636842:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785678592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.636872:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785678592:12345-0@lo:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304719.636878:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:1.0:1789304719.636890:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:1.0:1789304719.636896:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785678848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.636927:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785678848:12345-0@lo:400:kworker.0 Request processed in 32us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304719.636933:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:1.0:1789304719.636954:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785679104 00000100:00100000:1.0:1789304719.636957:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785679104 00000100:00100000:1.0:1789304719.636980:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785678720 00000100:00100000:1.0:1789304719.636982:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785678720 00000100:00100000:1.0:1789304719.637001:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1789304719.637007:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785679104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.637038:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785679104:12345-0@lo:400:kworker.0 Request processed in 31us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304719.637044:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1789304719.637056:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1789304719.637062:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785678720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.637110:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785678720:12345-0@lo:400:kworker.0 Request processed in 26us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304719.637117:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00080000:1.0:1789304719.637134:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304719.637138:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304719.637167:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785678592:0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.637178:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785679104:0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.637186:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785678976:0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.637218:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785678848:0@lo:400:kworker.0 00000100:00100000:1.0:1789304719.637228:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785678720:0@lo:400:kworker.0 00010000:00010000:3.0:1789304719.702019:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304720.595174:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304720.595183:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304720.595190:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304720.595241:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304720.595254:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304720.595266:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304720.595291:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785679232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304720.595365:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304720.595418:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789304720.595511:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785679232 00000100:00100000:3.0:1789304720.595519:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785679232 00000100:00100000:3.0:1789304720.595574:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:3.0:1789304720.595584:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785679232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304720.595598:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304720.595613:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ea00/0xefc0bb7231296e3f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296e38 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304720.595639:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ea00/0xefc0bb7231296e3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296e38 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304720.595649:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860ea00/0xefc0bb7231296e3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296e38 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304720.595658:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ea00, rc 0) 00000100:00100000:3.0:1789304720.595704:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785679232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304720.595715:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1789304720.595847:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785679232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304720.595863:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304720.595871:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304720.595890:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304720.595894:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304720.595908:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304720.727429:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304721.746404:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304722.199556:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304722.199580:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785679360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304722.199647:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304722.199708:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785679360 00000100:00100000:2.0:1789304722.199716:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785679360 00000100:00080000:1.0:1789304722.199767:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304722.199776:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1789304722.199786:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785679360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304722.199820:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304722.199867:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785679360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304722.199873:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1789304722.199935:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785679360:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789304722.272487:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00000100:00100000:3.0:1789304722.273657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304722.273701:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304722.273824:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304722.273987:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765604224 00000100:00100000:3.0:1789304722.273999:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765604224 00000100:00100000:3.0:1789304722.274076:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1544 00000100:00100000:3.0:1789304722.274105:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765604224:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:1.0:1789304722.274133:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304722.274198:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765604224:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 112us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304722.274207:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1544 00000100:00100000:3.0:1789304722.274233:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765604096 00000100:00100000:3.0:1789304722.274237:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765604096 00000100:00100000:3.0:1789304722.274262:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1233 00000100:00100000:3.0:1789304722.274269:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765604096:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304722.274296:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765604096:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304722.274303:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1233 00000100:00100000:2.0:1789304722.281567:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765604352 00000100:00100000:2.0:1789304722.281584:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765604352 00000100:00100000:3.0:1789304722.281778:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1166 00000100:00100000:3.0:1789304722.281791:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765604352:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304722.281906:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765604352:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 118us (8081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304722.281914:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1166 00000100:00080000:2.0:1789304722.282122:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304722.770354:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304722.797774:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304722.797858:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765604480 00000100:00100000:1.0:1789304722.797868:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765604480 00000100:00100000:1.0:1789304722.797937:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 980 00000100:00100000:1.0:1789304722.797948:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:52517:x1876219765604480:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304722.797982:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304722.798008:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231296e46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610067b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304722.798076:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304722.798115:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304722.798129:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304722.798164:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:1.0:1789304722.798168:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304722.798187:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304722.798210:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231296e46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610067b expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304722.798236:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610067b expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304722.798243:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:1.0:1789304722.798246:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304722.798250:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370c00, rc 0) 00000100:00100000:1.0:1789304722.798312:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:52517:x1876219765604480:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 366us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304722.798319:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 980 00000100:00100000:0.0:1789304722.813730:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304722.813829:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765604736 00000100:00100000:3.0:1789304722.813839:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765604736 00000100:00100000:3.0:1789304722.813906:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 981 00000100:00100000:3.0:1789304722.813917:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:52517:x1876219765604736:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304722.813981:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304722.814008:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231296e4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610067b expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304722.814026:0:5852:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231296dac) 00010000:00010000:3.0:1789304722.814031:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:3.0:1789304722.814043:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304722.814070:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304722.814083:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304722.814117:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789304722.929211:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967676 is committed 00000004:00010000:3.0:1789304722.929394:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000732cf83 reply state 00000000fb46723f transno 4294967676 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304722.929408:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304722.929423:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00080000:3.0:1789304722.929531:0:5852:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304722.929549:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:52517:x1876219765604736:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 115630us (115826us total) trans 4294967676 rc 0/0 00000100:00100000:3.0:1789304722.929558:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 981 00010000:00010000:3.0:1789304722.929595:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304722.929603:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304722.929611:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304722.929629:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304722.929634:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304722.929641:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304722.929658:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304722.929661:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304722.929666:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304722.929674:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231296e54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304723.230359:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785679488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304723.230441:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304723.231986:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785679488 00000100:00100000:3.0:1789304723.231996:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785679488 00000100:00100000:3.0:1789304723.232077:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1789304723.232121:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785679488:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304723.232190:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789304723.232640:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304723.232730:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785679488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 644us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304723.232739:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1789304723.232902:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:3.0:1789304723.232910:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c36e84700, transno 4294967359 00000100:00100000:3.0:1789304723.232937:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785679488:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304723.794439:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304724.005997:0:89191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd70794ec0 20000000:00000080:1.0:1789304724.006016:0:89191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412ea800 uarg=0000000000000000 00010000:00010000:1.0:1789304724.006997:0:89191:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304724.007016:0:89191:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304724.007032:0:89191:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304724.007051:0:89191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304724.007069:0:89191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860ea00/0xefc0bb7231296e3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296e38 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304724.007077:0:89191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304724.007390:0:89191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860ea00/0xefc0bb7231296e3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296e38 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304724.007407:0:89191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860ea00/0xefc0bb7231296e3f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296e38 expref: 18 pid: 5847 timeout: 2323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304724.007424:0:89191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89191:1876219785679616:0@lo:104: 00000100:00100000:1.0:1789304724.007496:0:89191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304724.007655:0:89191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38835900 going to sleep for 11 seconds 00000100:00100000:2.0:1789304724.008439:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785679616 00000100:00100000:2.0:1789304724.008450:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785679616 00000100:00100000:3.0:1789304724.008745:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789304724.008756:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:89191:x1876219785679616:12345-0@lo:104: 00010000:00010000:3.0:1789304724.008860:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304724.008989:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304724.008996:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:89191:x1876219785679616:12345-0@lo:104: Request processed in 241us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304724.009003:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00010000:2.0:1789304724.009051:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304724.009059:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304724.009067:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304724.009071:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304724.009080:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304724.009189:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304724.009196:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304724.009244:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304724.009404:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789304724.009454:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789304724.009481:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304724.009488:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb7231296e38 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296e3f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304724.009515:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304724.009517:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304724.009518:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304724.009737:0:89191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89191:1876219785679616:0@lo:104: 00010000:00010000:1.0:1789304724.009761:0:89191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304724.009922:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785679744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304724.009967:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304724.010068:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785679744 00000100:00100000:0.0:1789304724.010074:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785679744 00010000:00010000:0.0:1789304724.010677:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860ea00/0xefc0bb7231296e3f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296e38 expref: 19 pid: 5847 timeout: 2323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304724.010750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1789304724.010760:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785679744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304724.010783:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304724.010789:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860ea00/0xefc0bb7231296e3f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296e38 expref: 19 pid: 5847 timeout: 2323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010802:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860ea00/0xefc0bb7231296e3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296e38 expref: 19 pid: 5847 timeout: 2323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010819:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ea00/0xefc0bb7231296e3f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296e38 expref: 19 pid: 5847 timeout: 2323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010833:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010847:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010862:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010870:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010876:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010882:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010888:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304724.010893:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010900:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010920:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304724.010930:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304724.010984:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785679744:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304724.010991:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789304724.011057:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785679744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304724.011229:0:89191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304724.011238:0:89191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304724.011244:0:89191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371400/0xefc0bb7231296e5b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304724.766376:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785679872:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.766478:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304724.766537:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785680384:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.766567:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304724.766598:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304724.766603:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785680256:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.766626:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304724.766657:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785680000:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.766684:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304724.766703:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785680512:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.766728:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304724.766748:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304724.766754:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785680128:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.766775:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304724.766812:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785679872 00000100:00100000:0.0:1789304724.766821:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785679872 00000100:00100000:0.0:1789304724.766867:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1789304724.766877:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785679872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.766932:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785679872:12345-0@lo:400:kworker.0 Request processed in 57us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304724.766939:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1789304724.766971:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785680384 00000100:00100000:0.0:1789304724.766976:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785680384 00000100:00100000:0.0:1789304724.767007:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785680256 00000100:00100000:0.0:1789304724.767009:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785680256 00000100:00100000:0.0:1789304724.767027:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785680000 00000100:00100000:0.0:1789304724.767030:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785680000 00000100:00100000:0.0:1789304724.767042:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:0.0:1789304724.767048:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785680384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.767079:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785680384:12345-0@lo:400:kworker.0 Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304724.767085:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:0.0:1789304724.767135:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:0.0:1789304724.767142:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785680256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.767170:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785680256:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304724.767176:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:0.0:1789304724.767188:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:0.0:1789304724.767193:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785680000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.767225:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785680000:12345-0@lo:400:kworker.0 Request processed in 31us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304724.767230:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:0.0:1789304724.767255:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785680512 00000100:00100000:0.0:1789304724.767259:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785680512 00000100:00100000:0.0:1789304724.767283:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785680128 00000100:00100000:0.0:1789304724.767285:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785680128 00000100:00100000:0.0:1789304724.767302:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1789304724.767308:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785680512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.767336:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785680512:12345-0@lo:400:kworker.0 Request processed in 28us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304724.767342:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1789304724.767353:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:0.0:1789304724.767358:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785680128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.767382:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785680128:12345-0@lo:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304724.767388:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00080000:0.0:1789304724.767411:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304724.767414:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304724.767464:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785680128:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.767476:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785680000:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.767485:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785680512:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.767516:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785680256:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.767524:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785679872:0@lo:400:kworker.0 00000100:00100000:0.0:1789304724.767535:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785680384:0@lo:400:kworker.0 00010000:00010000:1.0:1789304724.821127:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304725.083812:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304725.083821:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304725.083827:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304725.083873:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304725.083887:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304725.083900:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304725.083927:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785680640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304725.083994:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304725.084043:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304725.084078:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785680640 00000100:00100000:3.0:1789304725.084087:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785680640 00000100:00100000:3.0:1789304725.084160:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:3.0:1789304725.084169:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785680640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304725.084183:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304725.084196:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231296e69 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296e62 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304725.084219:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231296e69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296e62 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304725.084230:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231296e69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296e62 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304725.084239:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e000, rc 0) 00000100:00100000:3.0:1789304725.084276:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785680640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304725.084283:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:3.0:1789304725.084328:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785680640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304725.084344:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304725.084352:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304725.084372:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304725.084376:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304725.084389:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304725.842715:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304726.868009:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304726.893948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304726.893984:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765604864 00000100:00100000:0.0:1789304726.893994:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765604864 00000100:00100000:0.0:1789304726.894054:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 982 00000100:00100000:0.0:1789304726.894067:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:52594:x1876219765604864:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789304726.894108:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304726.894132:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296e70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100682 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894199:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296e77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894226:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894244:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894258:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296e7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894265:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894272:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894577:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296e85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894586:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894594:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304726.894615:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:0.0:1789304726.894619:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304726.894638:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894650:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894656:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296e77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894667:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296e77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894673:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304726.894677:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296e77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894685:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296e77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894695:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:0.0:1789304726.894699:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304726.894703:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296e77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894710:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296e77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894720:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894726:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296e7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894731:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296e7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894736:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304726.894739:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296e7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894748:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296e7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894756:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c0558d500) 00010000:00010000:0.0:1789304726.894758:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304726.894761:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296e7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894766:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296e7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894793:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296e70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100682 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894808:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100682 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.894815:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789304726.894817:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304726.894819:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789304726.894877:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:52594:x1876219765604864:12345-192.168.202.29@tcp:101:touch.0 Request processed in 813us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304726.894884:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 982 00000100:00080000:0.0:1789304726.894909:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304726.898347:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304726.899316:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765605120 00000100:00100000:3.0:1789304726.899327:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765605120 00000100:00100000:3.0:1789304726.899385:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 983 00000100:00100000:3.0:1789304726.899396:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52594:x1876219765605120:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304726.899417:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304726.899447:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296e8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100689 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899538:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296e93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899553:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296e93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899564:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296e93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899578:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296e9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899585:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296e9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899591:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296e9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304726.899608:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00010000:3.0:1789304726.899628:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296e93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899635:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296e93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899642:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296e93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899649:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304726.899654:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296e93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899662:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296e93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899673:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:3.0:1789304726.899676:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304726.899681:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296e93 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899688:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296e93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899702:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296e9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899708:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296e9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899718:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296e9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899723:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304726.899726:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296e9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899733:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296e9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899740:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c2ea19000) 00010000:00010000:3.0:1789304726.899742:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304726.899745:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296e9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899751:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296e9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899784:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296e8c lrc: 1/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100689 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899794:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:3.0:1789304726.899797:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304726.899800:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296e8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100689 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304726.899811:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304726.899871:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52594:x1876219765605120:12345-192.168.202.29@tcp:101:touch.0 Request processed in 476us (1534us total) trans 0 rc 301/301 00000100:00100000:3.0:1789304726.899882:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 983 00000100:00100000:3.0:1789304726.902055:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304726.902163:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765605248 00000100:00100000:1.0:1789304726.902171:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765605248 00000100:00100000:1.0:1789304726.902235:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 984 00000100:00100000:1.0:1789304726.902245:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:52594:x1876219765605248:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304726.902264:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304726.902283:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296ea1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100690 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902343:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296ea8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902358:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902369:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902383:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902389:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902396:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902415:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902422:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296ea8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902429:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902463:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304726.902467:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902475:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296ea8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902494:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:1.0:1789304726.902498:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304726.902503:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296ea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902509:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231296ea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902521:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902526:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296eaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902532:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902537:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304726.902540:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902546:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296eaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902552:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c14add000) 00010000:00010000:1.0:1789304726.902555:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304726.902558:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296eaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902563:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231296eaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902590:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296ea1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100690 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902601:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:1.0:1789304726.902603:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304726.902606:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231296ea1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100690 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304726.902615:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370600, rc 0) 00000100:00100000:1.0:1789304726.902669:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:52594:x1876219765605248:12345-192.168.202.29@tcp:101:touch.0 Request processed in 426us (622us total) trans 0 rc 301/301 00000100:00100000:1.0:1789304726.902676:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 984 00000100:00100000:3.0:1789304726.906147:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304726.906404:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765605376 00000100:00100000:0.0:1789304726.906415:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765605376 00000100:00100000:0.0:1789304726.906495:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 985 00000100:00100000:0.0:1789304726.906506:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:52594:x1876219765605376:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789304726.906527:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304726.906547:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296eb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100697 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906611:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296ebd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906625:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296ebd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906636:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296ebd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906650:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296ec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906657:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906663:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906684:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296ebd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906691:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296ebd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906698:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296ebd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906704:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304726.906709:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296ebd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906717:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296ebd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906728:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789304726.906731:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304726.906736:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296ebd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906742:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231296ebd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906752:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906759:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906764:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906769:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304726.906772:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906778:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906785:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c0558d900) 00010000:00010000:0.0:1789304726.906787:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304726.906790:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296ec4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906796:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231296ec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906826:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296eb6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100697 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906837:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789304726.906839:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304726.906842:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231296eb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100697 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304726.906850:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789304726.906907:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:52594:x1876219765605376:12345-192.168.202.29@tcp:101:touch.0 Request processed in 404us (769us total) trans 0 rc 301/301 00000100:00100000:0.0:1789304726.906914:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 985 00000100:00100000:2.0:1789304727.317125:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304727.317150:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785680768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304727.317231:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304727.317367:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785680768 00000100:00100000:2.0:1789304727.317376:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785680768 00000100:00100000:2.0:1789304727.317443:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:2.0:1789304727.317453:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785680768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304727.317605:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304727.317656:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785680768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 205us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304727.317760:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00080000:2.0:1789304727.317784:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304727.317822:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785680768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304727.393388:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304727.393441:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304727.393490:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304727.393523:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765605760 00000100:00100000:1.0:1789304727.393533:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765605760 00000100:00100000:1.0:1789304727.393591:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1169 00000100:00100000:1.0:1789304727.393601:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765605760:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304727.393678:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765605760:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304727.393686:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1169 00000100:00080000:1.0:1789304727.393706:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304727.393962:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765605504 00000100:00100000:3.0:1789304727.393967:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765605504 00000100:00100000:3.0:1789304727.394003:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1236 00000100:00100000:3.0:1789304727.394011:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765605504:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304727.394043:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765605504:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304727.394049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1236 00000100:00100000:0.0:1789304727.394608:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765605632 00000100:00100000:0.0:1789304727.394614:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765605632 00000100:00100000:0.0:1789304727.394658:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1548 00000100:00100000:0.0:1789304727.394668:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765605632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304727.394720:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765605632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304727.394728:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1548 00010000:00010000:3.0:1789304727.890350:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304728.340953:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304728.340977:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785680896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304728.341045:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304728.341131:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785680896 00000100:00100000:0.0:1789304728.341139:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785680896 00000100:00100000:0.0:1789304728.341197:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1789304728.341207:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785680896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304728.341245:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304728.341309:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785680896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304728.341317:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00080000:0.0:1789304728.341339:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304728.341375:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785680896:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1789304728.744873:0:89436:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfb81cf90 20000000:00000080:2.0:1789304728.744888:0:89436:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e74800 uarg=0000000000000000 00010000:00010000:2.0:1789304728.746873:0:89436:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789304728.746924:0:89436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:2.0:1789304728.746928:0:89436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304728.746940:0:89436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296e85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100682 expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304728.746964:0:89436:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789304728.746982:0:89436:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304728.746997:0:89436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304728.747011:0:89436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231296e69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296e62 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304728.747018:0:89436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304728.747054:0:89436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231296e69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296e62 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304728.747070:0:89436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231296e69 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296e62 expref: 18 pid: 5847 timeout: 2328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304728.747084:0:89436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89436:1876219785681024:0@lo:104: 00000100:00100000:2.0:1789304728.747652:0:89436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304728.747762:0:89436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789304728.747870:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785681024 00000100:00100000:3.0:1789304728.747878:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785681024 00000100:00100000:3.0:1789304728.747964:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789304728.747974:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:89436:x1876219785681024:12345-0@lo:104: 00010000:00010000:3.0:1789304728.747988:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304728.748067:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304728.748073:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:89436:x1876219785681024:12345-0@lo:104: Request processed in 101us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304728.748080:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:0.0:1789304728.748252:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304728.748259:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748266:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304728.748270:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748277:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304728.748284:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304728.748302:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304728.748335:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748341:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304728.748361:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748367:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231296e62 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296e69 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748383:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304728.748385:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304728.748387:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304728.748407:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785681152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304728.748459:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304728.748502:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785681152 00000100:00100000:0.0:1789304728.748506:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785681152 00010000:00010000:0.0:1789304728.748526:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231296e69 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296e62 expref: 19 pid: 5847 timeout: 2328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304728.748548:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789304728.748555:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785681152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304728.748565:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304728.748569:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231296e69 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296e62 expref: 19 pid: 5847 timeout: 2328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748578:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231296e69 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296e62 expref: 19 pid: 5847 timeout: 2328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748593:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748601:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748617:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748624:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748630:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748637:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748642:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304728.748646:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748653:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748661:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304728.748669:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304728.748697:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785681152:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304728.748704:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789304728.748934:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785681152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304728.749039:0:89436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231296e69 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296e62 expref: 18 pid: 5847 timeout: 2328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304728.749051:0:89436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89436:1876219785681024:0@lo:104: 00010000:00010000:1.0:1789304728.749066:0:89436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304728.749075:0:89436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304728.749081:0:89436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304728.749087:0:89436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb7231296ecb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304728.915908:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304729.874310:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785681536:0@lo:400:kworker.0 00000100:00100000:0.0:1789304729.874378:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304729.874445:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304729.874452:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785681664:0@lo:400:kworker.0 00000100:00100000:0.0:1789304729.874490:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304729.874526:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785681536 00000100:00100000:0.0:1789304729.874534:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785681536 00000100:00100000:0.0:1789304729.874581:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:0.0:1789304729.874589:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785681536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304729.874635:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785681536:12345-0@lo:400:kworker.0 Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304729.874642:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:0.0:1789304729.874682:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785681536:0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.874862:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785681280:0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.874895:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304729.874926:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785681792:0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.874950:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304729.874969:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789304729.874975:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785681408:0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.874996:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304729.875013:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785681920:0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.875031:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304729.875056:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785681664 00000100:00100000:1.0:1789304729.875060:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785681664 00000100:00100000:1.0:1789304729.875114:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785681792 00000100:00100000:1.0:1789304729.875117:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785681792 00000100:00100000:1.0:1789304729.875137:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785681408 00000100:00100000:1.0:1789304729.875140:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785681408 00000100:00100000:1.0:1789304729.875153:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:1.0:1789304729.875159:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785681664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.875196:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785681664:12345-0@lo:400:kworker.0 Request processed in 37us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304729.875203:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:1.0:1789304729.875217:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:1.0:1789304729.875223:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785681792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.875253:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785681792:12345-0@lo:400:kworker.0 Request processed in 30us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304729.875259:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:1.0:1789304729.875272:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:1.0:1789304729.875277:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785681408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.875303:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785681408:12345-0@lo:400:kworker.0 Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304729.875309:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:1.0:1789304729.875328:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785681920 00000100:00100000:1.0:1789304729.875332:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785681920 00000100:00100000:1.0:1789304729.875357:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:1.0:1789304729.875363:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785681920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.875393:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785681920:12345-0@lo:400:kworker.0 Request processed in 31us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304729.875399:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:1.0:1789304729.875428:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304729.875432:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304729.875591:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785681280 00000100:00100000:0.0:1789304729.875596:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785681280 00000100:00100000:0.0:1789304729.875620:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1789304729.875626:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785681280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304729.875656:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785681280:12345-0@lo:400:kworker.0 Request processed in 30us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304729.875661:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1789304729.875723:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785681408:0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.875733:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785681920:0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.875740:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785681280:0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.875749:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785681792:0@lo:400:kworker.0 00000100:00100000:1.0:1789304729.875785:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785681664:0@lo:400:kworker.0 00010000:00010000:0.0:1789304729.938644:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304730.519144:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304730.519153:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304730.519165:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304730.519216:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304730.519229:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304730.519240:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304730.519265:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785682048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304730.519329:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304730.519376:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b04091d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789304730.521256:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785682048 00000100:00100000:1.0:1789304730.521271:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785682048 00000100:00100000:1.0:1789304730.521336:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1789304730.521346:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785682048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304730.521362:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304730.521379:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231296ed9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296ed2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304730.521417:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231296ed9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296ed2 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304730.521428:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231296ed9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296ed2 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304730.521437:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370c00, rc 0) 00000100:00100000:1.0:1789304730.521509:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785682048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304730.521516:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1789304730.522229:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785682048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304730.522248:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304730.522259:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304730.522277:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304730.522283:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304730.522290:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304730.963238:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304731.366138:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304731.366210:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765605888 00000100:00100000:2.0:1789304731.366221:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765605888 00000100:00100000:2.0:1789304731.366290:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 986 00000100:00100000:2.0:1789304731.366298:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:52680:x1876219765605888:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304731.366315:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304731.366334:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296ee0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610069e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304731.366385:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304731.366407:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304731.366425:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304731.366459:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:2.0:1789304731.366463:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304731.366486:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304731.366510:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231296ee0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610069e expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789304731.366605:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304731.367027:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610069e expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304731.367038:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789304731.367040:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304731.367043:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecca00, rc 0) 00000100:00100000:2.0:1789304731.367119:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:52680:x1876219765605888:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 821us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304731.367125:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 986 00000100:00100000:0.0:1789304731.373927:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304731.374714:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765606144 00000100:00100000:3.0:1789304731.374726:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765606144 00000100:00100000:3.0:1789304731.374794:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 987 00000100:00100000:3.0:1789304731.374804:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:52680:x1876219765606144:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304731.374859:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304731.374890:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ee7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610069e expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304731.374906:0:30980:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231296e85) 00010000:00010000:3.0:1789304731.374910:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:3.0:1789304731.374921:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304731.374946:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304731.374959:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304731.374982:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304731.375348:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003995143d reply state 0000000014984aaf transno 4294967677 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304731.375358:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304731.375370:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000100:00100000:3.0:1789304731.375464:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:52680:x1876219765606144:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 661us (1547us total) trans 4294967677 rc 0/0 00000100:00100000:3.0:1789304731.375471:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 987 00010000:00010000:1.0:1789304731.378314:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304731.378331:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304731.378339:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304731.378350:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304731.378355:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304731.378363:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304731.378380:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:1.0:1789304731.378383:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304731.378388:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304731.378404:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231296eee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304731.986674:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304732.099053:0:89631:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2b798c30 20000000:00000080:0.0:1789304732.099071:0:89631:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02f31000 uarg=0000000000000000 00010000:00010000:2.0:1789304732.099705:0:89631:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304732.099720:0:89631:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304732.099735:0:89631:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304732.099754:0:89631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304732.099771:0:89631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231296ed9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296ed2 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304732.099779:0:89631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304732.099817:0:89631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231296ed9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296ed2 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304732.099831:0:89631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231296ed9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296ed2 expref: 18 pid: 5847 timeout: 2331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304732.099845:0:89631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89631:1876219785682176:0@lo:104: 00000100:00100000:2.0:1789304732.099911:0:89631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304732.100011:0:89631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304732.100064:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789304732.100077:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785682176 00000100:00100000:3.0:1789304732.100083:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785682176 00000100:00100000:3.0:1789304732.100421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789304732.100432:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c40c76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:89631:x1876219785682176:12345-0@lo:104: 00010000:00010000:3.0:1789304732.100448:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304732.100559:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304732.100566:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c40c76450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:89631:x1876219785682176:12345-0@lo:104: Request processed in 137us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304732.100573:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00010000:1.0:1789304732.100643:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304732.100650:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100658:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304732.100662:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100670:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304732.100678:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304732.100683:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304732.100716:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100722:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304732.100743:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100750:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb7231296ed2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296ed9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100765:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304732.100767:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304732.100769:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304732.100787:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785682304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304732.100819:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304732.100864:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785682304 00000100:00100000:1.0:1789304732.100868:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785682304 00010000:00010000:1.0:1789304732.100888:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231296ed9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296ed2 expref: 19 pid: 5847 timeout: 2331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304732.100909:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1789304732.100916:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785682304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304732.100926:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304732.100929:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231296ed9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296ed2 expref: 19 pid: 5847 timeout: 2331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100936:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231296ed9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296ed2 expref: 19 pid: 5847 timeout: 2331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100947:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100953:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100962:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100966:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100971:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100975:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100978:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304732.100980:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100984:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100989:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304732.100995:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304732.101014:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785682304:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304732.101020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1789304732.101054:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785682304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304732.101724:0:89631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231296ed9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296ed2 expref: 18 pid: 5847 timeout: 2331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304732.101736:0:89631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89631:1876219785682176:0@lo:104: 00010000:00010000:0.0:1789304732.101752:0:89631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304732.101761:0:89631:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304732.101766:0:89631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304732.101771:0:89631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296ef5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304732.438246:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304732.438267:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785682432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304732.438331:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304732.438403:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785682432 00000100:00100000:1.0:1789304732.438410:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785682432 00000100:00100000:1.0:1789304732.438794:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1789304732.438803:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785682432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304732.438838:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304732.438897:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785682432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304732.438905:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00080000:1.0:1789304732.438925:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304732.439018:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785682432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304732.515001:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304732.515206:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304732.515238:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304732.515308:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765606528 00000100:00100000:2.0:1789304732.515318:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765606528 00000100:00100000:2.0:1789304732.515399:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1172 00000100:00100000:2.0:1789304732.515410:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765606528:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304732.515489:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765606528:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304732.515497:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1172 00000100:00080000:0.0:1789304732.516411:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304732.516500:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765606400 00000100:00100000:3.0:1789304732.516508:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765606400 00000100:00100000:1.0:1789304732.516550:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765606272 00000100:00100000:1.0:1789304732.516555:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765606272 00000100:00100000:1.0:1789304732.516638:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1239 00000100:00100000:1.0:1789304732.516647:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765606272:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304732.516704:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765606272:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 58us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304732.516711:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1239 00000100:00100000:2.0:1789304732.516792:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1552 00000100:00100000:2.0:1789304732.516799:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765606400:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304732.516831:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765606400:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 34us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304732.516837:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1552 00000001:00080000:1.0:1789304733.010350:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967677 is committed 00010000:00010000:0.0:1789304733.020702:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304733.458826:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785682560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304733.458963:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304733.460509:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785682560 00000100:00100000:0.0:1789304733.460522:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785682560 00000100:00080000:1.0:1789304733.460589:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304733.460615:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1789304733.460626:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785682560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304733.460661:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304733.460737:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785682560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304733.460744:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1789304733.460859:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785682560:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1789304733.714240:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304733.714248:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304733.714260:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304733.714308:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304733.714320:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304733.714331:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304733.714362:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785682688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304733.714440:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304733.714504:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789304733.714683:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785682688 00000100:00100000:0.0:1789304733.714691:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785682688 00000100:00100000:0.0:1789304733.714742:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:0.0:1789304733.714761:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785682688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304733.714778:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304733.714792:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb200/0xefc0bb7231296f03 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296efc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304733.714816:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb200/0xefc0bb7231296f03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296efc expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304733.714828:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb200/0xefc0bb7231296f03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296efc expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304733.714836:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789304733.714883:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785682688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304733.714890:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1789304733.715071:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785682688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304733.715086:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304733.715183:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304733.715202:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304733.715208:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304733.715216:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304734.034218:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304734.994711:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785682816:0@lo:400:kworker.0 00000100:00100000:1.0:1789304734.994786:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304734.994879:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785682816 00000100:00100000:2.0:1789304734.994888:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785682816 00000100:00100000:2.0:1789304734.994937:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1789304734.994947:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785682816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304734.999181:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785682816:12345-0@lo:400:kworker.0 Request processed in 4225us (4384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304734.999195:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1789304735.000525:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785682944:0@lo:400:kworker.0 00000100:00100000:3.0:1789304735.000586:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304735.000620:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785683456:0@lo:400:kworker.0 00000100:00100000:3.0:1789304735.000645:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304735.000671:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304735.000678:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785683072:0@lo:400:kworker.0 00000100:00100000:3.0:1789304735.000702:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304735.000741:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785683456 00000100:00100000:3.0:1789304735.000748:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785683456 00000100:00100000:3.0:1789304735.000795:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785683072 00000100:00100000:3.0:1789304735.000799:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785683072 00000100:00100000:3.0:1789304735.000818:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1789304735.000825:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785683456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304735.000878:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785683456:12345-0@lo:400:kworker.0 Request processed in 53us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304735.000884:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1789304735.000900:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:3.0:1789304735.000906:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785683072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304735.000951:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785683072:12345-0@lo:400:kworker.0 Request processed in 44us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304735.000957:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00080000:3.0:1789304735.000977:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304735.001010:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785683072:0@lo:400:kworker.0 00000100:00100000:3.0:1789304735.001020:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785683456:0@lo:400:kworker.0 00000100:00100000:3.0:1789304735.001723:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785682944 00000100:00100000:3.0:1789304735.001730:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785682944 00000100:00100000:3.0:1789304735.001775:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:3.0:1789304735.001783:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785682944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304735.001840:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785682944:12345-0@lo:400:kworker.0 Request processed in 58us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304735.001846:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:3.0:1789304735.001885:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785682944:0@lo:400:kworker.0 00000100:00100000:1.0:1789304735.002129:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785682816:0@lo:400:kworker.0 00000100:00100000:1.0:1789304735.002148:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785683328:0@lo:400:kworker.0 00000100:00100000:1.0:1789304735.002180:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304735.002205:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304735.002212:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785683200:0@lo:400:kworker.0 00000100:00100000:1.0:1789304735.002234:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304735.002413:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785683328 00000100:00100000:0.0:1789304735.002418:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785683328 00000100:00100000:0.0:1789304735.002455:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785683200 00000100:00100000:0.0:1789304735.002458:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785683200 00000100:00100000:0.0:1789304735.002480:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1789304735.002486:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785683328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304735.002529:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785683328:12345-0@lo:400:kworker.0 Request processed in 44us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304735.002535:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1789304735.002548:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1789304735.002553:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785683200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304735.002577:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785683200:12345-0@lo:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304735.002581:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00080000:0.0:1789304735.002597:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304735.002616:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785683200:0@lo:400:kworker.0 00000100:00100000:0.0:1789304735.002624:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785683328:0@lo:400:kworker.0 00010000:00010000:2.0:1789304735.061537:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304735.115719:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304735.115836:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765606656 00000100:00100000:3.0:1789304735.115847:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765606656 00000100:00100000:3.0:1789304735.115929:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 988 00000100:00100000:3.0:1789304735.115941:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765606656:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304735.116148:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765606656:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 210us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304735.116156:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 988 00000100:00080000:0.0:1789304735.116293:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304735.118887:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304735.118987:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765606784 00000100:00100000:3.0:1789304735.118998:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765606784 00000100:00100000:3.0:1789304735.119124:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 531 00000100:00100000:3.0:1789304735.119134:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765606784:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304735.119897:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765606784:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 762us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304735.119906:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 531 00000100:00100000:2.0:1789304735.121820:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304735.121890:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765606912 00000100:00100000:3.0:1789304735.121899:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765606912 00000100:00100000:3.0:1789304735.121936:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 532 00000100:00100000:3.0:1789304735.121943:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876219765606912:12345-192.168.202.29@tcp:8:lfs.0 00010000:00080000:3.0:1789304735.121975:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 2184 last 0 00000020:00000080:3.0:1789304735.122002:0:6692:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231296f0a 00002000:00100000:3.0:1789304735.122013:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b01e99800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789304735.122034:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789304735.122257:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789304735.122291:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9e2b01e9d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789304735.122606:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765606912:12345-192.168.202.29@tcp:8:lfs.0 Request processed in 661us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304735.122614:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 532 00000100:00080000:0.0:1789304735.123691:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304735.125054:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304735.125154:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765607040 00000100:00100000:1.0:1789304735.125176:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765607040 00000100:00100000:1.0:1789304735.125254:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 533 00000100:00100000:1.0:1789304735.125276:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52765:x1876219765607040:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304735.125901:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52765:x1876219765607040:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 635us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304735.125909:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 533 00000100:00080000:0.0:1789304735.126123:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304735.128758:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304735.128856:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765607168 00000100:00100000:0.0:1789304735.128867:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765607168 00000100:00100000:0.0:1789304735.128928:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 989 00000100:00100000:0.0:1789304735.128939:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765607168:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304735.129913:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765607168:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 972us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304735.129923:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 989 00000100:00100000:2.0:1789304735.132871:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304735.132978:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765607296 00000100:00100000:3.0:1789304735.132988:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765607296 00000100:00100000:3.0:1789304735.133119:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 990 00000100:00100000:3.0:1789304735.133131:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765607296:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304735.133252:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765607296:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 124us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304735.133262:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 990 00000100:00100000:2.0:1789304735.139778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304735.139896:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765607424 00000100:00100000:3.0:1789304735.139906:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765607424 00000100:00100000:3.0:1789304735.140003:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 534 00000100:00100000:3.0:1789304735.140014:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765607424:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304735.141153:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765607424:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 1136us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304735.141174:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 534 00000100:00100000:0.0:1789304735.143739:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304735.143832:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765607552 00000100:00100000:1.0:1789304735.143843:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765607552 00000100:00100000:1.0:1789304735.144051:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 535 00000100:00100000:1.0:1789304735.144064:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52765:x1876219765607552:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304735.144809:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52765:x1876219765607552:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 746us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304735.144820:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 535 00000100:00100000:1.0:1789304735.146658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304735.147055:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765607680 00000100:00100000:3.0:1789304735.147064:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765607680 00000100:00100000:3.0:1789304735.147139:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 991 00000100:00100000:3.0:1789304735.147150:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765607680:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304735.147559:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:52765:x1876219765607680:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 410us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304735.147568:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 991 00000100:00100000:2.0:1789304735.198483:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304735.198614:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765607808 00000100:00100000:0.0:1789304735.198628:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765607808 00000100:00100000:0.0:1789304735.198688:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 992 00000100:00100000:0.0:1789304735.198699:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:52769:x1876219765607808:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789304735.198722:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304735.198746:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296f11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006a5 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.198818:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296f18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.198833:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.198847:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.198859:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296f1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.198865:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.198871:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199402:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199412:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199419:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304735.199445:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:0.0:1789304735.199449:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304735.199469:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199482:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199489:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296f18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199500:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296f18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199506:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304735.199510:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296f18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199517:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296f18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199528:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:0.0:1789304735.199530:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304735.199534:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296f18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199540:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231296f18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199551:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199556:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296f1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199561:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199565:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304735.199568:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199576:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296f1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199582:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c0558da00) 00010000:00010000:0.0:1789304735.199584:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304735.199586:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296f1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199591:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231296f1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199620:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231296f11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006a5 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199634:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006a5 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.199641:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:0.0:1789304735.199643:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304735.199646:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789304735.199700:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52769:x1876219765607808:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1004us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304735.199707:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 992 00000100:00100000:0.0:1789304735.204875:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304735.204957:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765608064 00000100:00100000:3.0:1789304735.204991:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765608064 00000100:00100000:3.0:1789304735.205055:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 993 00000100:00100000:3.0:1789304735.205065:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:52769:x1876219765608064:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:3.0:1789304735.205086:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304735.205138:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296f2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006ac expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304735.205467:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296f34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304735.205488:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304735.205499:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304735.205514:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304735.205522:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304735.205528:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789304735.208863:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:2.0:1789304735.210316:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296f42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210339:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210365:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210421:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210429:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296f34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210436:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296f34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210441:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304735.210446:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296f34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210454:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296f34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210466:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:2.0:1789304735.210469:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304735.210473:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296f34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210478:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296f34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304735.210496:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034b59043 reply state 000000003ae412af transno 4294967678 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304735.210504:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304735.210674:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296f2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006ac expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210691:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006ac expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.210698:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9e2c421d2200) 00010000:00010000:2.0:1789304735.210701:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304735.210703:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789304735.210862:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:52769:x1876219765608064:12345-192.168.202.29@tcp:101:dd.0 Request processed in 5798us (5996us total) trans 4294967678 rc 0/0 00000100:00100000:2.0:1789304735.210870:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 993 00010000:00010000:0.0:1789304735.215689:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.215707:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.215717:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.215724:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304735.215729:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.215737:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.215752:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c2ea19000) 00010000:00010000:0.0:1789304735.215755:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304735.215760:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304735.215767:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296f3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304735.218618:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304735.220276:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765608192 00000100:00100000:2.0:1789304735.220291:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765608192 00000100:00100000:2.0:1789304735.220363:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 536 00000100:00100000:2.0:1789304735.220374:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:52769:x1876219765608192:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:2.0:1789304735.220395:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304735.220422:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231296f50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006b3 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304735.220452:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789304735.220479:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=2184s v=(0 0) 00010000:00010000:2.0:1789304735.220485:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304735.220496:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231296f50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006b3 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.220514:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231296f50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006b3 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304735.220527:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789304735.220592:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:52769:x1876219765608192:12345-192.168.202.29@tcp:101:dd.0 Request processed in 221us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304735.220597:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 536 00000100:00100000:1.0:1789304735.242085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304735.242330:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765608320 00000100:00100000:2.0:1789304735.242342:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765608320 00002000:00100000:2.0:1789304735.242405:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1f:0x0] (0->1048575) req@ffff9e2c02ed4a80 x1876219765608320/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:46/0 lens 488/0 e 0 to 0 dl 1789304746 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304735.242431:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c02ed4a80 with x1876219765608320 ext(0->1048575) 00002000:00010000:2.0:1789304735.242438:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c02ed4a80 00000100:00100000:2.0:1789304735.242473:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:2.0:1789304735.242484:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765608320:12345-192.168.202.29@tcp:4:dd.0 00000001:00100000:3.0:1789304735.290889:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:2.0:1789304735.297860:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765608320:12345-192.168.202.29@tcp:4:dd.0 Request processed in 55367us (55774us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1789304735.297875:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 24 00002000:00100000:2.0:1789304735.297888:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1f:0x0] (0->1048575) req@ffff9e2c02ed4a80 x1876219765608320/t4294967358(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:46/0 lens 488/448 e 0 to 0 dl 1789304746 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304735.297899:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c02ed4a80 with x1876219765608320 ext(0->1048575) 00002000:00010000:2.0:1789304735.297906:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c02ed4a80 00000100:00100000:1.0:1789304735.301188:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304735.301965:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765608448 00000100:00100000:3.0:1789304735.301985:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765608448 00000100:00100000:3.0:1789304735.302048:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 994 00000100:00100000:3.0:1789304735.302059:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:52769:x1876219765608448:12345-192.168.202.29@tcp:44:dd.0 00000100:00100000:2.0:1789304735.337279:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:52769:x1876219765608448:12345-192.168.202.29@tcp:44:dd.0 Request processed in 35211us (36087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304735.337293:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 994 00000001:00080000:1.0:1789304735.339549:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967678 is committed 00000100:00100000:0.0:1789304735.340118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304735.340253:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765608576 00000100:00100000:3.0:1789304735.340262:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765608576 00000100:00100000:3.0:1789304735.340363:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 537 00000100:00100000:3.0:1789304735.340374:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2357:x1876219765608576:12345-192.168.202.29@tcp:16:dd.0 00000001:00080000:0.0:1789304735.375531:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967358 is committed 00000100:00100000:3.0:1789304735.375758:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765608576:12345-192.168.202.29@tcp:16:dd.0 Request processed in 35380us (35639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304735.375771:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 537 00000100:00100000:2.0:1789304735.377978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304735.378070:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765608832 00000100:00100000:1.0:1789304735.378081:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765608832 00000100:00100000:1.0:1789304735.378333:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 101 00000100:00100000:1.0:1789304735.378345:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:52769:x1876219765608832:12345-192.168.202.29@tcp:35:dd.0 00000100:00100000:1.0:1789304735.378834:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:52769:x1876219765608832:12345-192.168.202.29@tcp:35:dd.0 Request processed in 491us (864us total) trans 4294967679 rc 0/0 00000100:00100000:1.0:1789304735.378842:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 101 00010000:00010000:0.0:1789304736.082590:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304736.483057:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967679 is committed 00010000:00010000:3.0:1789304737.110525:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304737.473367:0:89881:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2187151043575ns, next at 2168015411258ns, rc = 0 00000004:00080000:3.0:1789304737.473525:0:89881:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2187151433227ns, next at 2091606901408ns, rc = 0 00000004:00080000:1.0:1789304737.476125:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 87 committed 00000004:00080000:1.0:1789304737.476264:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 81 committed 00000100:00100000:2.0:1789304737.557266:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785683584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304737.557346:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304737.557613:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785683584 00000100:00100000:2.0:1789304737.557622:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785683584 00000100:00100000:2.0:1789304737.557678:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:2.0:1789304737.557688:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785683584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304737.557722:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789304737.557770:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785683584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304737.557778:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00080000:2.0:1789304737.557797:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304737.557833:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785683584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304737.634935:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304737.636573:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765609088 00000100:00100000:0.0:1789304737.636591:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765609088 00000100:00100000:0.0:1789304737.636655:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1556 00000100:00100000:0.0:1789304737.636666:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765609088:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304737.636751:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765609088:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304737.636762:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1556 00000100:00080000:0.0:1789304737.636784:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304737.639025:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304737.639069:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304737.639617:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765609216 00000100:00100000:0.0:1789304737.639629:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765609216 00000100:00100000:0.0:1789304737.639693:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1175 00000100:00100000:0.0:1789304737.639704:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765609216:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304737.639784:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765609216:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304737.639792:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1175 00000100:00100000:3.0:1789304737.640057:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765608960 00000100:00100000:3.0:1789304737.640062:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765608960 00000100:00100000:3.0:1789304737.640260:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1242 00000100:00100000:3.0:1789304737.640270:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765608960:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304737.640301:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765608960:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304737.640307:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1242 00000100:00080000:1.0:1789304737.641253:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304737.645795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304737.647539:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765609344 00000100:00100000:3.0:1789304737.647554:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765609344 00000100:00100000:0.0:1789304737.647718:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1176 00000100:00100000:0.0:1789304737.647730:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765609344:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304737.647819:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765609344:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 91us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304737.647827:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1176 00000100:00080000:1.0:1789304737.648041:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304738.130350:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304738.586950:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785683712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304738.587025:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304738.587638:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785683712 00000100:00100000:2.0:1789304738.587651:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785683712 00000100:00100000:2.0:1789304738.587715:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1789304738.587725:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785683712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304738.587759:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304738.587811:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785683712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304738.587822:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00080000:1.0:1789304738.587872:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304738.587910:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785683712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304738.867665:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304738.867801:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765609472 00000100:00100000:1.0:1789304738.867812:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765609472 00000100:00100000:1.0:1789304738.867876:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 995 00000100:00100000:1.0:1789304738.867887:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:52962:x1876219765609472:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304738.867998:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:52962:x1876219765609472:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 112us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304738.868005:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 995 00000100:00100000:0.0:1789304738.869529:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304738.873967:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765609600 00000100:00100000:1.0:1789304738.873984:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765609600 00000100:00100000:1.0:1789304738.874057:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 538 00000100:00100000:1.0:1789304738.874071:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:52962:x1876219765609600:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304738.874494:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:52962:x1876219765609600:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 426us (4968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304738.874503:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 538 00000100:00100000:3.0:1789304738.876501:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304738.876625:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765609728 00000100:00100000:1.0:1789304738.876635:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765609728 00000100:00100000:1.0:1789304738.878265:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 539 00000100:00100000:1.0:1789304738.878281:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52962:x1876219765609728:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304738.878678:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52962:x1876219765609728:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 400us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304738.878685:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 539 00000100:00100000:0.0:1789304738.883752:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304738.884196:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765609856 00000100:00100000:2.0:1789304738.884208:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765609856 00000100:00100000:2.0:1789304738.884262:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 996 00000100:00100000:2.0:1789304738.884274:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:52962:x1876219765609856:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304738.884853:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:52962:x1876219765609856:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 579us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304738.884862:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 996 00000100:00100000:0.0:1789304738.895279:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304738.895388:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765609984 00000100:00100000:2.0:1789304738.895399:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765609984 00000100:00100000:2.0:1789304738.895462:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 997 00000100:00100000:2.0:1789304738.895474:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:52962:x1876219765609984:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304738.895578:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:52962:x1876219765609984:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 106us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304738.895586:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 997 00000100:00100000:0.0:1789304738.908870:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304738.908916:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765610112 00000100:00100000:0.0:1789304738.908927:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765610112 00000100:00100000:0.0:1789304738.908984:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 540 00000100:00100000:0.0:1789304738.908994:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:52962:x1876219765610112:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304738.909427:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:52962:x1876219765610112:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 434us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304738.909436:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 540 00000100:00100000:0.0:1789304738.920502:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304738.920543:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765610240 00000100:00100000:0.0:1789304738.920554:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765610240 00000100:00100000:0.0:1789304738.920606:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 541 00000100:00100000:0.0:1789304738.920616:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52962:x1876219765610240:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304738.921005:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:52962:x1876219765610240:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 389us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304738.921013:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 541 00000100:00100000:0.0:1789304738.927380:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304738.927619:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765610368 00000100:00100000:1.0:1789304738.927629:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765610368 00000100:00100000:1.0:1789304738.927681:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 998 00000100:00100000:1.0:1789304738.927691:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:52962:x1876219765610368:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304738.928184:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:52962:x1876219765610368:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 493us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304738.928193:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 998 00000100:00100000:0.0:1789304739.032038:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304739.032165:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765610624 00000100:00100000:2.0:1789304739.032176:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765610624 00000100:00100000:2.0:1789304739.032246:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 999 00000100:00100000:2.0:1789304739.032256:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:52966:x1876219765610624:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304739.032306:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304739.032341:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231296f42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006ac expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.032364:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9e2c421d2200) 00010000:00010000:2.0:1789304739.032374:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304739.032396:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296f57 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.032410:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296f57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.032420:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296f57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.032433:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.032439:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.032455:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.033215:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296f65 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.033226:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296f65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.033234:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296f65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789304739.033532:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789304739.034572:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].31, 64 off10176 00000004:00080000:2.0:1789304739.034584:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2188712493109ns, next at 2189712490763ns, rc = 0 00010000:00010000:2.0:1789304739.035272:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035291:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035303:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035311:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035327:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035333:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035350:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304739.035376:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296f65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035382:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296f65 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035388:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296f65 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035394:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304739.035398:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296f65 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035405:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296f65 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035417:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:2.0:1789304739.035420:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304739.035425:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296f65 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.035432:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231296f65 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304739.035988:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304739.035997:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304739.036005:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304739.036009:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304739.036016:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304739.036026:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:0.0:1789304739.036029:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789304739.036032:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304739.036042:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.036083:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296f57 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.036121:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296f57 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.036128:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296f57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.036133:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304739.036136:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296f57 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.036142:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296f57 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.036151:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:2.0:1789304739.036153:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304739.036157:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296f57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304739.036163:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231296f57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304739.041827:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304739.041834:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304739.041838:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1789304739.041995:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008aa85671 reply state 0000000027049182 transno 4294967680 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304739.042028:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304739.042154:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:52966:x1876219765610624:12345-192.168.202.29@tcp:36:rm.0 Request processed in 9895us (10121us total) trans 4294967680 rc 0/0 00000100:00100000:2.0:1789304739.042164:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 999 00010000:00010000:1.0:1789304739.044695:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304739.044713:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304739.044721:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304739.044728:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304739.044733:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304739.044742:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304739.044757:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c421d2a00) 00010000:00010000:1.0:1789304739.044761:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304739.044765:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304739.044772:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231296f5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304739.155519:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304740.114580:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785683968:0@lo:400:kworker.0 00000100:00100000:0.0:1789304740.114685:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304740.114745:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785684480:0@lo:400:kworker.0 00000100:00100000:0.0:1789304740.114773:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304740.114800:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304740.114805:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785684096:0@lo:400:kworker.0 00000100:00100000:0.0:1789304740.114823:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304740.114857:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785684480 00000100:00100000:0.0:1789304740.114866:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785684480 00000100:00100000:0.0:1789304740.114943:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785684096 00000100:00100000:0.0:1789304740.114945:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785684096 00000100:00100000:0.0:1789304740.114970:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1789304740.114980:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785684480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304740.115048:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785684480:12345-0@lo:400:kworker.0 Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304740.115056:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1789304740.115074:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1789304740.115079:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785684096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304740.115129:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785684096:12345-0@lo:400:kworker.0 Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304740.115138:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1789304740.115183:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785684096:0@lo:400:kworker.0 00000100:00100000:0.0:1789304740.115192:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785684480:0@lo:400:kworker.0 00000100:00100000:3.0:1789304740.115534:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785683840:0@lo:400:kworker.0 00000100:00100000:3.0:1789304740.115575:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304740.115624:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785684352:0@lo:400:kworker.0 00000100:00100000:3.0:1789304740.115646:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304740.115669:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304740.115674:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785684224:0@lo:400:kworker.0 00000100:00100000:3.0:1789304740.115695:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304740.115727:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785683968 00000100:00100000:3.0:1789304740.115732:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785683968 00000100:00100000:3.0:1789304740.115767:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785684352 00000100:00100000:3.0:1789304740.115770:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785684352 00000100:00100000:3.0:1789304740.115794:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785684224 00000100:00100000:3.0:1789304740.115797:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785684224 00000100:00100000:3.0:1789304740.115812:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:3.0:1789304740.115820:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785683968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304740.115860:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785683968:12345-0@lo:400:kworker.0 Request processed in 41us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304740.115866:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:3.0:1789304740.115882:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:3.0:1789304740.115887:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785684352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304740.115917:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785684352:12345-0@lo:400:kworker.0 Request processed in 30us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304740.115922:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:3.0:1789304740.116254:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:3.0:1789304740.116263:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785684224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304740.116298:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785684224:12345-0@lo:400:kworker.0 Request processed in 38us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304740.116303:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:3.0:1789304740.116370:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785683968:0@lo:400:kworker.0 00000100:00100000:3.0:1789304740.116406:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785684224:0@lo:400:kworker.0 00000100:00100000:3.0:1789304740.116416:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785684352:0@lo:400:kworker.0 00000100:00100000:0.0:1789304740.116603:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785683840 00000100:00100000:0.0:1789304740.116609:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785683840 00000100:00100000:0.0:1789304740.116660:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1789304740.116668:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785683840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304740.116716:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785683840:12345-0@lo:400:kworker.0 Request processed in 49us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304740.116722:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1789304740.118471:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785683840:0@lo:400:kworker.0 00000100:00080000:1.0:1789304740.122386:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304740.122404:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304740.122409:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304740.178765:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304741.141852:0:90025:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2190819757997ns, next at 2168015411258ns, rc = 0 00000004:00080000:1.0:1789304741.141956:0:90025:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2190819864520ns, next at 2189712490763ns, rc = 0 00000004:00080000:2.0:1789304741.190483:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 89 committed 00000004:00080000:2.0:1789304741.190509:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 82 committed 00000001:00080000:2.0:1789304741.190530:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967680 is committed 00000004:00080000:2.0:1789304741.190534:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 88 committed 00000100:00100000:0.0:1789304741.190886:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785684608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789304741.190964:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304741.191341:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785684608 00000100:00100000:3.0:1789304741.191474:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785684608 00000100:00100000:3.0:1789304741.191523:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1789304741.191533:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785684608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789304741.191562:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:31 count 1 00010000:00010000:3.0:1789304741.191587:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304741.191620:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231296f50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006b3 expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304741.191630:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1789304741.191635:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304741.191640:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304741.191671:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231296f50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006b3 expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304741.191685:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231296f50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006b3 expref: 5 pid: 6691 timeout: 2290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304741.191698:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785684736:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304741.191771:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0367e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789304741.196459:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304741.196626:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785684736:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304741.196657:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304741.197536:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765610752 00000100:00100000:2.0:1789304741.197547:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765610752 00010000:00010000:2.0:1789304741.197615:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231296f50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006b3 expref: 6 pid: 6691 timeout: 2290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304741.197659:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 408 00000100:00100000:2.0:1789304741.197669:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765610752:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304741.197686:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304741.197693:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231296f50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006b3 expref: 6 pid: 6691 timeout: 2290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304741.197707:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231296f50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006b3 expref: 6 pid: 6691 timeout: 2290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304741.197735:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231296f50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006b3 expref: 6 pid: 6691 timeout: 2290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304741.197758:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304741.197762:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304741.197768:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304741.197778:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304741.197803:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304741.197856:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765610752:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 189us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304741.197864:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 408 00010000:00010000:3.0:1789304741.198601:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304741.198619:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304741.198630:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304741.198638:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304741.198658:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789304741.199549:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304741.200182:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304741.200193:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304741.200500:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304741.200507:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304741.200518:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304741.200539:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304741.200553:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b285ed/0xefc0bb7231296f73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304741.200580:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304741.200582:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304741.200584:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304741.200983:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785684608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9447us (10015us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1789304741.200993:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000004:00080000:0.0:1789304741.201936:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c0361ad80/2, rc 0, transno 4294967359 00000100:00100000:0.0:1789304741.201948:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785684608:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789304741.203722:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304742.226695:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304742.674545:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785684864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304742.674631:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304742.675246:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785684864 00000100:00100000:2.0:1789304742.675256:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785684864 00000100:00100000:2.0:1789304742.675351:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1789304742.675361:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785684864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304742.675396:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789304742.675453:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785684864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304742.675460:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00080000:0.0:1789304742.675777:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304742.675820:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785684864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304742.755563:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304742.755601:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304742.755634:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304742.755673:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304742.755796:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765611008 00000100:00100000:1.0:1789304742.755806:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765611008 00000100:00100000:1.0:1789304742.755897:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1560 00000100:00100000:1.0:1789304742.755909:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765611008:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304742.755996:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765611008:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304742.756004:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1560 00000100:00100000:0.0:1789304742.756552:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765611136 00000100:00100000:0.0:1789304742.756560:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765611136 00000100:00100000:0.0:1789304742.756605:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1179 00000100:00100000:0.0:1789304742.756613:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765611136:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304742.756647:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765611136:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 36us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304742.756654:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1179 00000100:00100000:0.0:1789304742.756665:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765611264 00000100:00100000:0.0:1789304742.756668:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765611264 00000100:00100000:0.0:1789304742.756686:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1180 00000100:00100000:0.0:1789304742.756691:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765611264:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304742.756713:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765611264:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 21us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304742.756718:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1180 00000100:00080000:2.0:1789304742.756887:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304742.756892:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304742.757550:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765610880 00000100:00100000:3.0:1789304742.757558:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765610880 00000100:00100000:3.0:1789304742.757605:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1244 00000100:00100000:3.0:1789304742.757614:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765610880:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304742.757653:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765610880:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304742.757660:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1244 00010000:00010000:2.0:1789304743.250907:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304743.698613:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304743.698637:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785684992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304743.698718:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304743.699058:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785684992 00000100:00100000:1.0:1789304743.699069:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785684992 00000100:00100000:1.0:1789304743.699165:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1789304743.699176:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785684992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304743.699218:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304743.699290:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785684992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304743.699297:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00080000:2.0:1789304743.699629:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304743.699715:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785684992:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789304744.269003:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967359 is committed 00010000:00010000:2.0:1789304744.274874:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304745.234447:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785685504:0@lo:400:kworker.0 00000100:00100000:2.0:1789304745.234532:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304745.234601:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304745.234607:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785685376:0@lo:400:kworker.0 00000100:00100000:2.0:1789304745.234631:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304745.234662:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785685504 00000100:00100000:2.0:1789304745.234670:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785685504 00000100:00100000:2.0:1789304745.234723:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561 00000100:00100000:2.0:1789304745.234732:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785685504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304745.234784:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785685504:12345-0@lo:400:kworker.0 Request processed in 53us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304745.234791:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1561 00000100:00080000:2.0:1789304745.234810:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304745.234838:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785685504:0@lo:400:kworker.0 00000100:00100000:0.0:1789304745.235244:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785685248:0@lo:400:kworker.0 00000100:00100000:0.0:1789304745.235301:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304745.235339:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785685760:0@lo:400:kworker.0 00000100:00100000:0.0:1789304745.235363:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304745.235407:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789304745.235413:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785685120:0@lo:400:kworker.0 00000100:00100000:0.0:1789304745.235440:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304745.235464:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785685632:0@lo:400:kworker.0 00000100:00100000:0.0:1789304745.235484:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304745.235508:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785685376 00000100:00100000:0.0:1789304745.235514:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785685376 00000100:00100000:0.0:1789304745.235548:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785685760 00000100:00100000:0.0:1789304745.235552:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785685760 00000100:00100000:0.0:1789304745.235573:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1789304745.235581:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785685376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304745.235625:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785685376:12345-0@lo:400:kworker.0 Request processed in 45us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304745.235631:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1789304745.235643:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1789304745.235649:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785685760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304745.235676:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785685760:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304745.235681:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1789304745.235697:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785685120 00000100:00100000:0.0:1789304745.235700:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785685120 00000100:00100000:0.0:1789304745.235720:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1789304745.235725:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785685120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304745.235751:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785685120:12345-0@lo:400:kworker.0 Request processed in 26us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304745.235756:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00080000:0.0:1789304745.235780:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304745.235782:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304745.235802:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785685376:0@lo:400:kworker.0 00000100:00100000:0.0:1789304745.235821:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785685120:0@lo:400:kworker.0 00000100:00100000:0.0:1789304745.235828:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:0.0:1789304745.235832:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c0361ad80, transno 4294967359 00000100:00100000:0.0:1789304745.235840:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785685760:0@lo:400:kworker.0 00000100:00100000:1.0:1789304745.236170:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785685248 00000100:00100000:1.0:1789304745.236175:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785685248 00000100:00100000:1.0:1789304745.236211:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785685632 00000100:00100000:1.0:1789304745.236214:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785685632 00000100:00100000:1.0:1789304745.236244:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:1.0:1789304745.236252:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785685248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304745.236306:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785685248:12345-0@lo:400:kworker.0 Request processed in 56us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304745.236313:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:1.0:1789304745.236327:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:1.0:1789304745.236333:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785685632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304745.236359:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785685632:12345-0@lo:400:kworker.0 Request processed in 27us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304745.236365:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00080000:1.0:1789304745.236384:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304745.236405:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785685632:0@lo:400:kworker.0 00000100:00100000:1.0:1789304745.236415:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785685248:0@lo:400:kworker.0 00010000:00010000:2.0:1789304745.299481:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304746.323030:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304747.348220:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304747.794858:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785685888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304747.794933:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304747.796429:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785685888 00000100:00100000:2.0:1789304747.796443:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785685888 00000100:00100000:2.0:1789304747.796571:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1789304747.796589:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785685888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304747.796630:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304747.796721:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785685888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304747.796728:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1789304747.796887:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785685888:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304747.798269:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304747.886925:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304747.887019:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304747.887077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304747.888722:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765611520 00000100:00100000:0.0:1789304747.888738:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765611520 00000100:00100000:0.0:1789304747.888827:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1564 00000100:00100000:0.0:1789304747.888839:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765611520:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304747.888931:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765611520:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 94us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304747.888939:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1564 00000100:00100000:0.0:1789304747.888966:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765611776 00000100:00100000:0.0:1789304747.888971:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765611776 00000100:00100000:0.0:1789304747.889001:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1183 00000100:00100000:0.0:1789304747.889008:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765611776:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304747.889033:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765611776:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304747.889039:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1183 00000100:00080000:3.0:1789304747.891865:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304747.891877:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304747.892253:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304747.892338:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765611648 00000100:00100000:1.0:1789304747.892349:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765611648 00000100:00100000:1.0:1789304747.892431:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1184 00000100:00100000:1.0:1789304747.892442:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765611648:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304747.892531:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765611648:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 90us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304747.892539:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1184 00000100:00080000:3.0:1789304747.892769:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304747.897641:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765611392 00000100:00100000:2.0:1789304747.897659:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765611392 00000100:00100000:2.0:1789304747.897731:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1246 00000100:00100000:2.0:1789304747.897754:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765611392:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304747.897850:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765611392:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 109us (10936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304747.897859:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1246 00010000:00010000:1.0:1789304748.370305:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304748.822772:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304748.822797:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785686016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304748.822865:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304748.822994:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785686016 00000100:00100000:1.0:1789304748.823004:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785686016 00000100:00100000:1.0:1789304748.823072:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1789304748.823081:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785686016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304748.823146:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304748.823197:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785686016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304748.823204:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1789304748.823267:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785686016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304748.823444:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304749.394289:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304750.355066:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785686144:0@lo:400:kworker.0 00000100:00100000:2.0:1789304750.355164:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304750.355294:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785686144 00000100:00100000:0.0:1789304750.355303:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785686144 00000100:00100000:1.0:1789304750.355354:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785686272:0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.355389:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304750.355449:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785686272 00000100:00100000:1.0:1789304750.355453:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785686272 00000100:00100000:1.0:1789304750.355501:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:1.0:1789304750.355509:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785686272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.355573:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785686272:12345-0@lo:400:kworker.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304750.355580:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:1.0:1789304750.355623:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785686272:0@lo:400:kworker.0 00000100:00100000:0.0:1789304750.355888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1789304750.355903:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785686144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.356873:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785686784:0@lo:400:kworker.0 00000100:00100000:3.0:1789304750.356879:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785686528:0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.356915:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304750.356923:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304750.356942:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304750.356943:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304750.356947:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785686656:0@lo:400:kworker.0 00000100:00100000:3.0:1789304750.356948:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785686400:0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.356970:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304750.356998:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785686528 00000100:00100000:1.0:1789304750.357004:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785686528 00000100:00100000:1.0:1789304750.357041:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785686656 00000100:00100000:1.0:1789304750.357044:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785686656 00000100:00100000:1.0:1789304750.357067:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:1.0:1789304750.357074:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785686528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.357127:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785686528:12345-0@lo:400:kworker.0 Request processed in 54us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304750.357133:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:1.0:1789304750.357148:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:1.0:1789304750.357154:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785686656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.357185:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785686656:12345-0@lo:400:kworker.0 Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304750.357191:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:1.0:1789304750.357236:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785686656:0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.357272:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785686784 00000100:00100000:1.0:1789304750.357275:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785686784 00000100:00100000:1.0:1789304750.357303:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1789304750.357309:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785686784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.357357:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785686784:12345-0@lo:400:kworker.0 Request processed in 48us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304750.357363:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1789304750.357392:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785686784:0@lo:400:kworker.0 00000100:00080000:1.0:1789304750.357422:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304750.357426:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304750.357634:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304750.357671:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785686528:0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.357696:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785686400 00000100:00100000:1.0:1789304750.357707:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785686400 00000100:00100000:1.0:1789304750.357749:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1789304750.357765:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785686400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304750.357801:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785686400:12345-0@lo:400:kworker.0 Request processed in 45us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304750.357806:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00080000:3.0:1789304750.358115:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304750.358137:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785686400:0@lo:400:kworker.0 00000100:00100000:0.0:1789304750.362112:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785686144:12345-0@lo:400:kworker.0 Request processed in 6185us (6923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304750.362128:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1789304750.363263:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785686144:0@lo:400:kworker.0 00010000:00010000:2.0:1789304750.418362:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304751.448791:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304752.466733:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304752.914590:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304752.914614:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785686912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304752.914686:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304752.914816:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785686912 00000100:00100000:0.0:1789304752.914825:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785686912 00000100:00100000:0.0:1789304752.914892:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1789304752.914903:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785686912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304752.914941:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304752.914993:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785686912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304752.915000:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1789304752.915048:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785686912:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304752.923395:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304752.994285:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304752.994330:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304752.994364:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304752.994426:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765612160 00000100:00100000:0.0:1789304752.994426:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304752.994441:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765612160 00000100:00100000:0.0:1789304752.994469:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765612288 00000100:00100000:0.0:1789304752.994475:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765612288 00000100:00100000:1.0:1789304752.994514:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1187 00000100:00100000:1.0:1789304752.994526:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765612160:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304752.994565:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765612032 00000100:00100000:2.0:1789304752.994571:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765612032 00000100:00100000:2.0:1789304752.994612:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1568 00000100:00100000:2.0:1789304752.994620:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765612032:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304752.994626:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765612160:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 100us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304752.994685:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765611904 00000100:00100000:3.0:1789304752.994690:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765611904 00000100:00100000:3.0:1789304752.994720:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1248 00000100:00100000:3.0:1789304752.994727:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765611904:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304752.994757:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765611904:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304752.994764:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1248 00000100:00100000:2.0:1789304752.994848:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765612032:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 228us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304752.994855:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1568 00000100:00100000:0.0:1789304752.998830:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1188 00000100:00100000:0.0:1789304752.998863:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765612288:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304752.998902:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1187 00000100:00100000:0.0:1789304752.998954:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765612288:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 110us (4527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304752.998963:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1188 00000100:00080000:1.0:1789304752.999916:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304752.999924:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304752.999928:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304753.490378:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304753.938361:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304753.938394:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785687040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304753.938476:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304753.939131:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785687040 00000100:00100000:1.0:1789304753.939142:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785687040 00000100:00100000:1.0:1789304753.939232:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1789304753.939244:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785687040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304753.939283:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304753.939350:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785687040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304753.939358:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1789304753.939411:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785687040:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304753.940168:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304754.519524:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304755.475970:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785687552:0@lo:400:kworker.0 00000100:00100000:3.0:1789304755.476046:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304755.476128:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304755.476134:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785687424:0@lo:400:kworker.0 00000100:00100000:3.0:1789304755.476173:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304755.476445:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785687168:0@lo:400:kworker.0 00000100:00100000:2.0:1789304755.476482:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304755.476515:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785687680:0@lo:400:kworker.0 00000100:00100000:2.0:1789304755.476536:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304755.476558:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789304755.476564:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785687296:0@lo:400:kworker.0 00000100:00100000:2.0:1789304755.476584:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304755.476612:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785687808:0@lo:400:kworker.0 00000100:00100000:2.0:1789304755.476632:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304755.476673:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785687424 00000100:00100000:2.0:1789304755.476681:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785687424 00000100:00100000:2.0:1789304755.476730:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785687808 00000100:00100000:2.0:1789304755.476733:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785687808 00000100:00100000:2.0:1789304755.476754:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1789304755.476764:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785687424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304755.476813:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785687424:12345-0@lo:400:kworker.0 Request processed in 50us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304755.476819:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1789304755.476837:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:2.0:1789304755.476843:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785687808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304755.476873:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785687808:12345-0@lo:400:kworker.0 Request processed in 31us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304755.476879:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00080000:2.0:1789304755.476900:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304755.476904:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304755.476928:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785687808:0@lo:400:kworker.0 00000100:00100000:0.0:1789304755.477107:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785687552 00000100:00100000:0.0:1789304755.477112:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785687552 00000100:00100000:0.0:1789304755.477148:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785687680 00000100:00100000:0.0:1789304755.477151:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785687680 00000100:00100000:0.0:1789304755.477181:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785687296 00000100:00100000:0.0:1789304755.477184:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785687296 00000100:00100000:0.0:1789304755.477199:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:0.0:1789304755.477206:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785687552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304755.477244:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785687552:12345-0@lo:400:kworker.0 Request processed in 39us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304755.477260:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000100:00100000:0.0:1789304755.477273:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:0.0:1789304755.477279:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785687680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304755.477321:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785687680:12345-0@lo:400:kworker.0 Request processed in 42us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304755.477327:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:0.0:1789304755.477338:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:0.0:1789304755.477343:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785687296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304755.477370:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785687296:12345-0@lo:400:kworker.0 Request processed in 27us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304755.477376:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1789304755.477542:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785687168 00000100:00100000:3.0:1789304755.477547:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785687168 00000100:00100000:3.0:1789304755.477585:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1789304755.477592:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785687168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304755.477626:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785687168:12345-0@lo:400:kworker.0 Request processed in 35us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304755.477632:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1789304755.477687:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785687424:0@lo:400:kworker.0 00000100:00100000:3.0:1789304755.477697:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785687552:0@lo:400:kworker.0 00000100:00080000:2.0:1789304755.477964:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304755.477985:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785687296:0@lo:400:kworker.0 00000100:00100000:2.0:1789304755.478006:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785687168:0@lo:400:kworker.0 00000100:00100000:2.0:1789304755.478015:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785687680:0@lo:400:kworker.0 00010000:00010000:0.0:1789304755.538266:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304756.562364:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304756.915521:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304756.915617:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765612416 00000100:00100000:0.0:1789304756.915628:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765612416 00000100:00100000:0.0:1789304756.915763:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1000 00000100:00100000:0.0:1789304756.915776:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:53184:x1876219765612416:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304756.915890:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:53184:x1876219765612416:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 116us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304756.915897:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1000 00000100:00080000:2.0:1789304756.915954:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304756.917966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304756.918071:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765612544 00000100:00100000:2.0:1789304756.918082:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765612544 00000100:00100000:2.0:1789304756.918215:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 543 00000100:00100000:2.0:1789304756.918225:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:53184:x1876219765612544:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304756.918664:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:53184:x1876219765612544:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 439us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304756.918673:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 543 00000100:00080000:3.0:1789304756.918843:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304756.920715:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304756.920873:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765612672 00000100:00100000:2.0:1789304756.920884:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765612672 00000100:00100000:2.0:1789304756.920956:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 544 00000100:00100000:2.0:1789304756.920967:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53184:x1876219765612672:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304756.921386:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53184:x1876219765612672:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 420us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304756.921394:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 544 00000100:00080000:3.0:1789304756.921689:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304756.929172:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304756.929327:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765612800 00000100:00100000:1.0:1789304756.929339:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765612800 00000100:00100000:1.0:1789304756.929404:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1001 00000100:00100000:1.0:1789304756.929416:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:53184:x1876219765612800:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304756.929850:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:53184:x1876219765612800:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 436us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304756.929859:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1001 00000100:00100000:3.0:1789304756.933578:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304756.933785:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765612928 00000100:00100000:1.0:1789304756.933799:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765612928 00000100:00100000:1.0:1789304756.933871:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1002 00000100:00100000:1.0:1789304756.933882:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53184:x1876219765612928:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304756.933993:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53184:x1876219765612928:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 113us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304756.934001:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1002 00000100:00100000:3.0:1789304756.939246:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304756.939350:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765613056 00000100:00100000:2.0:1789304756.939362:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765613056 00000100:00100000:2.0:1789304756.939426:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 545 00000100:00100000:2.0:1789304756.939436:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:53184:x1876219765613056:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304756.939831:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:53184:x1876219765613056:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 394us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304756.939839:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 545 00000100:00100000:3.0:1789304756.941854:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304756.941943:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765613184 00000100:00100000:2.0:1789304756.941952:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765613184 00000100:00100000:2.0:1789304756.942008:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 546 00000100:00100000:2.0:1789304756.942018:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53184:x1876219765613184:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304756.942491:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53184:x1876219765613184:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 474us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304756.942498:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 546 00000100:00100000:3.0:1789304756.950600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304756.950812:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765613312 00000100:00100000:0.0:1789304756.950822:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765613312 00000100:00100000:0.0:1789304756.950883:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1003 00000100:00100000:0.0:1789304756.950893:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:53184:x1876219765613312:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304756.951415:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:53184:x1876219765613312:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 521us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304756.951424:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1003 00010000:00010000:1.0:1789304757.586690:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304758.034625:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304758.034651:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785687936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304758.034723:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304758.034789:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785687936 00000100:00100000:1.0:1789304758.034797:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785687936 00000100:00100000:1.0:1789304758.034860:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1789304758.034870:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785687936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304758.034909:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304758.034956:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785687936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304758.034964:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00080000:1.0:1789304758.034983:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304758.035022:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785687936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304758.113696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304758.113777:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304758.113808:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304758.113831:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304758.113872:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765613696 00000100:00100000:3.0:1789304758.113882:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765613696 00000100:00100000:3.0:1789304758.114005:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765613824 00000100:00100000:3.0:1789304758.114009:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765613824 00000100:00100000:3.0:1789304758.114037:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1191 00000100:00100000:3.0:1789304758.114047:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765613696:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304758.114156:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765613696:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 110us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304758.114164:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1191 00000100:00100000:3.0:1789304758.114183:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1192 00000100:00100000:3.0:1789304758.114190:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765613824:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304758.114216:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765613824:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304758.114222:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1192 00000100:00080000:3.0:1789304758.114238:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304758.114242:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304758.119543:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765613440 00000100:00100000:0.0:1789304758.119558:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765613440 00000100:00100000:0.0:1789304758.119729:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1250 00000100:00100000:0.0:1789304758.119741:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765613440:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304758.119835:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765613440:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 97us (6146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304758.119842:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1250 00000100:00100000:2.0:1789304758.122450:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765613568 00000100:00100000:2.0:1789304758.122463:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765613568 00000100:00100000:2.0:1789304758.122565:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1572 00000100:00100000:2.0:1789304758.122574:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765613568:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:1.0:1789304758.122697:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304758.122940:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765613568:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 102us (8866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304758.122951:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1572 00010000:00010000:0.0:1789304758.611227:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304759.058290:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304759.058317:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785688064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304759.058394:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304759.058485:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785688064 00000100:00100000:1.0:1789304759.058496:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785688064 00000100:00100000:1.0:1789304759.058566:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00080000:0.0:1789304759.058573:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304759.058577:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785688064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304759.058616:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304759.058663:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785688064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304759.058671:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:0.0:1789304759.058856:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785688064:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1789304759.480324:0:90291:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdbb99d6e0 20000000:00000080:2.0:1789304759.480343:0:90291:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f662000 uarg=0000000000000000 00010000:00010000:2.0:1789304759.480841:0:90291:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789304759.480877:0:90291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:2.0:1789304759.480882:0:90291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304759.480894:0:90291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006a5 expref: 5 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304759.480916:0:90291:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789304759.480933:0:90291:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304759.480947:0:90291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304759.480959:0:90291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb200/0xefc0bb7231296f03 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296efc expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304759.480967:0:90291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304759.481003:0:90291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb200/0xefc0bb7231296f03 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296efc expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304759.481023:0:90291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afb200/0xefc0bb7231296f03 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296efc expref: 18 pid: 5845 timeout: 2359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304759.481037:0:90291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90291:1876219785688192:0@lo:104: 00000100:00100000:2.0:1789304759.481154:0:90291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304759.481210:0:90291:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38835e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789304759.481254:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785688192 00000100:00100000:1.0:1789304759.481262:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785688192 00000100:00100000:1.0:1789304759.481322:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789304759.481333:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:90291:x1876219785688192:12345-0@lo:104: 00010000:00010000:1.0:1789304759.481348:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304759.481416:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304759.481422:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:90291:x1876219785688192:12345-0@lo:104: Request processed in 92us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304759.481428:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00010000:3.0:1789304759.481491:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304759.481498:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304759.481511:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371e00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304759.481515:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304759.481524:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304759.481530:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304759.481535:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304759.481574:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304759.481580:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304759.481604:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304759.481610:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231296efc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296f03 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304759.481625:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304759.481627:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304759.481628:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304759.481636:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304759.481645:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785688320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304759.481689:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304759.481819:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785688320 00000100:00100000:0.0:1789304759.481824:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785688320 00010000:00010000:0.0:1789304759.481849:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb200/0xefc0bb7231296f03 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296efc expref: 19 pid: 5845 timeout: 2359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304759.481878:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1789304759.481885:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785688320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304759.481896:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304759.481901:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb200/0xefc0bb7231296f03 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296efc expref: 19 pid: 5845 timeout: 2359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.481915:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb200/0xefc0bb7231296f03 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296efc expref: 19 pid: 5845 timeout: 2359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.481929:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.481936:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.481949:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.481956:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.481962:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.481968:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.481972:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecde00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304759.481976:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.481983:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.481990:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304759.482001:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304759.482033:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785688320:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304759.482039:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1789304759.482076:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785688320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304759.485704:0:90291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb200/0xefc0bb7231296f03 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296efc expref: 18 pid: 5845 timeout: 2359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304759.485727:0:90291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90291:1876219785688192:0@lo:104: 00010000:00010000:2.0:1789304759.485755:0:90291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304759.485766:0:90291:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304759.485772:0:90291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304759.485778:0:90291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231296f7a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304759.639360:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304760.595077:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785688576:0@lo:400:kworker.0 00000100:00100000:1.0:1789304760.595187:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304760.595282:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304760.595297:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785688448:0@lo:400:kworker.0 00000100:00100000:2.0:1789304760.595334:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304760.595379:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785688576 00000100:00100000:2.0:1789304760.595387:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785688576 00000100:00100000:2.0:1789304760.595434:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:2.0:1789304760.595444:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785688576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304760.597646:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785688576:12345-0@lo:400:kworker.0 Request processed in 2196us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304760.597661:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00100000:2.0:1789304760.597708:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785688448 00000100:00100000:2.0:1789304760.597716:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785688448 00000100:00100000:2.0:1789304760.597781:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1789304760.597789:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785688448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304760.597873:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785688448:12345-0@lo:400:kworker.0 Request processed in 75us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304760.597880:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1789304760.597919:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785688704:0@lo:400:kworker.0 00000100:00100000:2.0:1789304760.597950:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304760.598009:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785688448:0@lo:400:kworker.0 00000100:00100000:0.0:1789304760.598204:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785688704 00000100:00100000:0.0:1789304760.598209:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785688704 00000100:00100000:0.0:1789304760.598248:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1789304760.598255:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785688704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304760.598294:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785688704:12345-0@lo:400:kworker.0 Request processed in 40us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304760.598300:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1789304760.598332:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785688704:0@lo:400:kworker.0 00000100:00100000:2.0:1789304760.598772:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785688832:0@lo:400:kworker.0 00000100:00100000:2.0:1789304760.598819:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304760.598873:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785688832 00000100:00100000:2.0:1789304760.598878:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785688832 00000100:00100000:2.0:1789304760.598912:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:2.0:1789304760.598919:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785688832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304760.598953:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785688832:12345-0@lo:400:kworker.0 Request processed in 35us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304760.598958:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00080000:2.0:1789304760.598973:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304760.598994:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785688832:0@lo:400:kworker.0 00000100:00100000:1.0:1789304760.599349:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785688576:0@lo:400:kworker.0 00000100:00100000:3.0:1789304760.599476:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304760.599486:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785689088:0@lo:400:kworker.0 00000100:00100000:2.0:1789304760.599486:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785688960:0@lo:400:kworker.0 00000100:00100000:3.0:1789304760.599513:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304760.599513:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304760.599820:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785689088 00000100:00100000:3.0:1789304760.599825:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785689088 00000100:00100000:3.0:1789304760.599972:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:3.0:1789304760.599980:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785689088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304760.601791:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785688960 00000100:00100000:2.0:1789304760.601918:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785688960 00000100:00100000:3.0:1789304760.603962:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785689088:12345-0@lo:400:kworker.0 Request processed in 3976us (4440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304760.603976:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:3.0:1789304760.604041:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785689088:0@lo:400:kworker.0 00000100:00080000:1.0:1789304760.604149:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304760.604155:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304760.607475:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:2.0:1789304760.607490:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785688960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304760.607587:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785688960:12345-0@lo:400:kworker.0 Request processed in 101us (8073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304760.607595:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:2.0:1789304760.607650:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785688960:0@lo:400:kworker.0 00010000:00010000:0.0:1789304760.658334:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304761.173988:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304761.173996:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304761.174001:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304761.174599:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304761.174612:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304761.174624:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304761.174650:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785689216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304761.174721:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304761.174781:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16480 going to sleep for 11 seconds 00000100:00100000:0.0:1789304761.176011:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785689216 00000100:00100000:0.0:1789304761.176033:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785689216 00000100:00100000:0.0:1789304761.176122:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1789304761.176134:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785689216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304761.176150:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304761.176294:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296f88 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296f81 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304761.176322:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296f88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296f81 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304761.176334:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296f88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296f81 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304761.176344:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afae00, rc 0) 00000100:00100000:0.0:1789304761.176407:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785689216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 275us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304761.176413:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1789304761.176493:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785689216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304761.176510:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304761.176519:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304761.176540:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304761.176545:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304761.176553:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304761.685717:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304762.244613:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304762.244737:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765613952 00000100:00100000:2.0:1789304762.244748:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765613952 00000100:00100000:2.0:1789304762.244831:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1004 00000100:00100000:2.0:1789304762.244843:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53280:x1876219765613952:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304762.244882:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304762.244912:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006ba expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304762.244979:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296f96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304762.244994:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304762.245008:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304762.245041:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:2.0:1789304762.245045:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304762.245065:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304762.245180:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231296f8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006ba expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304762.245203:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296f96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006ba expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304762.245213:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304762.245216:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304762.245220:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00080000:1.0:1789304762.245402:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304762.245499:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:53280:x1876219765613952:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 657us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304762.245515:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1004 00000100:00100000:3.0:1789304762.254508:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304762.254598:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765614208 00000100:00100000:0.0:1789304762.254608:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765614208 00000100:00100000:0.0:1789304762.254669:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1005 00000100:00100000:0.0:1789304762.254679:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53280:x1876219765614208:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304762.254727:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304762.254752:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231296f96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006ba expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304762.254773:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231296f26) 00010000:00010000:0.0:1789304762.254778:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:0.0:1789304762.254789:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304762.254814:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304762.254825:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304762.254835:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789304762.308382:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967681 is committed 00000004:00010000:0.0:1789304762.308433:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003dc6132 reply state 0000000021466909 transno 4294967681 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304762.308447:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304762.308461:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00080000:0.0:1789304762.308551:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789304762.308567:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53280:x1876219765614208:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 53886us (54066us total) trans 4294967681 rc 0/0 00000100:00100000:0.0:1789304762.308577:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1005 00010000:00010000:0.0:1789304762.309065:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304762.309077:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304762.309085:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304762.309123:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304762.309128:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304762.309137:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304762.309532:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:0.0:1789304762.309536:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304762.309542:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304762.309549:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231296f9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304762.710387:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304763.070919:0:90488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd7a1cc20 20000000:00000080:0.0:1789304763.070935:0:90488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e7ac00 uarg=0000000000000000 00010000:00010000:0.0:1789304763.072057:0:90488:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304763.072088:0:90488:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304763.072128:0:90488:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304763.072149:0:90488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304763.072168:0:90488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296f88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296f81 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304763.072185:0:90488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304763.072227:0:90488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296f88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296f81 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304763.072242:0:90488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296f88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296f81 expref: 18 pid: 5845 timeout: 2362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304763.072257:0:90488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90488:1876219785689344:0@lo:104: 00000100:00100000:0.0:1789304763.072321:0:90488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304763.072369:0:90488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16240 going to sleep for 11 seconds 00000100:00100000:1.0:1789304763.072619:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785689344 00000100:00100000:1.0:1789304763.072626:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785689344 00000100:00100000:1.0:1789304763.072682:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1789304763.072692:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:90488:x1876219785689344:12345-0@lo:104: 00010000:00010000:1.0:1789304763.072706:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304763.072774:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304763.072781:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:90488:x1876219785689344:12345-0@lo:104: Request processed in 91us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304763.072787:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789304763.072900:0:90488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90488:1876219785689344:0@lo:104: 00010000:00010000:0.0:1789304763.072918:0:90488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.072990:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304763.072998:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073005:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304763.073009:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073018:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304763.073025:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304763.073030:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304763.073066:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073073:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304763.073129:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073136:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f800/0xefc0bb7231296f81 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296f88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304763.073156:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785689472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304763.073161:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304763.073163:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304763.073164:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304763.073201:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304763.073436:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785689472 00000100:00100000:2.0:1789304763.073442:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785689472 00010000:00010000:2.0:1789304763.073463:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296f88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296f81 expref: 19 pid: 5845 timeout: 2362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304763.073492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1789304763.073499:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785689472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304763.073510:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304763.073514:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296f88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296f81 expref: 19 pid: 5845 timeout: 2362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073524:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296f88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296f81 expref: 19 pid: 5845 timeout: 2362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073537:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afae00/0xefc0bb7231296f88 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296f81 expref: 19 pid: 5845 timeout: 2362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073549:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073558:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073573:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073580:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073587:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073603:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073608:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304763.073612:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073619:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073637:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304763.073645:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304763.073672:0:90488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304763.073680:0:90488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304763.073683:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785689472:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (482us total) trans 0 rc 0/0 00010000:00010000:0.0:1789304763.073687:0:90488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa400/0xefc0bb7231296fa4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304763.073690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1789304763.074283:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785689472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304763.154257:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785689600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304763.154326:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304763.154417:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785689600 00000100:00100000:2.0:1789304763.154426:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785689600 00000100:00100000:2.0:1789304763.154489:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1789304763.154499:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785689600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304763.154534:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304763.154566:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304763.154583:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785689600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304763.154605:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1789304763.154655:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785689600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304763.240432:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304763.240483:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304763.240512:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765614720 00000100:00100000:2.0:1789304763.240521:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765614720 00000100:00100000:2.0:1789304763.240581:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1195 00000100:00100000:2.0:1789304763.240591:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765614720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304763.240666:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765614720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304763.240674:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1195 00000100:00080000:2.0:1789304763.240694:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304763.240730:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304763.240970:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765614464 00000100:00100000:0.0:1789304763.240976:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765614464 00000100:00100000:0.0:1789304763.241011:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1576 00000100:00100000:0.0:1789304763.241018:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765614464:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304763.241051:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765614464:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304763.241057:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1576 00000100:00100000:2.0:1789304763.241701:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304763.241783:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765614336 00000100:00100000:2.0:1789304763.241788:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765614336 00000100:00100000:2.0:1789304763.241816:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1253 00000100:00100000:2.0:1789304763.241824:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765614336:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304763.241860:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765614336:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304763.241871:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1253 00000100:00100000:0.0:1789304763.246642:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765614592 00000100:00100000:0.0:1789304763.246661:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765614592 00000100:00100000:0.0:1789304763.246753:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1196 00000100:00100000:0.0:1789304763.246765:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765614592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304763.246857:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765614592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 95us (5159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304763.246865:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1196 00000100:00080000:1.0:1789304763.248285:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304763.730272:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304764.178408:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785689728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304764.178468:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304764.178521:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785689728 00000100:00100000:0.0:1789304764.178530:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785689728 00000100:00080000:1.0:1789304764.178577:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304764.178590:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1789304764.178599:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785689728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304764.178654:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304764.178803:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785689728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304764.178808:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:3.0:1789304764.178866:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04017100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785689728:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1789304764.499160:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304764.499168:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304764.499173:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304764.499233:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304764.499246:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304764.499258:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304764.499284:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785689856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304764.499358:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304764.499420:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13d743c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304764.499647:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785689856 00000100:00100000:3.0:1789304764.499657:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785689856 00000100:00100000:3.0:1789304764.499763:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1789304764.499774:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785689856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304764.499789:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304764.499804:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231296fb2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231296fab expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304764.499827:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231296fb2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231296fab expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304764.499838:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231296fb2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296fab expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304764.499846:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304764.499908:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785689856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304764.499916:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1789304764.499989:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785689856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304764.500004:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304764.500017:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304764.500036:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304764.500041:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304764.500048:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304764.758210:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304765.698053:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304765.699208:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765614848 00000100:00100000:3.0:1789304765.699223:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765614848 00000100:00100000:3.0:1789304765.699708:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1006 00000100:00100000:3.0:1789304765.699721:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53356:x1876219765614848:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304765.699745:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304765.699770:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296fb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006c1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.699839:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296fc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.699854:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.699867:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.699882:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296fc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.699889:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.699896:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700668:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296fce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700682:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700691:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304765.700719:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:3.0:1789304765.700724:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304765.700748:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700764:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700771:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296fc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700779:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700785:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304765.700790:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700798:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296fc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700810:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304765.700819:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304765.700825:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700832:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231296fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700843:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700850:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296fc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700861:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700866:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304765.700869:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700875:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700883:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304765.700886:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304765.700889:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296fc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.700895:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231296fc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.701508:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231296fb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006c1 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.701529:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296fce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006c1 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.701534:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304765.701536:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00000100:00080000:1.0:1789304765.701537:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304765.701538:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304765.701611:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:53356:x1876219765614848:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 1891us (3564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304765.701622:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1006 00000100:00100000:1.0:1789304765.705723:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304765.707981:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765615104 00000100:00100000:3.0:1789304765.707997:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765615104 00000100:00100000:3.0:1789304765.708082:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1007 00000100:00100000:3.0:1789304765.708111:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53356:x1876219765615104:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304765.708132:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304765.708154:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296fd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006c8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.708409:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296fdc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.708425:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296fdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.708435:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296fdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.708445:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.708450:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.708454:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304765.708988:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20:0x0], index 0: 0 00010000:00010000:3.0:1789304765.713840:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296fea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.713865:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.713877:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.713915:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296fdc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.714630:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296fdc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.714638:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296fdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.714645:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304765.714650:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296fdc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.714659:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296fdc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.714675:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:3.0:1789304765.714678:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304765.714683:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296fdc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.714690:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231296fdc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304765.714708:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abd0c238 reply state 00000000562e9b35 transno 4294967682 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304765.714718:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304765.714765:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296fd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006c8 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.714781:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006c8 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.714788:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304765.714790:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304765.714792:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304765.714870:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:53356:x1876219765615104:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 6778us (9157us total) trans 4294967682 rc 0/0 00000100:00100000:3.0:1789304765.714878:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1007 00010000:00010000:1.0:1789304765.716801:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.716818:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.716826:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.716831:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304765.716836:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.716843:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.716857:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c2ea19800) 00010000:00010000:1.0:1789304765.716860:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304765.716865:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.716871:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231296fe3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304765.717493:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785689984:0@lo:400:kworker.0 00000100:00100000:1.0:1789304765.717555:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304765.717660:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785690112:0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.717694:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304765.717775:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785690240:0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.717801:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304765.717833:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785690240 00000100:00100000:2.0:1789304765.717841:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785690240 00000100:00100000:2.0:1789304765.717883:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1789304765.717890:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785690240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.717940:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785690240:12345-0@lo:400:kworker.0 Request processed in 50us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304765.717946:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1789304765.717988:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785690240:0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.718025:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785690368:0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.718049:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304765.718109:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785690112 00000100:00100000:2.0:1789304765.718117:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785690112 00000100:00100000:2.0:1789304765.718142:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785690368 00000100:00100000:2.0:1789304765.718144:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785690368 00000100:00100000:2.0:1789304765.718171:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1577 00000100:00100000:2.0:1789304765.718177:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785690112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.718212:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785690112:12345-0@lo:400:kworker.0 Request processed in 35us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304765.718219:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1577 00000100:00100000:2.0:1789304765.718230:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1789304765.718236:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785690368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.718265:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785690368:12345-0@lo:400:kworker.0 Request processed in 29us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304765.718283:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00080000:2.0:1789304765.718299:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304765.718319:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785690368:0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.718343:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785690112:0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.718374:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304765.718379:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785690496:0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.718402:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304765.718436:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785690624:0@lo:400:kworker.0 00000100:00100000:2.0:1789304765.718456:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304765.718655:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785690496 00000100:00100000:3.0:1789304765.718660:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785690496 00000100:00100000:3.0:1789304765.718700:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1789304765.718706:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785690496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304765.718743:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785690496:12345-0@lo:400:kworker.0 Request processed in 37us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304765.718748:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00080000:2.0:1789304765.718906:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304765.718925:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785690496:0@lo:400:kworker.0 00000100:00100000:1.0:1789304765.719209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304765.719535:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765615360 00000100:00100000:2.0:1789304765.719541:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765615360 00000100:00100000:2.0:1789304765.719570:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1008 00000100:00100000:2.0:1789304765.719577:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:53356:x1876219765615360:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:2.0:1789304765.719625:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304765.719651:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231296fea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006c8 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.719667:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:2.0:1789304765.719678:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304765.719728:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.719744:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.719755:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304765.719881:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000998c487b reply state 00000000cf955c6d transno 4294967683 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304765.719891:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304765.720009:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:53356:x1876219765615360:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 431us (802us total) trans 4294967683 rc 0/0 00000100:00100000:2.0:1789304765.720017:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1008 00000100:00100000:0.0:1789304765.720370:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785689984 00000100:00100000:0.0:1789304765.720384:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785689984 00000100:00100000:0.0:1789304765.720414:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1789304765.720421:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785689984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304765.720635:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785689984:12345-0@lo:400:kworker.0 Request processed in 215us (3081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304765.720643:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1789304765.720680:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785690624 00000100:00100000:0.0:1789304765.720684:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785690624 00000100:00100000:0.0:1789304765.720725:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1789304765.720731:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785690624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304765.720768:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785690624:12345-0@lo:400:kworker.0 Request processed in 37us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304765.720775:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1789304765.720815:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785690624:0@lo:400:kworker.0 00000100:00080000:2.0:1789304765.720893:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304765.721427:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785689984:0@lo:400:kworker.0 00010000:00010000:0.0:1789304765.722673:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.722686:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.722692:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.722696:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304765.722700:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.722705:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.722720:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:0.0:1789304765.722722:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304765.722727:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.722731:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231296ff8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304765.726867:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304765.726989:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765615488 00000100:00100000:3.0:1789304765.727006:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765615488 00000100:00100000:3.0:1789304765.727427:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1009 00000100:00100000:3.0:1789304765.727443:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:53356:x1876219765615488:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304765.727472:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304765.727507:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296fff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006cf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.727621:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296fff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006cf expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.727646:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296fff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006cf expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.727680:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304765.727687:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789304765.727694:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f400, rc 0) 00000100:00100000:3.0:1789304765.727782:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:53356:x1876219765615488:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 344us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304765.727788:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1009 00000100:00100000:2.0:1789304765.731502:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304765.731605:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765615616 00000100:00100000:0.0:1789304765.731616:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765615616 00000100:00100000:0.0:1789304765.731726:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 547 00000100:00100000:0.0:1789304765.731738:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765615616:12345-192.168.202.29@tcp:2:touch.60003 00000100:00100000:0.0:1789304765.732454:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765615616:12345-192.168.202.29@tcp:2:touch.60003 Request processed in 715us (958us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789304765.732467:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 547 00000100:00080000:2.0:1789304765.732542:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304765.735675:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304765.735855:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765615872 00000100:00100000:0.0:1789304765.735865:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765615872 00000100:00100000:0.0:1789304765.739593:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 102 00000100:00100000:2.0:1789304765.739786:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:53356:x1876219765615872:12345-192.168.202.29@tcp:35:touch.60003 00000100:00100000:2.0:1789304765.740177:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:53356:x1876219765615872:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 564us (4510us total) trans 4294967684 rc 0/0 00000100:00100000:2.0:1789304765.740185:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 102 00010000:00010000:2.0:1789304765.778786:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304765.789188:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304765.789302:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765616000 00000100:00100000:2.0:1789304765.789313:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765616000 00000100:00100000:2.0:1789304765.789371:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1010 00000100:00100000:2.0:1789304765.789382:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:53360:x1876219765616000:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:2.0:1789304765.789409:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304765.789433:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006d6 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789499:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129700d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789514:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129700d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789525:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129700d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789539:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789545:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789551:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789638:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129701b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789646:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129701b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789653:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129701b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304765.789683:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 0 00000004:00200000:2.0:1789304765.789687:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304765.789705:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129701b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789716:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129701b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789724:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129700d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789730:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129700d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789737:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129700d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789742:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304765.789746:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129700d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789753:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129700d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789763:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:2.0:1789304765.789766:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304765.789770:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129700d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789776:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb723129700d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789788:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789798:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789804:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789810:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304765.789813:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789818:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789825:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304765.789827:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304765.789830:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789836:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789864:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006d6 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789878:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129701b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006d6 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304765.789885:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:2.0:1789304765.789887:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304765.789890:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789304765.789958:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:53360:x1876219765616000:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 578us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304765.789965:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1010 00000100:00100000:3.0:1789304765.797551:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304765.797637:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765616128 00000100:00100000:0.0:1789304765.797648:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765616128 00000100:00100000:0.0:1789304765.797707:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 548 00000100:00100000:0.0:1789304765.797718:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765616128:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:0.0:1789304765.797747:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304765.797769:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297022 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006dd expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304765.797796:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x6aa69fbd, atime: 0x6aa69fbd, ctime: 0x6aa69fbd, blocks: 0x1 00010000:00010000:0.0:1789304765.797819:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=2215s v=(0 0) 00010000:00010000:0.0:1789304765.797824:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304765.797833:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006dd expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.797854:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006dd expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.797868:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789304765.797929:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765616128:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 214us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304765.797936:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 548 00000100:00100000:1.0:1789304765.809306:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304765.809416:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765616384 00000100:00100000:0.0:1789304765.809427:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765616384 00000100:00100000:0.0:1789304765.809485:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1011 00000100:00100000:0.0:1789304765.809495:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:53360:x1876219765616384:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:0.0:1789304765.809546:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304765.809572:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129701b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006d6 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.809594:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231296fff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006cf expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.809605:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:0.0:1789304765.809615:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304765.809647:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297029 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.809661:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.809670:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.809685:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.809692:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.809698:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.809791:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297037 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.809799:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.809806:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789304765.810425:0:30980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].32, 64 off10240 00000004:00080000:0.0:1789304765.810435:0:30980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2215488343841ns, next at 2216488341944ns, rc = 0 00010000:00010000:0.0:1789304765.810486:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810496:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810505:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810512:0:30980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810519:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810525:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810540:0:30980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789304765.810557:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810563:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297037 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810570:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297037 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810577:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304765.810581:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297037 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810587:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297037 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810596:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:0.0:1789304765.810598:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789304765.810602:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297037 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810608:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297037 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810621:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810628:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297029 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810633:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297029 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810638:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304765.810640:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297029 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810650:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297029 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810657:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:0.0:1789304765.810660:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304765.810663:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297029 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304765.810668:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297029 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304765.810676:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011a63801 reply state 000000005c810f8a transno 4294967685 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304765.810683:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304765.810755:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:53360:x1876219765616384:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 1259us (1458us total) trans 4294967685 rc 0/0 00000100:00100000:0.0:1789304765.810763:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1011 00010000:00010000:3.0:1789304765.814646:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.814664:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.814673:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.814679:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304765.814685:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.814693:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.814709:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c0558db00) 00010000:00010000:3.0:1789304765.814711:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304765.814716:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304765.814723:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297030 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.815446:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304765.815455:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.815463:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304765.815467:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.815474:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.815484:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:1.0:1789304765.815487:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304765.815490:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.815495:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129703e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304765.815511:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304765.815512:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304765.815514:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304766.802262:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304767.291011:0:90732:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde1672300 20000000:00000080:1.0:1789304767.291030:0:90732:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36f56000 uarg=0000000000000000 00010000:00010000:1.0:1789304767.291461:0:90732:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304767.291497:0:90732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:1.0:1789304767.291501:0:90732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304767.291513:0:90732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231296fce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006c1 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.291543:0:90732:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304767.291560:0:90732:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304767.291576:0:90732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.291589:0:90732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231296fb2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231296fab expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.291596:0:90732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.291634:0:90732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231296fb2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231296fab expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.291649:0:90732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231296fb2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231296fab expref: 18 pid: 5846 timeout: 2366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304767.291663:0:90732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90732:1876219785690752:0@lo:104: 00000100:00100000:1.0:1789304767.291724:0:90732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304767.291826:0:90732:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05a08000 going to sleep for 11 seconds 00000100:00100000:2.0:1789304767.291873:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785690752 00000100:00100000:2.0:1789304767.291881:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785690752 00000100:00100000:2.0:1789304767.291963:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789304767.291974:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:90732:x1876219785690752:12345-0@lo:104: 00010000:00010000:2.0:1789304767.291988:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304767.292065:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304767.292071:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:90732:x1876219785690752:12345-0@lo:104: Request processed in 100us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304767.292077:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:3.0:1789304767.292154:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304767.292161:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292169:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304767.292173:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292182:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304767.292189:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304767.292195:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304767.292226:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292237:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304767.292257:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292262:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231296fab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231296fb2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292276:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304767.292278:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304767.292280:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304767.292364:0:90732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90732:1876219785690752:0@lo:104: 00010000:00010000:0.0:1789304767.292383:0:90732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304767.292421:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785690880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304767.292453:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304767.292527:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785690880 00000100:00100000:3.0:1789304767.292532:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785690880 00010000:00010000:3.0:1789304767.292552:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231296fb2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296fab expref: 19 pid: 5846 timeout: 2366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304767.292581:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1789304767.292589:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785690880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304767.292600:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304767.292604:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231296fb2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231296fab expref: 19 pid: 5846 timeout: 2366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292614:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231296fb2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231296fab expref: 19 pid: 5846 timeout: 2366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292625:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231296fb2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231296fab expref: 19 pid: 5846 timeout: 2366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292636:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292649:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292662:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292669:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292676:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292683:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292689:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304767.292693:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292700:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292710:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304767.292720:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304767.292756:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785690880:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304767.292763:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1789304767.292790:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785690880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304767.292843:0:90732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304767.292851:0:90732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304767.292857:0:90732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297045 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.828233:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304767.842698:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967685 is committed 00000004:00080000:0.0:1789304767.842709:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 83 committed 00000100:00100000:0.0:1789304767.842864:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785691008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304767.842936:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304767.843834:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785691008 00000100:00100000:1.0:1789304767.843856:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785691008 00000100:00100000:1.0:1789304767.843931:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1789304767.843943:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785691008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789304767.843978:0:17212:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:32 count 1 00010000:00010000:1.0:1789304767.844009:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.844043:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297022 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006dd expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.844064:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789304767.844071:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304767.844077:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.844312:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006dd expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.844330:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297022 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006dd expref: 6 pid: 6692 timeout: 2317 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304767.844411:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785691136:192.168.202.29@tcp:104: 00000100:00100000:1.0:1789304767.844488:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c038539c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789304767.846034:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304767.848650:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304767.848798:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785691136:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304767.848830:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304767.848986:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765616512 00000100:00100000:1.0:1789304767.848994:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765616512 00010000:00010000:1.0:1789304767.849119:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297022 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006dd expref: 7 pid: 6692 timeout: 2317 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304767.849154:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 412 00000100:00100000:1.0:1789304767.849163:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765616512:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304767.849177:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304767.849184:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297022 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006dd expref: 7 pid: 6692 timeout: 2317 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.849197:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006dd expref: 7 pid: 6692 timeout: 2317 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.849223:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297022 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006dd expref: 7 pid: 6692 timeout: 2317 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.849239:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304767.849243:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304767.849249:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.849259:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.849282:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304767.849333:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765616512:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 171us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304767.849349:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 412 00010000:00010000:1.0:1789304767.849375:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.849383:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.849399:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.849407:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.849425:0:17212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789304767.849970:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785691008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6029us (7031us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1789304767.849979:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00010000:00010000:1.0:1789304767.850004:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304767.850011:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.850020:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304767.850025:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.850035:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.850060:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.850068:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b07ff582/0xefc0bb723129704c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304767.850112:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304767.850114:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304767.850116:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304767.850147:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c36e84e00/2, rc 0, transno 4294967361 00000100:00100000:1.0:1789304767.850153:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785691008:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1789304767.853139:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304768.275700:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785691264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304768.275775:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304768.275905:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785691264 00000100:00100000:2.0:1789304768.275914:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785691264 00000100:00100000:2.0:1789304768.276032:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:2.0:1789304768.276056:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785691264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304768.276124:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304768.276174:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785691264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304768.276182:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:2.0:1789304768.276228:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785691264:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789304768.276460:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304768.353416:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304768.353519:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304768.353568:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304768.353607:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304768.353654:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765616896 00000100:00100000:0.0:1789304768.353665:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765616896 00000100:00100000:0.0:1789304768.353728:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765617024 00000100:00100000:0.0:1789304768.353732:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765617024 00000100:00100000:0.0:1789304768.353764:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1199 00000100:00100000:0.0:1789304768.353774:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765616896:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304768.353857:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765616896:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304768.353864:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1199 00000100:00100000:0.0:1789304768.353891:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1200 00000100:00100000:0.0:1789304768.353898:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765617024:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304768.354145:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765617024:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 246us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304768.354156:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1200 00000100:00100000:2.0:1789304768.354414:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765616768 00000100:00100000:2.0:1789304768.354420:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765616768 00000100:00100000:2.0:1789304768.354463:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1580 00000100:00100000:2.0:1789304768.354470:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765616768:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304768.354524:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765616768:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 56us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304768.354531:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1580 00000100:00080000:1.0:1789304768.354689:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304768.354696:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304768.356305:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765616640 00000100:00100000:3.0:1789304768.356319:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765616640 00000100:00100000:2.0:1789304768.356841:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1256 00000100:00100000:2.0:1789304768.359134:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765616640:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304768.359229:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765616640:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 123us (5825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304768.359238:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1256 00010000:00010000:3.0:1789304768.850940:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304769.237367:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304769.237375:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304769.237380:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304769.237431:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304769.237444:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304769.237456:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304769.237481:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785691392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304769.237549:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304769.237665:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c11b8b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789304769.240940:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785691392 00000100:00100000:2.0:1789304769.240954:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785691392 00000100:00100000:2.0:1789304769.241102:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1789304769.241113:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785691392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304769.241130:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304769.241157:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc000/0xefc0bb723129705a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297053 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304769.241188:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc000/0xefc0bb723129705a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297053 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304769.241201:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb723129705a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297053 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304769.241211:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789304769.241326:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785691392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (3777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304769.241334:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1789304769.241442:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785691392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304769.241463:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304769.241473:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304769.241497:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304769.241503:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304769.241511:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304769.299347:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304769.299369:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785691520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304769.299433:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304769.299477:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785691520 00000100:00100000:1.0:1789304769.299485:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785691520 00000100:00100000:1.0:1789304769.299532:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1789304769.299541:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785691520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304769.299573:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304769.299611:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785691520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304769.299618:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00080000:1.0:1789304769.299635:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304769.299667:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785691520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304769.878277:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304769.896877:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00000001:00080000:3.0:1789304769.896899:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00000100:00100000:0.0:1789304770.108521:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304770.108642:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765617152 00000100:00100000:3.0:1789304770.108653:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765617152 00000100:00100000:3.0:1789304770.108740:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1012 00000100:00100000:3.0:1789304770.108751:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53448:x1876219765617152:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304770.108771:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304770.108794:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297061 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006e4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304770.108858:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297068 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304770.108872:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304770.108885:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304770.108919:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:3.0:1789304770.108923:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304770.108942:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304770.108967:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006e4 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304770.109002:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006e4 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304770.109011:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304770.109014:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304770.109018:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304770.109140:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:53448:x1876219765617152:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 391us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304770.109147:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1012 00000100:00080000:1.0:1789304770.109358:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304770.112267:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304770.112366:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765617408 00000100:00100000:3.0:1789304770.112377:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765617408 00000100:00100000:3.0:1789304770.112431:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1013 00000100:00100000:3.0:1789304770.112453:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53448:x1876219765617408:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304770.112511:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304770.112535:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297068 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006e4 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304770.112549:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231296fce) 00010000:00010000:3.0:1789304770.112552:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304770.112562:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304770.112583:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304770.112595:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304770.112601:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789304770.145339:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967686 is committed 00000004:00010000:3.0:1789304770.145428:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000410ead7c reply state 0000000044c28d3f transno 4294967686 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304770.145445:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304770.145463:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00080000:3.0:1789304770.145569:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304770.145591:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53448:x1876219765617408:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 33147us (33330us total) trans 4294967686 rc 0/0 00000100:00100000:3.0:1789304770.145599:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1013 00010000:00010000:2.0:1789304770.145970:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.145981:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.145989:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.145995:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304770.146000:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.146007:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.146034:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:2.0:1789304770.146037:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789304770.146042:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.146048:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb723129706f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304770.838558:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785691648:0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.838628:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304770.838692:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785692160:0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.838719:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304770.838747:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789304770.838753:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785691776:0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.838775:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304770.838800:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785691648 00000100:00100000:0.0:1789304770.838803:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785692288:0@lo:400:kworker.0 00000100:00100000:2.0:1789304770.838808:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785691648 00000100:00100000:0.0:1789304770.838826:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304770.838848:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1789304770.838852:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785691904:0@lo:400:kworker.0 00000100:00100000:2.0:1789304770.838857:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785691648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.838872:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304770.838888:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304770.838893:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785692032:0@lo:400:kworker.0 00000100:00100000:2.0:1789304770.838907:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785691648:12345-0@lo:400:kworker.0 Request processed in 51us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304770.838910:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304770.838914:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1789304770.838935:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785692160 00000100:00100000:0.0:1789304770.838938:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785692160 00000100:00100000:0.0:1789304770.838983:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785691776 00000100:00100000:0.0:1789304770.838987:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785691776 00000100:00100000:0.0:1789304770.839004:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785692032 00000100:00100000:0.0:1789304770.839006:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785692032 00000100:00100000:0.0:1789304770.839030:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1581 00000100:00100000:0.0:1789304770.839037:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785692160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.839069:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785692160:12345-0@lo:400:kworker.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304770.839075:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1581 00000100:00100000:0.0:1789304770.839088:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00080000:2.0:1789304770.839108:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304770.839114:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785691776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.839142:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785691776:12345-0@lo:400:kworker.0 Request processed in 29us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304770.839147:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:0.0:1789304770.839159:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:0.0:1789304770.839165:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785692032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.839206:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785692032:12345-0@lo:400:kworker.0 Request processed in 41us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304770.839215:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00100000:0.0:1789304770.839234:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785692288 00000100:00100000:2.0:1789304770.839236:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785692032:0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.839237:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785692288 00000100:00100000:0.0:1789304770.839277:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785691904 00000100:00100000:0.0:1789304770.839280:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785691904 00000100:00100000:0.0:1789304770.839298:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1789304770.839303:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1789304770.839304:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785692288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304770.839309:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785691904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.839334:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785692288:12345-0@lo:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304770.839335:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785691904:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304770.839340:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00080000:0.0:1789304770.839374:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304770.839395:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785691776:0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.839404:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785692288:0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.839411:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785691648:0@lo:400:kworker.0 00000100:00100000:0.0:1789304770.839418:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785692160:0@lo:400:kworker.0 00000100:00100000:2.0:1789304770.843827:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1789304770.843911:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:2.0:1789304770.843919:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c36e84e00, transno 4294967361 00000100:00100000:2.0:1789304770.843934:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785691904:0@lo:400:kworker.0 00010000:00010000:1.0:1789304770.898434:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304770.955624:0:90932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd16f839d0 20000000:00000080:2.0:1789304770.955647:0:90932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c4131d000 uarg=0000000000000000 00010000:00010000:2.0:1789304770.956169:0:90932:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304770.956186:0:90932:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304770.956199:0:90932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304770.956221:0:90932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.956238:0:90932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc000/0xefc0bb723129705a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297053 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.956247:0:90932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.956283:0:90932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc000/0xefc0bb723129705a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297053 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.956301:0:90932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb723129705a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297053 expref: 18 pid: 5845 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304770.956314:0:90932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90932:1876219785692416:0@lo:104: 00000100:00100000:2.0:1789304770.956382:0:90932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304770.956446:0:90932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05b6a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789304770.956848:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785692416 00000100:00100000:3.0:1789304770.956856:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785692416 00000100:00100000:3.0:1789304770.956922:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789304770.956932:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:90932:x1876219785692416:12345-0@lo:104: 00010000:00010000:3.0:1789304770.956947:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304770.957034:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789304770.957040:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:90932:x1876219785692416:12345-0@lo:104: Request processed in 111us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304770.957047:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:0.0:1789304770.958924:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304770.958937:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304770.958949:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304770.958953:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304770.958962:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304770.958975:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304770.958982:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304770.959049:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304770.959055:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304770.959120:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304770.959128:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb600/0xefc0bb7231297053 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129705a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304770.959146:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304770.959148:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304770.959150:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304770.959158:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304770.959176:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785692544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304770.959244:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304770.959297:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785692544 00000100:00100000:0.0:1789304770.959304:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785692544 00010000:00010000:0.0:1789304770.959333:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc000/0xefc0bb723129705a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297053 expref: 19 pid: 5845 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304770.959360:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1789304770.959368:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785692544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304770.959406:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304770.959414:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc000/0xefc0bb723129705a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297053 expref: 19 pid: 5845 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959425:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc000/0xefc0bb723129705a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297053 expref: 19 pid: 5845 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959442:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959450:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959467:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959475:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959486:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959492:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959498:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304770.959502:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959521:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959529:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304770.959538:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304770.959583:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785692544:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304770.959591:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1789304770.959936:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785692544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304770.960253:0:90932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc000/0xefc0bb723129705a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297053 expref: 18 pid: 5845 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304770.960266:0:90932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90932:1876219785692416:0@lo:104: 00010000:00010000:2.0:1789304770.960279:0:90932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.960287:0:90932:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.960293:0:90932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304770.960298:0:90932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231297076 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304771.926603:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304772.946153:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304772.946162:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304772.946167:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304772.946221:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304772.946233:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304772.946246:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304772.946274:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785692672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304772.946340:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304772.946382:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785692672 00000100:00100000:1.0:1789304772.946389:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789304772.946391:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785692672 00000100:00100000:0.0:1789304772.946447:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00010000:00010000:3.0:1789304772.946448:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304772.946456:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785692672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304772.946472:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304772.946497:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231297084 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129707d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304772.946523:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231297084 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129707d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304772.946535:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231297084 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129707d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304772.946545:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789304772.946601:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785692672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304772.946608:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:1.0:1789304772.946652:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785692672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304772.946666:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304772.946675:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304772.946693:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304772.946698:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304772.946705:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304773.403752:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304773.403781:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785692800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304773.403869:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304773.403960:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785692800 00000100:00100000:3.0:1789304773.403968:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785692800 00000100:00100000:3.0:1789304773.404075:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:3.0:1789304773.404085:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785692800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304773.404154:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304773.404212:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785692800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304773.404219:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00080000:3.0:1789304773.404241:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304773.404280:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785692800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304773.474902:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304773.474948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304773.474960:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765617664 00000100:00100000:3.0:1789304773.474971:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765617664 00000100:00100000:0.0:1789304773.474975:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304773.475006:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304773.475048:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1584 00000100:00100000:3.0:1789304773.475074:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765617664:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304773.475176:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765617664:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 105us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304773.475184:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1584 00000100:00080000:3.0:1789304773.475205:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304773.483967:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765617920 00000100:00100000:0.0:1789304773.483984:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765617920 00000100:00100000:0.0:1789304773.484063:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765617792 00000100:00100000:0.0:1789304773.484067:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765617792 00000100:00100000:0.0:1789304773.484125:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1203 00000100:00100000:0.0:1789304773.484137:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765617920:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304773.484251:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765617920:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 116us (9302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304773.484258:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1203 00000100:00100000:0.0:1789304773.484277:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1204 00000100:00100000:0.0:1789304773.484283:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765617792:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304773.484307:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765617792:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (9311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304773.484312:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1204 00000100:00100000:0.0:1789304773.484332:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765617536 00000100:00100000:0.0:1789304773.484336:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765617536 00000100:00100000:0.0:1789304773.484359:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1260 00000100:00100000:0.0:1789304773.484365:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765617536:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304773.484388:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765617536:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 23us (9411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304773.484393:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1260 00000100:00080000:3.0:1789304773.484627:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304773.484632:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304773.651080:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304773.651251:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765618048 00000100:00100000:3.0:1789304773.651262:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765618048 00000100:00100000:3.0:1789304773.651316:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1014 00000100:00100000:3.0:1789304773.651326:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:53525:x1876219765618048:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304773.651346:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304773.651367:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129708b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006eb expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651426:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297092 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651440:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651451:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651464:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297099 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651470:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651476:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651803:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312970a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651812:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312970a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651820:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312970a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304773.651842:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:3.0:1789304773.651845:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304773.651863:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312970a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651875:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651882:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297092 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651890:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297092 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651896:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304773.651900:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297092 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651908:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297092 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651919:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789304773.651923:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304773.651928:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651933:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651945:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651952:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297099 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651959:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651966:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304773.651969:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651976:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297099 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.651983:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c2ea19000) 00010000:00010000:3.0:1789304773.651986:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304773.651989:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297099 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.652006:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297099 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.652038:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129708b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006eb expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.652070:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312970a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006eb expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304773.652078:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304773.652081:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304773.652084:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304773.652179:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:53525:x1876219765618048:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 854us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304773.652188:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1014 00010000:00010000:0.0:1789304773.975120:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304774.419269:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785692928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304774.419351:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304774.421327:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785692928 00000100:00100000:2.0:1789304774.421342:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785692928 00000100:00100000:2.0:1789304774.421499:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1789304774.421510:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785692928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304774.421548:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304774.421624:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785692928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304774.421633:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1789304774.421687:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785692928:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304774.425227:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304774.994231:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304775.242769:0:91176:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf5128f30 20000000:00000080:0.0:1789304775.242788:0:91176:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b01fb2800 uarg=0000000000000000 00010000:00010000:0.0:1789304775.243622:0:91176:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789304775.243660:0:91176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:0.0:1789304775.243664:0:91176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304775.243678:0:91176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb72312970a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006eb expref: 5 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304775.243700:0:91176:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789304775.243716:0:91176:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304775.243732:0:91176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304775.243745:0:91176:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231297084 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129707d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304775.243754:0:91176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304775.243792:0:91176:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231297084 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129707d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304775.243807:0:91176:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231297084 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129707d expref: 18 pid: 5845 timeout: 2374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304775.243822:0:91176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91176:1876219785693056:0@lo:104: 00000100:00100000:0.0:1789304775.243887:0:91176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304775.243950:0:91176:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789304775.244065:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785693056 00000100:00100000:2.0:1789304775.244073:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785693056 00000100:00100000:2.0:1789304775.244148:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789304775.244159:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:91176:x1876219785693056:12345-0@lo:104: 00010000:00010000:2.0:1789304775.244173:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244227:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304775.244233:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:91176:x1876219785693056:12345-0@lo:104: Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304775.244240:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:2.0:1789304775.244261:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304775.244267:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244273:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304775.244277:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244285:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304775.244291:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304775.244296:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304775.244326:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244333:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304775.244354:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244360:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41371600/0xefc0bb723129707d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297084 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244374:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304775.244375:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304775.244377:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304775.244394:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785693184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304775.244423:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304775.244458:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785693184 00000100:00100000:2.0:1789304775.244462:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785693184 00010000:00010000:2.0:1789304775.244478:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231297084 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129707d expref: 19 pid: 5845 timeout: 2374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304775.244500:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789304775.244506:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785693184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304775.244515:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304775.244520:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231297084 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129707d expref: 19 pid: 5845 timeout: 2374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244529:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231297084 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129707d expref: 19 pid: 5845 timeout: 2374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244542:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244550:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244562:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244569:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244575:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244581:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244586:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304775.244590:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244597:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244604:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304775.244613:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304775.244641:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785693184:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304775.244648:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789304775.244682:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785693184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304775.244854:0:91176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb000/0xefc0bb7231297084 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129707d expref: 18 pid: 5845 timeout: 2374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304775.244864:0:91176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91176:1876219785693056:0@lo:104: 00010000:00010000:0.0:1789304775.244878:0:91176:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304775.244886:0:91176:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304775.244893:0:91176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304775.244899:0:91176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312970a7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304775.958815:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785693312:0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.958894:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304775.958939:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785693824:0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.958966:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304775.959007:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789304775.959014:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785693440:0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.959038:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304775.959056:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785693952:0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.959080:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304775.966190:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785693568:0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.966269:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304775.966316:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304775.966323:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785693696:0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.966349:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304775.966387:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785693312 00000100:00100000:0.0:1789304775.966397:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785693312 00000100:00100000:0.0:1789304775.966445:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1789304775.966454:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785693312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.966512:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785693312:12345-0@lo:400:kworker.0 Request processed in 58us (7618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304775.966519:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1789304775.966553:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785693824 00000100:00100000:0.0:1789304775.966557:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785693824 00000100:00100000:0.0:1789304775.966602:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785693440 00000100:00100000:0.0:1789304775.966606:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785693440 00000100:00100000:0.0:1789304775.966622:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785693696 00000100:00100000:0.0:1789304775.966624:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785693696 00000100:00100000:0.0:1789304775.966639:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1585 00000100:00100000:0.0:1789304775.966644:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785693824:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789304775.967241:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304775.967289:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:1.0:1789304775.967301:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785693440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304775.967344:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785693440:12345-0@lo:400:kworker.0 Request processed in 48us (8305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304775.967351:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:1.0:1789304775.967365:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:1.0:1789304775.967371:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785693696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304775.967406:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785693696:12345-0@lo:400:kworker.0 Request processed in 35us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304775.967412:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:1.0:1789304775.967431:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785693952 00000100:00100000:1.0:1789304775.967435:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785693952 00000100:00100000:1.0:1789304775.967464:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785693568 00000100:00100000:1.0:1789304775.967467:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785693568 00000100:00100000:1.0:1789304775.967489:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1789304775.967495:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785693952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304775.967528:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785693952:12345-0@lo:400:kworker.0 Request processed in 33us (8448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304775.967534:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1789304775.967549:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:1.0:1789304775.967555:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785693568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304775.967582:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785693568:12345-0@lo:400:kworker.0 Request processed in 28us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304775.967587:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00080000:1.0:1789304775.967608:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304775.967643:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785693696:0@lo:400:kworker.0 00000100:00100000:1.0:1789304775.967654:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785693568:0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.968384:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785693824:12345-0@lo:400:kworker.0 Request processed in 1736us (9413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304775.968396:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1585 00000100:00100000:0.0:1789304775.968457:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785693440:0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.968468:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785693952:0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.968478:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785693312:0@lo:400:kworker.0 00000100:00100000:0.0:1789304775.968488:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785693824:0@lo:400:kworker.0 00010000:00010000:0.0:1789304776.019850:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304776.341636:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304776.341648:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304776.341655:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304776.341785:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304776.341800:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304776.341813:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304776.341842:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785694080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304776.341927:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304776.341997:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c013593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304776.342011:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785694080 00000100:00100000:1.0:1789304776.342019:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785694080 00000100:00100000:1.0:1789304776.342110:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1789304776.342121:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785694080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304776.342136:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304776.342151:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370400/0xefc0bb72312970b5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312970ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304776.342184:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370400/0xefc0bb72312970b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312970ae expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304776.342194:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370400/0xefc0bb72312970b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312970ae expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304776.342203:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370400, rc 0) 00000100:00100000:1.0:1789304776.342251:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785694080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304776.342258:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1789304776.342391:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785694080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304776.342409:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304776.342419:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304776.342437:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304776.342442:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304776.342450:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304777.042234:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304778.071553:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304778.209854:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304778.210000:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765618176 00000100:00100000:0.0:1789304778.210074:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765618176 00000100:00080000:1.0:1789304778.210963:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304778.211169:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1015 00000100:00100000:0.0:1789304778.211207:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53611:x1876219765618176:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304778.211368:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304778.211406:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312970bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006f2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.211514:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312970c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.211539:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312970c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.211553:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312970c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304778.211601:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:0.0:1789304778.211605:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304778.212150:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312970c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304778.212181:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb72312970bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006f2 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304778.212207:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312970c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006f2 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304778.212216:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:1.0:1789304778.212219:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304778.212223:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:1.0:1789304778.212308:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:53611:x1876219765618176:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 1127us (2463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304778.212316:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1015 00000100:00100000:3.0:1789304778.217604:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304778.217886:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765618432 00000100:00100000:0.0:1789304778.217897:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765618432 00000100:00100000:0.0:1789304778.217965:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1016 00000100:00100000:0.0:1789304778.217977:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53611:x1876219765618432:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304778.218029:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304778.218054:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312970c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006f2 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.218073:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312970a0) 00010000:00010000:0.0:1789304778.218076:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:0.0:1789304778.218087:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304778.218128:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.218141:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.218151:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304778.218846:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a64eaef reply state 00000000a31e9d11 transno 4294967687 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304778.218857:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304778.218865:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000100:00100000:0.0:1789304778.218971:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:53611:x1876219765618432:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 995us (1375us total) trans 4294967687 rc 0/0 00000100:00100000:0.0:1789304778.218979:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1016 00010000:00010000:2.0:1789304778.222365:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304778.222382:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304778.222390:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304778.222397:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304778.222402:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304778.222410:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304778.222431:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d300) 00010000:00010000:2.0:1789304778.222434:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789304778.222439:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304778.222445:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312970ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304778.514306:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785694208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304778.514382:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304778.523279:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785694208 00000100:00100000:3.0:1789304778.523296:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785694208 00000100:00100000:3.0:1789304778.523423:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:3.0:1789304778.523435:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785694208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304778.523491:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304778.523593:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785694208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (9210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304778.523600:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1789304778.523909:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785694208:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304778.527428:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304778.596474:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304778.596512:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304778.596542:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304778.596565:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304778.596590:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765618688 00000100:00100000:0.0:1789304778.596601:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765618688 00000100:00100000:0.0:1789304778.596655:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1588 00000100:00100000:0.0:1789304778.596665:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765618688:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304778.596744:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765618688:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304778.596752:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1588 00000100:00100000:0.0:1789304778.596774:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765618816 00000100:00100000:0.0:1789304778.596778:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765618816 00000100:00100000:0.0:1789304778.596810:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765618944 00000100:00100000:0.0:1789304778.596813:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765618944 00000100:00100000:0.0:1789304778.596838:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1207 00000100:00100000:0.0:1789304778.596845:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765618816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304778.596874:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765618816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304778.596880:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1207 00000100:00100000:0.0:1789304778.596892:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 550 00000100:00100000:0.0:1789304778.596898:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765618944:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:0.0:1789304778.596916:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231296f0a 00000100:00080000:0.0:1789304778.596926:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2b01e9d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789304778.596972:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967359 00000100:00100000:0.0:1789304778.597255:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765618944:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 355us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304778.597262:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 550 00000100:00080000:0.0:1789304778.597378:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304778.597383:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304778.597398:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304778.597474:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765618560 00000100:00100000:1.0:1789304778.597479:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765618560 00000100:00100000:1.0:1789304778.597516:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1263 00000100:00100000:1.0:1789304778.597524:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765618560:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304778.597559:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765618560:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 36us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304778.597565:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1263 00000020:00000080:2.0:1789304778.920418:0:91374:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca279c1b0 20000000:00000080:2.0:1789304778.920436:0:91374:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c4131d000 uarg=0000000000000000 00010000:00010000:2.0:1789304778.920935:0:91374:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304778.920966:0:91374:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304778.920982:0:91374:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304778.921391:0:91374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304778.921410:0:91374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370400/0xefc0bb72312970b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312970ae expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304778.921419:0:91374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304778.921461:0:91374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370400/0xefc0bb72312970b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312970ae expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304778.921477:0:91374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41370400/0xefc0bb72312970b5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312970ae expref: 18 pid: 5846 timeout: 2378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304778.921492:0:91374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91374:1876219785694336:0@lo:104: 00000100:00100000:2.0:1789304778.921562:0:91374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304778.921666:0:91374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16480 going to sleep for 11 seconds 00000100:00100000:1.0:1789304778.921791:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785694336 00000100:00100000:1.0:1789304778.921800:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785694336 00000100:00100000:1.0:1789304778.921880:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789304778.921891:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:91374:x1876219785694336:12345-0@lo:104: 00010000:00010000:1.0:1789304778.921904:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304778.922050:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304778.922057:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:91374:x1876219785694336:12345-0@lo:104: Request processed in 168us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304778.922063:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00010000:00010000:0.0:1789304778.922119:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304778.922125:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922132:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304778.922137:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922145:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304778.922153:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304778.922163:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304778.922196:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922203:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304778.922224:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922231:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312970ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312970b5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922248:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304778.922250:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304778.922252:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304778.922272:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785694464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304778.922303:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304778.922345:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785694464 00000100:00100000:0.0:1789304778.922349:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785694464 00010000:00010000:0.0:1789304778.922367:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370400/0xefc0bb72312970b5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312970ae expref: 19 pid: 5846 timeout: 2378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304778.922387:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1789304778.922393:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785694464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304778.922403:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304778.922408:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370400/0xefc0bb72312970b5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312970ae expref: 19 pid: 5846 timeout: 2378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922417:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370400/0xefc0bb72312970b5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312970ae expref: 19 pid: 5846 timeout: 2378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922432:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922440:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922453:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922460:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922468:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922474:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922480:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304778.922484:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922492:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922501:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304778.922510:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304778.922539:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785694464:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304778.922549:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1789304778.922586:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785694464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304778.923593:0:91374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370400/0xefc0bb72312970b5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312970ae expref: 18 pid: 5846 timeout: 2378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304778.923609:0:91374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91374:1876219785694336:0@lo:104: 00010000:00010000:3.0:1789304778.923626:0:91374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304778.923640:0:91374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304778.923658:0:91374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304778.923665:0:91374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb72312970d1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304779.090688:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304779.538600:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304779.538676:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785694592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304779.539583:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304779.539690:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785694592 00000100:00100000:2.0:1789304779.539772:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785694592 00000100:00100000:2.0:1789304779.541161:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1789304779.541177:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785694592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304779.541217:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304779.541297:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785694592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304779.541304:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1789304779.541379:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785694592:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304779.570173:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304780.116694:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789304780.136253:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304780.136263:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2b01e99800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304780.136386:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b01e99800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:1.0:1789304780.136440:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b01e9d000 for lustre-OST0001 10000000:01000000:0.0:1789304780.435157:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304780.435166:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304780.435172:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304780.435214:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304780.435227:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304780.435239:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304780.435264:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785694720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304780.435330:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304780.435377:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38be8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789304780.435446:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785694720 00000100:00100000:2.0:1789304780.435655:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785694720 00000100:00100000:2.0:1789304780.435709:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1789304780.435719:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785694720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304780.435732:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304780.435745:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312970df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312970d8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304780.435771:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312970df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312970d8 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304780.435783:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312970df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312970d8 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304780.435791:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc800, rc 0) 00000100:00100000:2.0:1789304780.435835:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785694720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304780.435842:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1789304780.435925:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38463b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785694720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304780.435949:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304780.435960:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304780.436053:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304780.436058:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304780.436067:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789304780.610258:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967687 is committed 00000100:00100000:0.0:1789304781.078663:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785695232:0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.078739:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304781.078800:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789304781.078806:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785694848:0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.078836:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304781.078854:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785695360:0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.078878:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304781.078904:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785694976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.078938:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304781.078958:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304781.078963:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785695104:0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.079003:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304781.079040:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785695232 00000100:00100000:0.0:1789304781.079059:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785695232 00000100:00100000:0.0:1789304781.079125:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785694848 00000100:00100000:0.0:1789304781.079129:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785694848 00000100:00100000:0.0:1789304781.079145:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785695104 00000100:00100000:0.0:1789304781.079148:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785695104 00000100:00100000:0.0:1789304781.079167:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589 00000100:00100000:0.0:1789304781.079177:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785695232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.079228:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785695232:12345-0@lo:400:kworker.0 Request processed in 53us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.079235:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00000100:00100000:0.0:1789304781.079253:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:0.0:1789304781.079258:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785694848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.079282:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785694848:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.079288:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:0.0:1789304781.079298:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:0.0:1789304781.079303:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785695104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.079330:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785695104:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.079335:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:0.0:1789304781.079351:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785695360 00000100:00100000:0.0:1789304781.079354:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785695360 00000100:00100000:0.0:1789304781.079376:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785694976 00000100:00100000:0.0:1789304781.079378:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785694976 00000100:00100000:0.0:1789304781.079397:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:0.0:1789304781.079403:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785695360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.079431:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785695360:12345-0@lo:400:kworker.0 Request processed in 28us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.079437:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:0.0:1789304781.079446:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1789304781.079451:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785694976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.079475:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785694976:12345-0@lo:400:kworker.0 Request processed in 25us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.079480:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00080000:0.0:1789304781.079497:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304781.079501:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304781.079503:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304781.079543:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785695104:0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.079555:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785694976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.079581:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785694848:0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.079590:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785695360:0@lo:400:kworker.0 00000100:00100000:0.0:1789304781.079598:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785695232:0@lo:400:kworker.0 00010000:00010000:0.0:1789304781.138342:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304781.670471:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304781.670627:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765619072 00000100:00100000:2.0:1789304781.670638:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765619072 00000100:00100000:2.0:1789304781.670709:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1017 00000100:00100000:2.0:1789304781.670720:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765619072:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304781.670821:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765619072:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 103us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304781.670829:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1017 00000100:00080000:0.0:1789304781.671167:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304781.673269:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304781.673340:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765619200 00000100:00100000:0.0:1789304781.673351:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765619200 00000100:00100000:0.0:1789304781.673423:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 551 00000100:00100000:0.0:1789304781.673433:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765619200:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304781.673808:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765619200:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 375us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.673815:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 551 00000100:00080000:2.0:1789304781.674269:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304781.681619:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304781.681766:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765619328 00000100:00100000:2.0:1789304781.681777:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765619328 00000100:00100000:2.0:1789304781.681826:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 552 00000100:00100000:2.0:1789304781.681834:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876219765619328:12345-192.168.202.29@tcp:8:lfs.60003 00010000:00080000:2.0:1789304781.681866:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 2231 last 0 00000020:00000080:2.0:1789304781.681895:0:17212:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb72312970e6 00002000:00100000:2.0:1789304781.681906:0:17212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2b02eca800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789304781.681940:0:17212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789304781.682377:0:17212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789304781.682409:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2c1c970800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789304781.682477:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765619328:12345-192.168.202.29@tcp:8:lfs.60003 Request processed in 643us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.682485:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 552 00000100:00100000:3.0:1789304781.684267:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304781.684534:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765619456 00000100:00100000:0.0:1789304781.684544:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765619456 00000100:00080000:2.0:1789304781.684604:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304781.684612:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 553 00000100:00100000:0.0:1789304781.684622:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:53696:x1876219765619456:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304781.685013:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:53696:x1876219765619456:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 391us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.685021:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 553 00000100:00100000:3.0:1789304781.691666:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304781.691718:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765619584 00000100:00100000:0.0:1789304781.691730:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765619584 00000100:00100000:0.0:1789304781.691786:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1018 00000100:00100000:0.0:1789304781.691797:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765619584:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304781.692386:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765619584:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 589us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.692394:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1018 00000100:00100000:1.0:1789304781.695004:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304781.695144:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765619712 00000100:00100000:0.0:1789304781.695154:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765619712 00000100:00100000:0.0:1789304781.695325:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1019 00000100:00100000:0.0:1789304781.695336:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765619712:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304781.695451:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765619712:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 116us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.695459:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1019 00000100:00100000:3.0:1789304781.696730:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304781.696905:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765619840 00000100:00100000:1.0:1789304781.696913:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765619840 00000100:00100000:1.0:1789304781.697086:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 554 00000100:00100000:1.0:1789304781.697123:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765619840:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304781.697539:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765619840:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 417us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304781.697548:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 554 00000100:00100000:3.0:1789304781.699774:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304781.699870:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765619968 00000100:00100000:1.0:1789304781.699880:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765619968 00000100:00100000:1.0:1789304781.700266:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 555 00000100:00100000:1.0:1789304781.700277:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53696:x1876219765619968:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304781.700940:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53696:x1876219765619968:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 664us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304781.700948:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 555 00000100:00100000:2.0:1789304781.702486:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304781.702577:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765620096 00000100:00100000:0.0:1789304781.702588:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765620096 00000100:00100000:0.0:1789304781.702639:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1020 00000100:00100000:0.0:1789304781.702647:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765620096:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304781.703183:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:53696:x1876219765620096:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 535us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.703190:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1020 00000100:00100000:3.0:1789304781.743049:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304781.743261:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765620224 00000100:00100000:0.0:1789304781.743272:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765620224 00000100:00100000:0.0:1789304781.743333:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1021 00000100:00100000:0.0:1789304781.743344:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:53700:x1876219765620224:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304781.743366:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304781.743389:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312970ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861006f9 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743455:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312970f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743468:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312970f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743480:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312970f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743551:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312970fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743560:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312970fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743566:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312970fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743867:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743876:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743882:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304781.743904:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:0.0:1789304781.743908:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304781.743940:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743951:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312970f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743957:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312970f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743963:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312970f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.743969:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304781.744043:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312970f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744052:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312970f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744063:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d500) 00010000:00010000:0.0:1789304781.744066:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304781.744071:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312970f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744076:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312970f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744146:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312970fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744279:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312970fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744284:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312970fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744289:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304781.744292:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312970fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744298:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312970fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744305:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c0558dd00) 00010000:00010000:0.0:1789304781.744307:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304781.744310:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312970fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744315:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312970fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744347:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312970ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006f9 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744364:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006f9 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.744370:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:0.0:1789304781.744373:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304781.744376:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afac00, rc 0) 00000100:00100000:0.0:1789304781.744488:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:53700:x1876219765620224:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1145us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304781.744496:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1021 00000100:00100000:2.0:1789304781.755263:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304781.755396:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765620480 00000100:00100000:1.0:1789304781.755407:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765620480 00000100:00100000:1.0:1789304781.755469:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1022 00000100:00100000:1.0:1789304781.755479:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53700:x1876219765620480:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:1.0:1789304781.755498:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304781.755518:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297109 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100700 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.755787:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297110 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.755802:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.755813:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.755828:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.755835:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.755841:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789304781.757467:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20:0x0], index 1: 0 00010000:00010000:1.0:1789304781.757756:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129711e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.757772:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129711e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.757783:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129711e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.757819:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297110 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.757826:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297110 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.757832:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297110 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.757838:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304781.757842:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297110 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.757854:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297110 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.757866:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:1.0:1789304781.757868:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304781.757873:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297110 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.757878:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297110 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304781.757890:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081e99f1c reply state 000000002a77ac89 transno 4294967688 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304781.757898:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789304781.757946:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297109 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100700 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.757962:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129711e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100700 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304781.758087:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9e2c14add100) 00010000:00010000:1.0:1789304781.758350:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304781.758354:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371e00, rc 0) 00000100:00100000:1.0:1789304781.758433:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:53700:x1876219765620480:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 2955us (10633us total) trans 4294967688 rc 0/0 00000100:00100000:1.0:1789304781.758442:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1022 00000100:00100000:2.0:1789304781.763800:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304781.763877:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765620608 00000100:00100000:3.0:1789304781.763888:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765620608 00000100:00100000:3.0:1789304781.763958:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 556 00000100:00100000:3.0:1789304781.763979:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:53700:x1876219765620608:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:3.0:1789304781.764002:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304781.764024:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbaba77f/0xefc0bb723129712c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100707 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789304781.764055:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789304781.764077:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=2231s v=(0 0) 00010000:00010000:3.0:1789304781.764083:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304781.764126:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbaba77f/0xefc0bb723129712c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100707 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304781.764146:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbaba77f/0xefc0bb723129712c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100707 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304781.764158:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f600, rc 0) 00000100:00100000:3.0:1789304781.764210:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:53700:x1876219765620608:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 243us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304781.764217:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 556 00010000:00010000:0.0:1789304781.767080:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.767172:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.767181:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.767187:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304781.767192:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.767200:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.767216:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c14add200) 00010000:00010000:0.0:1789304781.767219:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304781.767225:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304781.767230:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297117 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304781.779631:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304781.779735:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765620736 00000100:00100000:1.0:1789304781.779746:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765620736 00002000:00100000:1.0:1789304781.779798:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x20:0x0] (0->1048575) req@ffff9e2c3f86e680 x1876219765620736/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:92/0 lens 488/0 e 0 to 0 dl 1789304792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304781.779810:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c3f86e680 with x1876219765620736 ext(0->1048575) 00002000:00010000:1.0:1789304781.779815:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c3f86e680 00000100:00100000:1.0:1789304781.779848:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 25 00000100:00100000:1.0:1789304781.779857:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765620736:12345-192.168.202.29@tcp:4:dd.60003 00000001:00100000:2.0:1789304781.822534:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:1.0:1789304781.825811:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2357:x1876219765620736:12345-192.168.202.29@tcp:4:dd.60003 Request processed in 45943us (46177us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789304781.825826:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 25 00002000:00100000:1.0:1789304781.825839:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x20:0x0] (0->1048575) req@ffff9e2c3f86e680 x1876219765620736/t4294967360(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:92/0 lens 488/448 e 0 to 0 dl 1789304792 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304781.825849:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c3f86e680 with x1876219765620736 ext(0->1048575) 00002000:00010000:1.0:1789304781.825856:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c3f86e680 00000100:00100000:0.0:1789304781.828725:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304781.828841:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765620864 00000100:00100000:1.0:1789304781.828851:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765620864 00000100:00100000:1.0:1789304781.828903:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1023 00000100:00100000:1.0:1789304781.828912:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:53700:x1876219765620864:12345-192.168.202.29@tcp:44:dd.60003 00000001:00080000:2.0:1789304781.857572:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967688 is committed 00000100:00100000:1.0:1789304781.857799:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:53700:x1876219765620864:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 28881us (29076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304781.857810:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1023 00000100:00100000:3.0:1789304781.859678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304781.859755:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765620992 00000100:00100000:0.0:1789304781.859764:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765620992 00000100:00100000:0.0:1789304781.859840:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 557 00000100:00100000:0.0:1789304781.859850:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765620992:12345-192.168.202.29@tcp:16:dd.60003 00000100:00100000:1.0:1789304781.886823:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765620992:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 26963us (27140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304781.886837:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 557 00000001:00080000:1.0:1789304781.887270:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967360 is committed 00000100:00100000:0.0:1789304781.889790:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304781.889868:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765621248 00000100:00100000:1.0:1789304781.889880:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765621248 00000100:00100000:1.0:1789304781.889948:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 103 00000100:00100000:1.0:1789304781.889958:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:53700:x1876219765621248:12345-192.168.202.29@tcp:35:dd.60003 00000001:00080000:1.0:1789304781.890409:0:79662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967689 00000100:00100000:1.0:1789304781.890536:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:53700:x1876219765621248:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 578us (751us total) trans 4294967690 rc 0/0 00000100:00100000:1.0:1789304781.890543:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 103 00000020:00080000:1.0:1789304781.890548:0:79662:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789304782.162451:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304783.170863:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967690 is committed 00010000:00010000:0.0:1789304783.187199:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304783.635685:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304783.635707:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785695488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304783.635772:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304783.635841:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785695488 00000100:00100000:3.0:1789304783.635849:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785695488 00000100:00100000:3.0:1789304783.635914:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1789304783.635924:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785695488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304783.635969:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789304783.636019:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785695488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304783.636026:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00080000:3.0:1789304783.636048:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304783.636087:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785695488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304783.714480:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304783.714525:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304783.714560:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304783.714628:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304783.714658:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765621760 00000100:00100000:1.0:1789304783.714671:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765621760 00000100:00100000:1.0:1789304783.714727:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765621632 00000100:00100000:1.0:1789304783.714730:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765621632 00000100:00100000:1.0:1789304783.714753:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1210 00000100:00100000:1.0:1789304783.714762:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765621760:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304783.714827:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765621760:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 66us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304783.714834:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1210 00000100:00100000:1.0:1789304783.714851:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1211 00000100:00100000:1.0:1789304783.714857:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765621632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304783.714881:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765621632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304783.714887:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1211 00000100:00080000:1.0:1789304783.714920:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304783.714924:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304783.714982:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765621376 00000100:00100000:3.0:1789304783.714987:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765621376 00000100:00100000:3.0:1789304783.715023:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1265 00000100:00100000:3.0:1789304783.715031:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765621376:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304783.715057:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765621376:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304783.715063:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1265 00000100:00100000:0.0:1789304783.715295:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765621504 00000100:00100000:0.0:1789304783.715300:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765621504 00000100:00100000:0.0:1789304783.715354:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1592 00000100:00100000:0.0:1789304783.715363:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765621504:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304783.715396:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765621504:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 36us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304783.715401:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1592 00000100:00080000:1.0:1789304783.715568:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304784.212400:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304784.351582:0:91620:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2234029488708ns, next at 2216488341944ns, rc = 0 00000004:00080000:0.0:1789304784.351746:0:91620:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2234029655118ns, next at 2189712490763ns, rc = 0 00000004:00080000:3.0:1789304784.355859:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 90 committed 00000004:00080000:3.0:1789304784.355886:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 84 committed 00000100:00100000:1.0:1789304784.665688:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304784.665710:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785695616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304784.665784:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304784.665867:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785695616 00000100:00100000:1.0:1789304784.665875:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785695616 00000100:00100000:1.0:1789304784.665964:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:1.0:1789304784.665976:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785695616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304784.666016:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304784.666065:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785695616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304784.666073:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00080000:1.0:1789304784.666117:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304784.666158:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785695616:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304785.249342:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304785.836003:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304785.836416:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765621888 00000100:00100000:1.0:1789304785.836428:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765621888 00000100:00100000:2.0:1789304785.836595:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1024 00000100:00100000:2.0:1789304785.836607:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:53893:x1876219765621888:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304785.836737:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:53893:x1876219765621888:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 132us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304785.836744:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1024 00000100:00080000:1.0:1789304785.837057:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304785.841596:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304785.842715:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765622016 00000100:00100000:3.0:1789304785.842727:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765622016 00000100:00100000:3.0:1789304785.842805:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 558 00000100:00100000:3.0:1789304785.842816:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:53893:x1876219765622016:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304785.843987:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:53893:x1876219765622016:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1167us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304785.843997:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 558 00000100:00080000:1.0:1789304785.844275:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304785.853689:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304785.854222:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765622144 00000100:00100000:0.0:1789304785.854233:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765622144 00000100:00100000:0.0:1789304785.854310:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 559 00000100:00100000:0.0:1789304785.854323:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53893:x1876219765622144:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304785.854707:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53893:x1876219765622144:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 385us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304785.854716:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 559 00000100:00080000:1.0:1789304785.855065:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304785.859188:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304785.859389:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765622272 00000100:00100000:3.0:1789304785.859401:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765622272 00000100:00100000:3.0:1789304785.859453:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1025 00000100:00100000:3.0:1789304785.859463:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:53893:x1876219765622272:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304785.859788:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:53893:x1876219765622272:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 327us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304785.859794:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1025 00000100:00100000:0.0:1789304785.865207:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304785.865328:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765622400 00000100:00100000:3.0:1789304785.865340:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765622400 00000100:00100000:3.0:1789304785.865408:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1026 00000100:00100000:3.0:1789304785.865419:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:53893:x1876219765622400:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304785.865537:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:53893:x1876219765622400:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 121us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304785.865545:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1026 00000100:00100000:2.0:1789304785.876365:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304785.876463:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765622528 00000100:00100000:1.0:1789304785.876474:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765622528 00000100:00100000:1.0:1789304785.876534:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 560 00000100:00100000:1.0:1789304785.876544:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:53893:x1876219765622528:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304785.877179:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:53893:x1876219765622528:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 635us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304785.877189:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 560 00000100:00100000:0.0:1789304785.883533:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304785.883604:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765622656 00000100:00100000:2.0:1789304785.883616:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765622656 00000100:00100000:2.0:1789304785.883669:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 561 00000100:00100000:2.0:1789304785.883678:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53893:x1876219765622656:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304785.884060:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:53893:x1876219765622656:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 381us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304785.884068:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 561 00000100:00100000:0.0:1789304785.892797:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304785.893052:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765622784 00000100:00100000:2.0:1789304785.893065:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765622784 00000100:00100000:2.0:1789304785.893152:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1027 00000100:00100000:2.0:1789304785.893163:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:53893:x1876219765622784:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304785.893617:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:53893:x1876219765622784:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 453us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304785.893626:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1027 00000100:00100000:0.0:1789304785.949634:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304785.949715:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765623040 00000100:00100000:1.0:1789304785.949726:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765623040 00000100:00100000:1.0:1789304785.949786:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1028 00000100:00100000:1.0:1789304785.949796:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:53897:x1876219765623040:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:1.0:1789304785.949852:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304785.949895:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb723129711e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100700 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304785.949914:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9e2c14add100) 00010000:00010000:1.0:1789304785.949924:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304785.949947:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297133 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304785.949962:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297133 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304785.949973:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297133 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304785.949985:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304785.949993:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304785.949999:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304785.950344:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231297141 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304785.950355:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231297141 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304785.950361:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231297141 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789304785.954931:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].32, 64 off10240 00000004:00080000:0.0:1789304785.954946:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2235632855357ns, next at 2236632851999ns, rc = 0 00010000:00010000:0.0:1789304785.955113:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955133:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955145:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955154:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955160:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955166:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955187:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789304785.955215:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231297141 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955222:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231297141 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955228:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231297141 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955233:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370c00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304785.955237:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231297141 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955244:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231297141 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955256:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:0.0:1789304785.955259:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789304785.955264:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231297141 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955269:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb7231297141 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955287:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297133 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955292:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297133 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955297:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297133 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955302:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304785.955305:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297133 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955310:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297133 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955316:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:0.0:1789304785.955319:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304785.955321:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297133 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304785.955330:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297133 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304785.955339:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000221dffde reply state 000000008dabae5b transno 4294967691 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304785.955373:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304785.955488:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:53897:x1876219765623040:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 5689us (5862us total) trans 4294967691 rc 0/0 00000100:00100000:0.0:1789304785.955497:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1028 00010000:00010000:2.0:1789304785.956028:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304785.956037:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.956045:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304785.956048:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.956055:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.956067:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:2.0:1789304785.956070:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789304785.956074:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.956080:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297148 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.956126:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304785.956128:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304785.956130:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304785.958794:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.958813:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.958821:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.958827:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304785.958832:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.958844:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.958862:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff9e2c14add000) 00010000:00010000:2.0:1789304785.958865:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304785.958870:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304785.958876:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb723129713a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304786.194486:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785696128:0@lo:400:kworker.0 00000100:00100000:3.0:1789304786.194559:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304786.194629:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304786.194653:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785696000:0@lo:400:kworker.0 00000100:00100000:3.0:1789304786.194681:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304786.194765:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785695872:0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.194797:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304786.194823:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785696384:0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.194846:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304786.194863:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789304786.194869:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785695744:0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.194909:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304786.194933:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785696256:0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.194967:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304786.194998:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785696000 00000100:00100000:2.0:1789304786.195006:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785696000 00000100:00100000:2.0:1789304786.195057:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785696384 00000100:00100000:2.0:1789304786.195060:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785696384 00000100:00100000:2.0:1789304786.195085:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1789304786.195118:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785696000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195174:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785696000:12345-0@lo:400:kworker.0 Request processed in 58us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304786.195181:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1789304786.195197:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1789304786.195203:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785696384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195236:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785696384:12345-0@lo:400:kworker.0 Request processed in 33us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304786.195241:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1789304786.195259:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785695744 00000100:00100000:2.0:1789304786.195262:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785695744 00000100:00100000:2.0:1789304786.195287:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1789304786.195293:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785695744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195323:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785695744:12345-0@lo:400:kworker.0 Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304786.195329:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1789304786.195357:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785696128 00000100:00100000:2.0:1789304786.195360:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785696128 00000100:00100000:2.0:1789304786.195387:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785695872 00000100:00100000:2.0:1789304786.195390:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785695872 00000100:00100000:2.0:1789304786.195402:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785696256 00000100:00100000:2.0:1789304786.195405:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785696256 00000100:00100000:2.0:1789304786.195419:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:2.0:1789304786.195424:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785696128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195451:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785696128:12345-0@lo:400:kworker.0 Request processed in 28us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304786.195456:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00100000:2.0:1789304786.195468:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:2.0:1789304786.195473:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785695872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195497:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785695872:12345-0@lo:400:kworker.0 Request processed in 25us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304786.195502:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:2.0:1789304786.195512:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:2.0:1789304786.195518:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785696256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195542:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785696256:12345-0@lo:400:kworker.0 Request processed in 25us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304786.195548:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00100000:2.0:1789304786.195597:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785696000:0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195608:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785696128:0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195634:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785695744:0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195642:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785696256:0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195650:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785695872:0@lo:400:kworker.0 00000100:00100000:2.0:1789304786.195657:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785696384:0@lo:400:kworker.0 00000100:00080000:2.0:1789304786.195674:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304786.195678:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304786.195680:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304786.258349:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304787.282394:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304788.308172:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304788.374831:0:91765:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2238052738051ns, next at 2216488341944ns, rc = 0 00000004:00080000:3.0:1789304788.378307:0:91765:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2238056212666ns, next at 2236632851999ns, rc = 0 00000001:00080000:3.0:1789304788.417140:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967691 is committed 00000004:00080000:3.0:1789304788.417154:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 91 committed 00000004:00080000:3.0:1789304788.417168:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 85 committed 00000100:00100000:1.0:1789304788.417699:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785696512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789304788.417773:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304788.418087:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785696512 00000100:00100000:0.0:1789304788.418124:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785696512 00000100:00100000:0.0:1789304788.418177:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1789304788.418187:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785696512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789304788.418215:0:17212:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:32 count 1 00010000:00010000:0.0:1789304788.418243:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304788.418265:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbaba77f/0xefc0bb723129712c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100707 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304788.418275:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1789304788.418280:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304788.418284:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304788.418318:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbaba77f/0xefc0bb723129712c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100707 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304788.418332:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbaba77f/0xefc0bb723129712c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100707 expref: 5 pid: 17212 timeout: 2338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304788.418344:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f86df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17212:1876219785696640:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304788.418407:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c411e9780 going to sleep for 11 seconds 00000100:00080000:2.0:1789304788.418647:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304788.422926:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f86df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17212:1876219785696640:192.168.202.29@tcp:104: 00010000:00010000:1.0:1789304788.422961:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304788.423941:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304788.424139:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765623168 00000100:00100000:3.0:1789304788.424148:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765623168 00010000:00010000:3.0:1789304788.424206:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbaba77f/0xefc0bb723129712c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100707 expref: 6 pid: 17212 timeout: 2338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304788.424514:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 416 00000100:00100000:3.0:1789304788.424525:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765623168:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789304788.424541:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304788.424547:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbaba77f/0xefc0bb723129712c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100707 expref: 6 pid: 17212 timeout: 2338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304788.424562:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbaba77f/0xefc0bb723129712c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100707 expref: 6 pid: 17212 timeout: 2338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304788.424590:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbaba77f/0xefc0bb723129712c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100707 expref: 6 pid: 17212 timeout: 2338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304788.424608:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304788.424618:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304788.424624:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304788.424634:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304788.424668:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304788.424725:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765623168:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 202us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304788.424733:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 416 00000100:00080000:1.0:1789304788.425116:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789304788.427025:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 92 committed 00010000:00010000:2.0:1789304788.427128:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304788.427143:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304788.427159:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304788.427166:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304788.427189:0:17212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789304788.428173:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785696512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9982us (10395us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789304788.428185:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00010000:00010000:2.0:1789304788.428218:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304788.428226:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304788.428238:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304788.428243:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304788.428254:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304788.428280:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304788.428287:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004929f185/0xefc0bb723129714f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304788.428311:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304788.428313:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304788.428315:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304788.428395:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c3f86e300/2, rc 0, transno 4294967361 00000100:00100000:0.0:1789304788.428412:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785696512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789304788.766558:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785696768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304788.766632:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304788.766755:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785696768 00000100:00100000:2.0:1789304788.766765:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785696768 00000100:00100000:2.0:1789304788.766822:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:2.0:1789304788.766832:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785696768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304788.766884:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789304788.766945:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785696768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304788.766952:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1789304788.767300:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785696768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304788.835354:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304788.835398:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304788.835437:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304788.835530:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765623424 00000100:00100000:1.0:1789304788.835530:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765623296 00000100:00100000:3.0:1789304788.835541:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765623424 00000100:00100000:1.0:1789304788.835541:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765623296 00000100:00100000:1.0:1789304788.835597:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1267 00000100:00100000:3.0:1789304788.835599:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1596 00000100:00100000:3.0:1789304788.835608:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765623424:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304788.835608:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765623296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1789304788.835688:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304788.835696:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765623552 00000100:00100000:2.0:1789304788.835700:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765623552 00000100:00080000:0.0:1789304788.835728:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304788.835734:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1214 00000100:00100000:2.0:1789304788.835741:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765623552:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304788.841593:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765623296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 5971us (6236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304788.841611:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1267 00000100:00100000:3.0:1789304788.842339:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765623424:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 6726us (6894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304788.842351:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1596 00000100:00100000:0.0:1789304788.849009:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765623552:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 13256us (13597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304788.849023:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1214 00010000:00010000:2.0:1789304789.335711:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304789.778308:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304789.778335:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785696896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304789.778409:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304789.778827:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785696896 00000100:00100000:1.0:1789304789.778839:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785696896 00000100:00100000:1.0:1789304789.778937:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1789304789.778948:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785696896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304789.778991:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304789.779057:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785696896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304789.779065:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1789304789.779146:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785696896:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304789.779519:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304790.355934:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304790.883723:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967361 is committed 00000100:00100000:2.0:1789304791.315235:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785697024:0@lo:400:kworker.0 00000100:00100000:2.0:1789304791.315316:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304791.315393:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785697024 00000100:00100000:2.0:1789304791.315402:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785697024 00000100:00100000:2.0:1789304791.315531:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1789304791.315543:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785697024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304791.315597:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785697024:12345-0@lo:400:kworker.0 Request processed in 56us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304791.315607:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1789304791.315655:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785697024:0@lo:400:kworker.0 00000100:00100000:1.0:1789304791.315797:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785697280:0@lo:400:kworker.0 00000100:00100000:1.0:1789304791.315845:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304791.315869:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789304791.315875:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785697152:0@lo:400:kworker.0 00000100:00100000:1.0:1789304791.315901:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304791.315921:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785697664:0@lo:400:kworker.0 00000100:00100000:1.0:1789304791.315942:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304791.316306:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785697408:0@lo:400:kworker.0 00000100:00100000:0.0:1789304791.316343:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304791.316366:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304791.316371:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785697536:0@lo:400:kworker.0 00000100:00100000:0.0:1789304791.316392:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304791.316428:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785697152 00000100:00100000:0.0:1789304791.316433:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785697152 00000100:00100000:0.0:1789304791.316539:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785697408 00000100:00100000:0.0:1789304791.316543:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785697408 00000100:00100000:0.0:1789304791.316567:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785697536 00000100:00100000:0.0:1789304791.316569:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785697536 00000100:00100000:0.0:1789304791.316583:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:0.0:1789304791.316589:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785697152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304791.316626:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785697152:12345-0@lo:400:kworker.0 Request processed in 37us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304791.316631:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:0.0:1789304791.316644:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:0.0:1789304791.316650:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785697408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304791.316677:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785697408:12345-0@lo:400:kworker.0 Request processed in 28us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304791.316683:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:0.0:1789304791.316693:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:0.0:1789304791.316698:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785697536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304791.316722:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785697536:12345-0@lo:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304791.316727:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00080000:0.0:1789304791.316748:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304791.316774:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785697536:0@lo:400:kworker.0 00000100:00100000:0.0:1789304791.316783:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785697408:0@lo:400:kworker.0 00000100:00100000:2.0:1789304791.316913:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785697280 00000100:00100000:2.0:1789304791.316918:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785697280 00000100:00100000:2.0:1789304791.317287:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785697664 00000100:00100000:2.0:1789304791.317293:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785697664 00000100:00100000:2.0:1789304791.317317:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1789304791.317325:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785697280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304791.317374:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785697280:12345-0@lo:400:kworker.0 Request processed in 49us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304791.317380:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1789304791.317392:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1789304791.317398:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785697664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304791.317425:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785697664:12345-0@lo:400:kworker.0 Request processed in 27us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304791.317430:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:1.0:1789304791.317556:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785697152:0@lo:400:kworker.0 00000100:00100000:1.0:1789304791.317566:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:1.0:1789304791.317571:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c3f86e300, transno 4294967361 00000100:00100000:1.0:1789304791.317582:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785697664:0@lo:400:kworker.0 00000100:00100000:1.0:1789304791.317592:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785697280:0@lo:400:kworker.0 00000100:00080000:0.0:1789304791.318702:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304791.318711:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304791.378476:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304792.402402:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304793.426787:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304793.876978:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785697792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304793.877058:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304793.877244:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785697792 00000100:00100000:1.0:1789304793.877252:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785697792 00000100:00100000:1.0:1789304793.877313:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:1.0:1789304793.877322:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785697792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304793.877358:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304793.877413:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785697792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304793.877420:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:1.0:1789304793.877476:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785697792:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304793.877540:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304793.961407:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304793.961474:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304793.961527:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304793.961552:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304793.961655:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765623680 00000100:00100000:1.0:1789304793.961665:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765623680 00000100:00100000:1.0:1789304793.961726:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1269 00000100:00100000:1.0:1789304793.961737:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765623680:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304793.961823:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765623680:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304793.961830:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1269 00000100:00100000:2.0:1789304793.962033:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765623808 00000100:00100000:2.0:1789304793.962038:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765623808 00000100:00100000:2.0:1789304793.962126:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1600 00000100:00100000:2.0:1789304793.962135:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765623808:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304793.962174:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765623808:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 41us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304793.962181:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1600 00000100:00100000:2.0:1789304793.962201:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765624064 00000100:00100000:2.0:1789304793.962205:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765624064 00000100:00100000:2.0:1789304793.962231:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765623936 00000100:00100000:2.0:1789304793.962235:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765623936 00000100:00100000:2.0:1789304793.962258:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1217 00000100:00100000:2.0:1789304793.962265:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765624064:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304793.962290:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765624064:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304793.962296:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1217 00000100:00100000:2.0:1789304793.962308:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1218 00000100:00100000:2.0:1789304793.962314:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765623936:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304793.962337:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765623936:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 23us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304793.962342:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1218 00000100:00080000:1.0:1789304793.962525:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304793.962529:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304793.962531:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304794.450408:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304794.898401:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785697920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304794.898477:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304794.898778:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785697920 00000100:00100000:3.0:1789304794.898787:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785697920 00000100:00100000:3.0:1789304794.898909:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:3.0:1789304794.898927:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785697920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304794.898960:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304794.899019:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785697920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304794.899026:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:3.0:1789304794.899110:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785697920:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304794.902732:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304795.479534:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304796.434802:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785698304:0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.434859:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785698176:0@lo:400:kworker.0 00000100:00100000:3.0:1789304796.434888:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304796.434892:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304796.434983:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785698176 00000100:00100000:0.0:1789304796.434992:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785698176 00000100:00100000:0.0:1789304796.435051:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:0.0:1789304796.435060:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785698176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304796.435149:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785698432:0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.437154:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785698688:0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.437214:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304796.437275:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785698304 00000100:00100000:2.0:1789304796.437283:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785698304 00000100:00100000:2.0:1789304796.437343:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785698688 00000100:00100000:2.0:1789304796.437346:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785698688 00000100:00100000:2.0:1789304796.439119:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:2.0:1789304796.439141:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785698304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.439227:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785698304:12345-0@lo:400:kworker.0 Request processed in 96us (4339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304796.439236:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:2.0:1789304796.439258:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1789304796.439265:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785698688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.439300:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785698688:12345-0@lo:400:kworker.0 Request processed in 36us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304796.439306:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1789304796.439474:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785698688:0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.439656:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785698048:0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.440798:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304796.440856:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785698560:0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.440884:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304796.440939:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785698560 00000100:00100000:2.0:1789304796.440946:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785698560 00000100:00100000:2.0:1789304796.441149:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:2.0:1789304796.441158:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785698560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.441210:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785698560:12345-0@lo:400:kworker.0 Request processed in 53us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304796.441218:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000100:00100000:2.0:1789304796.441240:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785698048 00000100:00100000:2.0:1789304796.441243:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785698048 00000100:00100000:2.0:1789304796.441268:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1789304796.441274:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785698048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.441302:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785698048:12345-0@lo:400:kworker.0 Request processed in 29us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304796.441309:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1789304796.441351:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785698048:0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.441380:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785698560:0@lo:400:kworker.0 00000100:00100000:3.0:1789304796.445433:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785698304:0@lo:400:kworker.0 00000100:00100000:0.0:1789304796.453176:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785698176:12345-0@lo:400:kworker.0 Request processed in 18106us (18270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304796.453193:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00080000:0.0:1789304796.453250:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304796.453257:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304796.453260:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304796.454519:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785698176:0@lo:400:kworker.0 00000100:00100000:1.0:1789304796.457141:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304796.466027:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785698432 00000100:00100000:2.0:1789304796.466043:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785698432 00000100:00100000:2.0:1789304796.466866:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00100000:2.0:1789304796.466881:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785698432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304796.466970:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785698432:12345-0@lo:400:kworker.0 Request processed in 94us (9837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304796.466977:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00080000:0.0:1789304796.467288:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304796.467344:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785698432:0@lo:400:kworker.0 00010000:00010000:2.0:1789304796.498328:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304797.524670:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304798.546505:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304798.994716:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785698816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304798.994832:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304798.994952:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785698816 00000100:00100000:2.0:1789304798.994961:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785698816 00000100:00100000:2.0:1789304798.995049:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:2.0:1789304798.995060:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785698816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304798.995117:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304798.995203:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304799.006452:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785698816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11384us (11609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304799.006473:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:3.0:1789304799.008524:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785698816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304799.080081:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304799.080173:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304799.080211:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304799.080504:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765624320 00000100:00100000:0.0:1789304799.080516:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765624320 00000100:00100000:0.0:1789304799.080589:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1604 00000100:00100000:0.0:1789304799.080603:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765624320:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304799.080689:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765624320:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304799.080697:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1604 00000100:00100000:1.0:1789304799.080832:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765624576 00000100:00100000:1.0:1789304799.080837:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765624576 00000100:00100000:1.0:1789304799.080879:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1221 00000100:00100000:1.0:1789304799.080887:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765624576:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304799.080915:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765624576:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304799.080923:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1221 00000100:00080000:0.0:1789304799.080925:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304799.080933:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304799.082861:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304799.082976:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765624448 00000100:00100000:0.0:1789304799.082987:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765624448 00000100:00100000:0.0:1789304799.083051:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1222 00000100:00100000:0.0:1789304799.083061:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765624448:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304799.083175:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765624448:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 116us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304799.083182:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1222 00000100:00100000:0.0:1789304799.083246:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765624192 00000100:00100000:0.0:1789304799.083251:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765624192 00000100:00100000:0.0:1789304799.083290:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1271 00000100:00100000:0.0:1789304799.083297:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765624192:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304799.083320:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765624192:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (3148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304799.083327:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1271 00000100:00080000:2.0:1789304799.083722:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304799.570533:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304800.019172:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304800.023457:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785698944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304800.023537:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304800.029279:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785698944 00000100:00100000:2.0:1789304800.029296:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785698944 00000100:00100000:2.0:1789304800.029386:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:2.0:1789304800.029399:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785698944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304800.029440:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304800.029541:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785698944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (6003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304800.029547:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00080000:0.0:1789304800.030050:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304800.030205:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785698944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304800.595915:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304801.554420:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304801.554445:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785699456:0@lo:400:kworker.0 00000100:00100000:2.0:1789304801.554524:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304801.554598:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785699072:0@lo:400:kworker.0 00000100:00100000:2.0:1789304801.554631:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304801.554760:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304801.554767:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785699584:0@lo:400:kworker.0 00000100:00100000:2.0:1789304801.554792:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304801.554849:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785699456 00000100:00100000:2.0:1789304801.554857:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785699456 00000100:00100000:2.0:1789304801.554908:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785699584 00000100:00100000:2.0:1789304801.554910:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785699584 00000100:00100000:2.0:1789304801.554932:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:2.0:1789304801.554941:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785699456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304801.554999:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785699456:12345-0@lo:400:kworker.0 Request processed in 59us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304801.555008:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00100000:2.0:1789304801.555026:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:2.0:1789304801.555031:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785699584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304801.555056:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785699584:12345-0@lo:400:kworker.0 Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304801.555062:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000100:00100000:2.0:1789304801.555130:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785699584:0@lo:400:kworker.0 00000100:00100000:2.0:1789304801.555142:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785699456:0@lo:400:kworker.0 00000100:00100000:3.0:1789304801.555387:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785699200:0@lo:400:kworker.0 00000100:00100000:3.0:1789304801.555422:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304801.555458:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785699712:0@lo:400:kworker.0 00000100:00100000:3.0:1789304801.555485:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304801.555508:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304801.555514:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785699328:0@lo:400:kworker.0 00000100:00100000:3.0:1789304801.555536:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304801.559862:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785699200 00000100:00100000:2.0:1789304801.559888:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785699200 00000100:00100000:2.0:1789304801.559964:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:2.0:1789304801.559976:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785699200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304801.560125:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785699200:12345-0@lo:400:kworker.0 Request processed in 117us (4667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304801.560132:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00100000:2.0:1789304801.560177:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785699712 00000100:00100000:2.0:1789304801.560182:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785699712 00000100:00080000:1.0:1789304801.560380:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304801.560386:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304801.560447:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785699200:0@lo:400:kworker.0 00000100:00100000:0.0:1789304801.562352:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785699072 00000100:00100000:0.0:1789304801.562367:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785699072 00000100:00100000:0.0:1789304801.562432:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1789304801.562441:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785699072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304801.562538:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785699072:12345-0@lo:400:kworker.0 Request processed in 98us (7905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304801.562545:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1789304801.562611:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785699072:0@lo:400:kworker.0 00000100:00100000:3.0:1789304801.563660:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785699328 00000100:00100000:3.0:1789304801.563671:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785699328 00000100:00100000:2.0:1789304801.565847:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1789304801.565871:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785699712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304801.565983:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785699712:12345-0@lo:400:kworker.0 Request processed in 124us (10496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304801.565990:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1789304801.566086:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785699712:0@lo:400:kworker.0 00000100:00100000:3.0:1789304801.576159:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1789304801.576190:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785699328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304801.576488:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785699328:12345-0@lo:400:kworker.0 Request processed in 315us (20950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304801.576498:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1789304801.576624:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785699328:0@lo:400:kworker.0 00010000:00010000:2.0:1789304801.618394:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304802.314269:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304802.314999:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765624704 00000100:00100000:2.0:1789304802.315013:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765624704 00000100:00100000:2.0:1789304802.315241:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1029 00000100:00100000:2.0:1789304802.315253:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:54074:x1876219765624704:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304802.315373:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:54074:x1876219765624704:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 121us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304802.315380:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1029 00000100:00100000:0.0:1789304802.319266:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304802.319512:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765624832 00000100:00100000:2.0:1789304802.319522:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765624832 00000100:00080000:1.0:1789304802.320829:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304802.320839:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304802.326531:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 563 00000100:00100000:2.0:1789304802.326552:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:54074:x1876219765624832:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304802.327060:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:54074:x1876219765624832:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 515us (7803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304802.327069:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 563 00000100:00100000:3.0:1789304802.332189:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304802.332400:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765624960 00000100:00100000:0.0:1789304802.332410:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765624960 00000100:00080000:1.0:1789304802.335943:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304802.339257:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 564 00000100:00100000:0.0:1789304802.339277:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:54074:x1876219765624960:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304802.339599:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:54074:x1876219765624960:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 329us (7420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304802.339607:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 564 00000100:00100000:3.0:1789304802.344353:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304802.344458:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765625088 00000100:00100000:1.0:1789304802.344469:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765625088 00000100:00100000:1.0:1789304802.344532:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1030 00000100:00100000:1.0:1789304802.344543:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:54074:x1876219765625088:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304802.345018:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:54074:x1876219765625088:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 475us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304802.345026:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1030 00000100:00100000:1.0:1789304802.351449:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304802.351636:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765625216 00000100:00100000:0.0:1789304802.351648:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765625216 00000100:00100000:0.0:1789304802.351712:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1031 00000100:00100000:0.0:1789304802.351733:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:54074:x1876219765625216:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304802.351845:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:54074:x1876219765625216:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 123us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304802.351854:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1031 00000100:00100000:3.0:1789304802.354193:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304802.354301:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765625344 00000100:00100000:2.0:1789304802.354311:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765625344 00000100:00100000:2.0:1789304802.354372:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 565 00000100:00100000:2.0:1789304802.354383:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:54074:x1876219765625344:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304802.354953:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:54074:x1876219765625344:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 570us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304802.354963:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 565 00000100:00100000:3.0:1789304802.361524:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304802.365125:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765625472 00000100:00100000:2.0:1789304802.365142:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765625472 00000100:00100000:2.0:1789304802.365219:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 566 00000100:00100000:2.0:1789304802.365231:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:54074:x1876219765625472:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304802.367034:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:54074:x1876219765625472:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1794us (5510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304802.367053:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 566 00000100:00100000:1.0:1789304802.373262:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304802.373355:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765625600 00000100:00100000:0.0:1789304802.373367:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765625600 00000100:00100000:0.0:1789304802.373429:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1032 00000100:00100000:0.0:1789304802.373440:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54074:x1876219765625600:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304802.373933:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54074:x1876219765625600:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 493us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304802.373942:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1032 00000100:00100000:1.0:1789304802.416235:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304802.417057:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765625728 00000100:00100000:3.0:1789304802.417070:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765625728 00000100:00100000:3.0:1789304802.418368:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1033 00000100:00100000:3.0:1789304802.418382:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:54075:x1876219765625728:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304802.418401:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304802.418423:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610070e expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304802.418499:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129715d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304802.418514:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304802.418530:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304802.418567:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:3.0:1789304802.418571:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304802.418592:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304802.418617:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610070e expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304802.421771:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129715d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610070e expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304802.421791:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:3.0:1789304802.421794:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304802.421799:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f800, rc 0) 00000100:00100000:3.0:1789304802.421879:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:54075:x1876219765625728:12345-192.168.202.29@tcp:101:rm.0 Request processed in 3500us (5651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304802.421889:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1033 00000100:00100000:3.0:1789304802.432031:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304802.432275:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765625984 00000100:00100000:3.0:1789304802.432286:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765625984 00000100:00100000:3.0:1789304802.432853:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1034 00000100:00100000:3.0:1789304802.432866:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:54075:x1876219765625984:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304802.432888:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304802.432911:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297164 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100715 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304802.434261:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00010000:3.0:1789304802.434537:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297164 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100715 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304802.434555:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789304802.434558:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789304802.434564:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297164 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100715 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304802.434582:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304802.434737:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:54075:x1876219765625984:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1874us (2716us total) trans 4294967692 rc 301/301 00000100:00100000:3.0:1789304802.434745:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1034 00000100:00100000:0.0:1789304802.447127:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304802.448247:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765626112 00000100:00100000:3.0:1789304802.448260:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765626112 00000100:00100000:3.0:1789304802.448316:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 104 00000100:00100000:3.0:1789304802.448328:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:54075:x1876219765626112:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:3.0:1789304802.458945:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:54075:x1876219765626112:12345-192.168.202.29@tcp:37:rm.0 Request processed in 10608us (11841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304802.458958:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 104 00000100:00100000:0.0:1789304802.480196:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304802.480246:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765626368 00000100:00100000:0.0:1789304802.480256:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765626368 00000100:00100000:0.0:1789304802.480308:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 105 00000100:00100000:0.0:1789304802.480321:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:54075:x1876219765626368:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:0.0:1789304802.480839:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:54075:x1876219765626368:12345-192.168.202.29@tcp:35:rm.0 Request processed in 518us (648us total) trans 4294967693 rc 0/0 00000100:00100000:0.0:1789304802.480849:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 105 00000100:00100000:0.0:1789304802.490656:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304802.490720:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765626624 00000100:00100000:1.0:1789304802.490740:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765626624 00000100:00100000:1.0:1789304802.490817:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1035 00000100:00100000:1.0:1789304802.490828:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:54075:x1876219765626624:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:1.0:1789304802.490889:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789304802.490916:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb723129715d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610070e expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.490937:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861006f9 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.490948:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231296d58) 00010000:00010000:1.0:1789304802.490952:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:1.0:1789304802.490963:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304802.490987:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297172 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491000:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297172 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491010:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297172 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491022:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297179 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491028:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297179 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491033:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297179 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491827:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297180 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491839:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491851:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491889:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491897:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297180 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491904:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297180 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491910:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304802.491915:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297180 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491923:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297180 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491932:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c14adde00) 00010000:00010000:1.0:1789304802.491935:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789304802.491939:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297180 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491945:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297180 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491961:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297172 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491967:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297172 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491973:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297172 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491978:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304802.491981:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297172 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491987:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297172 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.491994:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add300) 00010000:00010000:1.0:1789304802.491997:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304802.491999:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297172 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.492005:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297172 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.492014:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297179 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.492020:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297179 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.492026:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297179 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.492031:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304802.492034:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297179 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.492044:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297179 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.492051:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c14addf00) 00010000:00010000:1.0:1789304802.492053:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304802.492056:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297179 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304802.492062:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297179 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304802.492169:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:54075:x1876219765626624:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1340us (1521us total) trans 0 rc -13/-13 00000100:00100000:1.0:1789304802.492177:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1035 00010000:00010000:2.0:1789304802.655182:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304803.667722:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304804.122233:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304804.122257:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785699840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304804.122328:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304804.122392:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785699840 00000100:00100000:3.0:1789304804.122401:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785699840 00000100:00100000:3.0:1789304804.122460:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1789304804.122469:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785699840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304804.122504:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304804.122561:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785699840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304804.122568:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00080000:3.0:1789304804.122587:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304804.122625:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785699840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304804.215502:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304804.215741:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304804.215781:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304804.215866:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304804.215907:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765627136 00000100:00100000:1.0:1789304804.215920:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765627136 00000100:00100000:1.0:1789304804.215976:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765627008 00000100:00100000:1.0:1789304804.215979:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765627008 00000100:00100000:1.0:1789304804.216004:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1225 00000100:00100000:1.0:1789304804.216013:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765627136:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304804.216084:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765627136:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 72us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304804.216118:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1225 00000100:00100000:1.0:1789304804.216136:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1226 00000100:00100000:1.0:1789304804.216143:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765627008:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304804.216168:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765627008:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304804.216174:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1226 00000100:00080000:1.0:1789304804.216190:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304804.216195:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304804.216702:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765626752 00000100:00100000:3.0:1789304804.216717:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765626752 00000100:00100000:3.0:1789304804.216772:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1273 00000100:00100000:3.0:1789304804.216781:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765626752:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304804.216812:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765626752:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 34us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304804.216818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1273 00000100:00100000:1.0:1789304804.221224:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765626880 00000100:00100000:1.0:1789304804.221243:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765626880 00000100:00100000:1.0:1789304804.221336:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1608 00000100:00100000:1.0:1789304804.221348:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765626880:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304804.221431:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765626880:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 85us (5689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304804.221440:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1608 00000100:00080000:1.0:1789304804.221462:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789304804.230038:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967693 is committed 00010000:00010000:2.0:1789304804.691269:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304805.138600:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785699968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304805.138678:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304805.140798:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785699968 00000100:00100000:3.0:1789304805.140818:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785699968 00000100:00100000:3.0:1789304805.141752:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1789304805.141767:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785699968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304805.141814:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789304805.142278:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304805.145617:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785699968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3842us (6926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304805.145635:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:0.0:1789304805.154397:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785699968:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304805.714458:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304805.954551:0:92036:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1ac2c970 20000000:00000080:2.0:1789304805.954571:0:92036:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412a8400 uarg=0000000000000000 00010000:00010000:2.0:1789304805.955373:0:92036:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304805.955391:0:92036:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304805.955405:0:92036:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304805.955426:0:92036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304805.955447:0:92036:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312970df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312970d8 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304805.955456:0:92036:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304805.955575:0:92036:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312970df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312970d8 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304805.955589:0:92036:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312970df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312970d8 expref: 18 pid: 5845 timeout: 2405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304805.955603:0:92036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92036:1876219785700096:0@lo:104: 00000100:00100000:2.0:1789304805.955674:0:92036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304805.955786:0:92036:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8000 going to sleep for 11 seconds 00000100:00100000:1.0:1789304805.955895:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789304805.955910:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785700096 00000100:00100000:1.0:1789304805.955918:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785700096 00000100:00100000:1.0:1789304805.956067:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789304805.956077:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f72e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:92036:x1876219785700096:12345-0@lo:104: 00010000:00010000:1.0:1789304805.956119:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304805.956179:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304805.956184:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f72e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:92036:x1876219785700096:12345-0@lo:104: Request processed in 110us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304805.956195:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789304805.956289:0:92036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92036:1876219785700096:0@lo:104: 00010000:00010000:3.0:1789304805.956308:0:92036:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956373:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304805.956381:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956388:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304805.956392:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956400:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304805.956408:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304805.956413:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304805.956453:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956460:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304805.956492:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956499:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb72312970d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312970df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956517:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304805.956519:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304805.956520:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304805.956527:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304805.956538:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785700224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304805.956573:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304805.956608:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785700224 00000100:00100000:0.0:1789304805.956612:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785700224 00010000:00010000:0.0:1789304805.956632:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312970df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312970d8 expref: 19 pid: 5845 timeout: 2405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304805.956653:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1789304805.956660:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785700224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304805.956670:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304805.956674:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312970df lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312970d8 expref: 19 pid: 5845 timeout: 2405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956685:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312970df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312970d8 expref: 19 pid: 5845 timeout: 2405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956708:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312970df lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312970d8 expref: 19 pid: 5845 timeout: 2405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956721:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956729:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956753:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956760:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956767:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956773:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956778:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304805.956783:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956790:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956803:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304805.956812:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304805.956838:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785700224:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304805.956844:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1789304805.956897:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785700224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304805.957018:0:92036:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304805.957028:0:92036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304805.957034:0:92036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecca00/0xefc0bb7231297187 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304806.674604:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785700608:0@lo:400:kworker.0 00000100:00100000:0.0:1789304806.674675:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304806.674746:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304806.674753:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785700736:0@lo:400:kworker.0 00000100:00100000:0.0:1789304806.674777:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304806.674835:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785700608 00000100:00100000:0.0:1789304806.674844:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785700608 00000100:00100000:0.0:1789304806.674888:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:0.0:1789304806.674898:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785700608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304806.674948:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785700608:12345-0@lo:400:kworker.0 Request processed in 52us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304806.674956:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:0.0:1789304806.674979:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785700736 00000100:00100000:0.0:1789304806.674983:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785700736 00000100:00100000:0.0:1789304806.675014:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1789304806.675020:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785700736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304806.675049:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785700736:12345-0@lo:400:kworker.0 Request processed in 29us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304806.675054:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1789304806.675114:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785700736:0@lo:400:kworker.0 00000100:00100000:0.0:1789304806.675127:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785700608:0@lo:400:kworker.0 00000100:00080000:0.0:1789304806.675150:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304806.675376:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785700480:0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675407:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304806.675442:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785700992:0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675464:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304806.675485:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789304806.675491:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785700352:0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675515:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304806.675536:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785700864:0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675557:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304806.675584:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785700992 00000100:00100000:2.0:1789304806.675588:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785700992 00000100:00100000:2.0:1789304806.675619:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1789304806.675625:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785700992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675660:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785700992:12345-0@lo:400:kworker.0 Request processed in 35us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304806.675666:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1789304806.675695:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785700352 00000100:00100000:2.0:1789304806.675698:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785700352 00000100:00100000:2.0:1789304806.675722:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1789304806.675728:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785700352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675756:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785700352:12345-0@lo:400:kworker.0 Request processed in 28us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304806.675761:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1789304806.675785:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785700480 00000100:00100000:2.0:1789304806.675789:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785700480 00000100:00100000:2.0:1789304806.675809:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785700864 00000100:00100000:2.0:1789304806.675811:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785700864 00000100:00100000:2.0:1789304806.675830:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:2.0:1789304806.675835:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785700480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675865:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785700480:12345-0@lo:400:kworker.0 Request processed in 30us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304806.675871:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:2.0:1789304806.675883:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:2.0:1789304806.675889:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785700864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675914:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785700864:12345-0@lo:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304806.675919:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00100000:2.0:1789304806.675944:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785700352:0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675953:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785700864:0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675962:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785700480:0@lo:400:kworker.0 00000100:00100000:2.0:1789304806.675970:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785700992:0@lo:400:kworker.0 00000100:00080000:0.0:1789304806.677866:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304806.677877:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789304806.738822:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304806.995929:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304806.995939:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304806.995944:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304806.995987:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304806.996001:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304806.996013:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304806.996042:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785701120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304806.996125:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304806.996172:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03853b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789304806.996203:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785701120 00000100:00100000:2.0:1789304806.996210:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785701120 00000100:00100000:2.0:1789304806.996259:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1789304806.996268:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785701120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304806.996280:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304806.996293:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231297195 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129718e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304806.996330:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231297195 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129718e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304806.996341:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231297195 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129718e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304806.996350:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd200, rc 0) 00000100:00100000:2.0:1789304806.996389:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785701120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304806.996396:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1789304806.996447:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785701120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304806.996461:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304806.996470:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304806.996488:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304806.996494:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304806.996502:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789304807.022554:0:92085:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd92f8920 20000000:00000080:3.0:1789304807.022574:0:92085:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f6df400 uarg=0000000000000000 10000000:01000000:3.0:1789304807.022622:0:92085:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304807.022645:0:92085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304807.022665:0:92085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231297195 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129718e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304807.022674:0:92085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304807.022752:0:92085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231297195 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129718e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304807.022774:0:92085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231297195 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129718e expref: 18 pid: 5845 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304807.022791:0:92085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92085:1876219785701248:0@lo:104: 00000100:00100000:3.0:1789304807.022869:0:92085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304807.022922:0:92085:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c078ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304807.022926:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785701248 00000100:00100000:0.0:1789304807.022935:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785701248 00000100:00100000:0.0:1789304807.022993:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789304807.023004:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:92085:x1876219785701248:12345-0@lo:104: 00010000:00010000:0.0:1789304807.023017:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304807.023112:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304807.023119:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:92085:x1876219785701248:12345-0@lo:104: Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304807.023126:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00010000:00010000:1.0:1789304807.023202:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304807.023210:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023218:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304807.023222:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023230:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304807.023236:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304807.023242:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304807.023284:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023290:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304807.023315:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023322:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129718e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297195 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023339:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304807.023341:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304807.023343:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304807.023392:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785701376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304807.023424:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304807.023617:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785701376 00000100:00100000:1.0:1789304807.023622:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785701376 00010000:00010000:1.0:1789304807.023643:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231297195 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129718e expref: 19 pid: 5845 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304807.023692:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1789304807.023700:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785701376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304807.023712:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304807.023716:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231297195 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129718e expref: 19 pid: 5845 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023725:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231297195 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129718e expref: 19 pid: 5845 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023742:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023750:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023764:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023772:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023780:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023787:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023793:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304807.023798:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023805:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023814:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304807.023824:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304807.023854:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785701376:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304807.023860:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00010000:00010000:3.0:1789304807.024040:0:92085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231297195 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129718e expref: 18 pid: 5845 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304807.024051:0:92085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92085:1876219785701248:0@lo:104: 00010000:00010000:3.0:1789304807.024070:0:92085:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304807.024079:0:92085:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304807.024085:0:92085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304807.024121:0:92085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb723129719c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304807.029277:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785701376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304807.767893:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304808.530402:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304808.530410:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304808.530416:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304808.530464:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304808.530477:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304808.530497:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304808.530523:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785701504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304808.530594:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304808.530720:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03853b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789304808.531178:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785701504 00000100:00100000:3.0:1789304808.531188:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785701504 00000100:00100000:3.0:1789304808.531573:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1789304808.531586:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785701504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304808.531725:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304808.531748:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312971aa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312971a3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304808.531774:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312971aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312971a3 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304808.531785:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312971aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312971a3 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304808.531793:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304808.532212:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785701504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 628us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304808.532219:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1789304808.532563:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785701504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304808.532582:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304808.532591:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304808.532685:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304808.532692:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304808.532701:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304808.789031:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304809.234897:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785701632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304809.234975:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304809.235054:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785701632 00000100:00100000:1.0:1789304809.235062:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785701632 00000100:00100000:1.0:1789304809.235136:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1789304809.235147:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785701632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304809.235185:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304809.235236:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785701632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304809.235243:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00080000:1.0:1789304809.235268:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304809.235392:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785701632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304809.315437:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304809.315479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304809.315504:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304809.315809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304809.315842:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765627520 00000100:00100000:0.0:1789304809.315855:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765627520 00000100:00100000:0.0:1789304809.315927:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765627648 00000100:00100000:0.0:1789304809.315930:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765627648 00000100:00100000:0.0:1789304809.315957:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1229 00000100:00100000:0.0:1789304809.315966:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765627520:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304809.316043:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765627520:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 77us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304809.316050:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1229 00000100:00100000:0.0:1789304809.316070:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1230 00000100:00100000:0.0:1789304809.316077:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765627648:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304809.316131:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765627648:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 55us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304809.316141:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1230 00000100:00100000:0.0:1789304809.316162:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765627392 00000100:00100000:0.0:1789304809.316166:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765627392 00000100:00100000:0.0:1789304809.316197:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1612 00000100:00100000:0.0:1789304809.316204:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765627392:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304809.316232:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765627392:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304809.316238:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1612 00000100:00080000:1.0:1789304809.316273:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304809.316279:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304809.316474:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304809.319018:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765627264 00000100:00100000:3.0:1789304809.319035:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765627264 00000100:00100000:3.0:1789304809.319287:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1277 00000100:00100000:3.0:1789304809.319300:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765627264:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304809.319386:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765627264:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (3955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304809.319394:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1277 00010000:00010000:2.0:1789304809.817597:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304810.275368:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785701760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304810.275451:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304810.275532:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785701760 00000100:00100000:1.0:1789304810.275541:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785701760 00000100:00100000:1.0:1789304810.275602:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:1.0:1789304810.275612:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785701760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304810.275659:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304810.277904:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785701760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2288us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304810.277918:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00080000:1.0:1789304810.277957:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304810.278016:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785701760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304810.295887:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304810.296897:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765627776 00000100:00100000:2.0:1789304810.296911:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765627776 00000100:00100000:2.0:1789304810.296977:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1036 00000100:00100000:2.0:1789304810.296989:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:54190:x1876219765627776:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304810.297012:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304810.297036:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312971b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610071c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.297123:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312971b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.297138:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312971b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.297154:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312971b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304810.297192:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789304810.297197:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304810.297220:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312971b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.297246:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312971b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610071c expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.297270:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312971b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610071c expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.297280:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:2.0:1789304810.297283:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304810.297287:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd200, rc 0) 00000100:00100000:2.0:1789304810.297362:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:54190:x1876219765627776:12345-192.168.202.29@tcp:101:rm.0 Request processed in 374us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304810.297370:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1036 00000100:00100000:3.0:1789304810.305637:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304810.306898:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765627904 00000100:00100000:1.0:1789304810.306911:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765627904 00000100:00100000:1.0:1789304810.306978:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1037 00000100:00100000:1.0:1789304810.306988:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54190:x1876219765627904:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304810.307011:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304810.307034:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312971bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100723 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307119:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307136:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307149:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307171:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312971cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307179:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312971cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307186:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312971cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307476:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb72312971d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307486:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb72312971d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307493:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb72312971d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304810.307529:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:1.0:1789304810.307533:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304810.307554:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb72312971d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307567:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307574:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307580:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307590:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304810.307594:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307602:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307614:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:1.0:1789304810.307617:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304810.307623:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307628:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307640:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312971cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.307646:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312971cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.308911:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312971cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.308919:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304810.308923:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312971cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.308932:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312971cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.308956:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c14add400) 00010000:00010000:1.0:1789304810.308959:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304810.308965:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312971cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.308972:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312971cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.309039:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312971bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100723 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.309053:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb72312971d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100723 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.309060:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:1.0:1789304810.309062:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304810.309065:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371600, rc 0) 00000100:00100000:1.0:1789304810.309163:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:54190:x1876219765627904:12345-192.168.202.29@tcp:101:rm.0 Request processed in 2175us (3533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304810.309173:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1037 00000100:00100000:1.0:1789304810.317959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304810.318040:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765628160 00000100:00100000:2.0:1789304810.318054:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765628160 00000100:00100000:2.0:1789304810.318188:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1038 00000100:00100000:2.0:1789304810.318200:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:54190:x1876219765628160:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304810.318227:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304810.318254:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312971db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610072a expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304810.318352:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00010000:2.0:1789304810.318601:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312971db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610072a expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.318616:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:2.0:1789304810.318620:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789304810.318626:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb72312971db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610072a expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.318645:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789304810.318960:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:54190:x1876219765628160:12345-192.168.202.29@tcp:101:rm.0 Request processed in 761us (1010us total) trans 4294967694 rc 301/301 00000100:00100000:2.0:1789304810.318968:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1038 00000100:00100000:0.0:1789304810.323181:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304810.323368:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765628288 00000100:00100000:2.0:1789304810.323381:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765628288 00000100:00100000:2.0:1789304810.323505:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 106 00000100:00100000:2.0:1789304810.323522:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:54190:x1876219765628288:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:2.0:1789304810.327017:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:54190:x1876219765628288:12345-192.168.202.29@tcp:37:rm.0 Request processed in 3493us (3836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304810.327029:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 106 00000100:00100000:1.0:1789304810.333697:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304810.337208:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765628544 00000100:00100000:0.0:1789304810.337226:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765628544 00000100:00100000:0.0:1789304810.337293:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 107 00000100:00100000:0.0:1789304810.337302:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:54190:x1876219765628544:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:0.0:1789304810.337547:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:54190:x1876219765628544:12345-192.168.202.29@tcp:35:rm.0 Request processed in 245us (3861us total) trans 4294967695 rc 0/0 00000100:00100000:0.0:1789304810.337555:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 107 00000100:00100000:0.0:1789304810.340450:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304810.340540:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765628800 00000100:00100000:1.0:1789304810.340551:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765628800 00000100:00100000:1.0:1789304810.340609:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1039 00000100:00100000:1.0:1789304810.340620:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:54190:x1876219765628800:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:1.0:1789304810.340698:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304810.340898:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb72312971d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100723 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.340917:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:1.0:1789304810.340932:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312971b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610071c expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.340940:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2c00) 00010000:00010000:1.0:1789304810.340946:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304810.340970:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.340983:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.340992:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.341003:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.341009:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.341015:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.342553:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312971f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.342570:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312971f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.342582:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312971f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304810.343390:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00010000:0.0:1789304810.343409:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312971f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343418:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312971f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343424:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312971f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343430:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304810.343435:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312971f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343442:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312971f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343453:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9e2c0558d000) 00010000:00010000:0.0:1789304810.343457:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789304810.343462:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312971f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343474:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312971f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343498:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343504:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343514:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343518:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304810.343521:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343526:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343534:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add400) 00010000:00010000:0.0:1789304810.343536:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304810.343539:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.343545:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371e00/0xefc0bb72312971e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304810.343558:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069d54e08 reply state 00000000ba762007 transno 4294967696 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304810.343568:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304810.343713:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:54190:x1876219765628800:12345-192.168.202.29@tcp:36:rm.0 Request processed in 3091us (3271us total) trans 4294967696 rc 0/0 00000100:00100000:0.0:1789304810.343722:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1039 00010000:00010000:2.0:1789304810.353550:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.353568:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.353575:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.353580:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304810.353585:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.353593:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.353612:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c14adde00) 00010000:00010000:2.0:1789304810.353615:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304810.353620:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.353626:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb72312971f0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304810.408420:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304810.408494:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765628928 00000100:00100000:1.0:1789304810.408506:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765628928 00000100:00100000:1.0:1789304810.408577:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1040 00000100:00100000:1.0:1789304810.408588:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:54194:x1876219765628928:12345-192.168.202.29@tcp:101:mkdir.0 00010000:00010000:1.0:1789304810.408613:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304810.408637:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312971fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100731 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.408752:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297205 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.408771:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.408784:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304810.408826:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789304810.408830:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304810.408850:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.408874:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312971fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100731 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.408898:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297205 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100731 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.408905:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:1.0:1789304810.408907:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304810.408911:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370600, rc 0) 00000100:00100000:1.0:1789304810.408980:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:54194:x1876219765628928:12345-192.168.202.29@tcp:101:mkdir.0 Request processed in 394us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304810.408987:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1040 00000100:00100000:0.0:1789304810.414911:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304810.419105:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765629056 00000100:00100000:3.0:1789304810.419125:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765629056 00000100:00100000:3.0:1789304810.419211:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1041 00000100:00100000:3.0:1789304810.419222:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:2355:x1876219765629056:12345-192.168.202.29@tcp:41:mkdir.0 00000004:00000024:3.0:1789304810.419271:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789304810.419835:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:2355:x1876219765629056:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 612us (4932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304810.419848:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1041 00000100:00100000:2.0:1789304810.420014:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304810.420504:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765629312 00000100:00100000:0.0:1789304810.420513:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765629312 00000100:00100000:0.0:1789304810.420607:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1042 00000100:00100000:0.0:1789304810.420617:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:54194:x1876219765629312:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:0.0:1789304810.420677:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304810.420718:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb7231297205 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100731 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.420742:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:0.0:1789304810.420754:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304810.420854:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129720c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.420872:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129720c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.420885:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129720c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.420910:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.420922:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.420928:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304810.422381:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00010000:0.0:1789304810.422400:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129720c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.422411:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129720c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.422420:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129720c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.422427:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304810.422432:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129720c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.422440:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129720c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.422803:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d000) 00010000:00010000:0.0:1789304810.422807:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304810.422816:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129720c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.422822:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129720c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304810.422842:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e25a893b reply state 000000009efcd843 transno 4294967697 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304810.422852:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304810.423025:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:54194:x1876219765629312:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 2405us (3006us total) trans 4294967697 rc 0/0 00000100:00100000:0.0:1789304810.423036:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1042 00010000:00010000:2.0:1789304810.425826:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.425845:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.425854:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.425860:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304810.425867:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.425875:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.425893:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c0558d600) 00010000:00010000:2.0:1789304810.425896:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304810.425902:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.425912:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297213 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304810.470209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304810.470325:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765629440 00000100:00100000:0.0:1789304810.470339:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765629440 00000100:00100000:0.0:1789304810.470412:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1043 00000100:00100000:0.0:1789304810.470423:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:54198:x1876219765629440:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:0.0:1789304810.470447:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304810.470473:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129721a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100738 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.470547:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297221 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.470561:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.470572:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304810.470608:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789304810.470612:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304810.470635:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.470678:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129721a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100738 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.470715:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100738 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.470727:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d000) 00010000:00010000:0.0:1789304810.470730:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304810.470743:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789304810.470812:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:54198:x1876219765629440:12345-192.168.202.29@tcp:101:chown.0 Request processed in 391us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304810.470820:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1043 00000100:00100000:1.0:1789304810.479564:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304810.479685:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765629568 00000100:00100000:3.0:1789304810.479696:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765629568 00000100:00100000:3.0:1789304810.479860:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1044 00000100:00100000:3.0:1789304810.479870:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:54198:x1876219765629568:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:3.0:1789304810.479894:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304810.479916:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610073f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.479983:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129722f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.479999:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129722f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480010:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129722f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480024:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297236 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480031:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480037:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480323:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129723d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480336:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129723d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480343:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129723d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304810.480375:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789304810.480378:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304810.480396:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129723d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480407:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129722f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480414:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129722f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480421:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129722f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480427:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304810.480431:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129722f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480438:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129722f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480448:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d000) 00010000:00010000:3.0:1789304810.480451:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304810.480455:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129722f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480465:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129722f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480478:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480484:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297236 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480490:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297236 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480495:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304810.480497:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297236 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480503:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297236 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480509:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304810.480511:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304810.480513:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297236 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480518:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297236 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480545:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610073f expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480557:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129723d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610073f expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304810.480565:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304810.480567:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304810.480569:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e000, rc 0) 00000100:00100000:3.0:1789304810.480629:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:54198:x1876219765629568:12345-192.168.202.29@tcp:101:chown.0 Request processed in 761us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304810.480636:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1044 00000100:00100000:2.0:1789304810.483385:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304810.483459:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765629824 00000100:00100000:0.0:1789304810.483469:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765629824 00000100:00100000:0.0:1789304810.483533:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1045 00000100:00100000:0.0:1789304810.483543:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:54198:x1876219765629824:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:0.0:1789304810.483594:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304810.483620:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb723129723d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610073f expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.483640:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:0.0:1789304810.483660:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304810.483686:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.483710:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304810.483721:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789304810.538627:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967698 is committed 00000004:00010000:0.0:1789304810.538943:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5d943ad reply state 0000000052bd206a transno 4294967698 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304810.538958:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304810.538974:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00080000:0.0:1789304810.539174:0:30980:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789304810.539229:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:54198:x1876219765629824:12345-192.168.202.29@tcp:36:chown.0 Request processed in 55683us (55852us total) trans 4294967698 rc 0/0 00000100:00100000:0.0:1789304810.539239:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1045 00010000:00010000:2.0:1789304810.550110:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.550131:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.550140:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.550146:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304810.550151:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.550170:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.550189:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c0558d200) 00010000:00010000:2.0:1789304810.550192:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789304810.550198:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304810.550204:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297244 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304810.834444:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304811.455223:0:92282:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0d834d50 20000000:00000080:3.0:1789304811.455243:0:92282:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f6de400 uarg=0000000000000000 00010000:00010000:3.0:1789304811.461262:0:92282:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789304811.461310:0:92282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d000) 00010000:00010000:3.0:1789304811.461314:0:92282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304811.461325:0:92282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297221 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100738 expref: 5 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304811.461353:0:92282:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789304811.461373:0:92282:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304811.461390:0:92282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304811.461404:0:92282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312971aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312971a3 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304811.461412:0:92282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304811.461451:0:92282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312971aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312971a3 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304811.461471:0:92282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312971aa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312971a3 expref: 18 pid: 5847 timeout: 2411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304811.461486:0:92282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92282:1876219785701888:0@lo:104: 00000100:00100000:3.0:1789304811.461551:0:92282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304811.462978:0:92282:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c078ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304811.463791:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785701888 00000100:00100000:1.0:1789304811.463805:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785701888 00000100:00100000:1.0:1789304811.464017:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789304811.464028:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:92282:x1876219785701888:12345-0@lo:104: 00010000:00010000:1.0:1789304811.464047:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304811.465063:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304811.465077:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:92282:x1876219785701888:12345-0@lo:104: Request processed in 1048us (3523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304811.465111:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00010000:00010000:0.0:1789304811.465181:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304811.465190:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465205:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304811.465210:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465220:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304811.465227:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304811.465233:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304811.465280:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465286:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304811.465311:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465318:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312971a3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312971aa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465340:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304811.465342:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304811.465343:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304811.465353:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304811.465366:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785702016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304811.465409:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304811.465456:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785702016 00000100:00100000:0.0:1789304811.465462:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785702016 00010000:00010000:0.0:1789304811.465486:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312971aa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312971a3 expref: 19 pid: 5847 timeout: 2411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304811.465511:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1789304811.465519:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785702016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304811.465532:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304811.465538:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312971aa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312971a3 expref: 19 pid: 5847 timeout: 2411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465549:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312971aa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312971a3 expref: 19 pid: 5847 timeout: 2411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465568:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465577:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465592:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465599:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465606:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465612:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465618:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304811.465623:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465630:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465650:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304811.465660:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304811.465701:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785702016:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304811.465707:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1789304811.465746:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785702016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304811.470852:0:92282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312971aa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312971a3 expref: 18 pid: 5847 timeout: 2411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304811.470886:0:92282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92282:1876219785701888:0@lo:104: 00010000:00010000:3.0:1789304811.470930:0:92282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304811.471232:0:92282:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304811.471241:0:92282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304811.471246:0:92282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f600/0xefc0bb723129724b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304811.794550:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785702528:0@lo:400:kworker.0 00000100:00100000:3.0:1789304811.794643:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304811.794779:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785702272:0@lo:400:kworker.0 00000100:00100000:0.0:1789304811.794815:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304811.794847:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785702400:0@lo:400:kworker.0 00000100:00100000:0.0:1789304811.794873:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304811.794906:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785702272 00000100:00100000:0.0:1789304811.794915:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785702272 00000100:00100000:0.0:1789304811.794970:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1789304811.794980:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785702272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304811.795039:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785702272:12345-0@lo:400:kworker.0 Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304811.795047:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:3.0:1789304811.795278:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785702528 00000100:00100000:3.0:1789304811.795283:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785702528 00000100:00100000:3.0:1789304811.795320:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785702400 00000100:00100000:3.0:1789304811.795323:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785702400 00000100:00100000:3.0:1789304811.795346:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:3.0:1789304811.795353:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785702528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304811.795394:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785702528:12345-0@lo:400:kworker.0 Request processed in 42us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304811.795400:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:3.0:1789304811.795414:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:3.0:1789304811.795421:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785702400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304811.795452:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785702400:12345-0@lo:400:kworker.0 Request processed in 31us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304811.795458:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00080000:3.0:1789304811.795477:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304811.795518:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785702528:0@lo:400:kworker.0 00000100:00100000:0.0:1789304811.795606:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785702272:0@lo:400:kworker.0 00000100:00100000:0.0:1789304811.795620:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789304811.795626:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785702144:0@lo:400:kworker.0 00000100:00100000:0.0:1789304811.795662:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304811.795696:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785702656:0@lo:400:kworker.0 00000100:00100000:0.0:1789304811.795720:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304811.795746:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785702144 00000100:00100000:0.0:1789304811.795749:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785702144 00000100:00100000:0.0:1789304811.795777:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:0.0:1789304811.795784:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785702144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304811.795819:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785702144:12345-0@lo:400:kworker.0 Request processed in 36us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304811.795825:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00100000:0.0:1789304811.795842:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785702656 00000100:00100000:0.0:1789304811.795845:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785702656 00000100:00100000:0.0:1789304811.795874:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1789304811.795880:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785702656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304811.795910:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785702656:12345-0@lo:400:kworker.0 Request processed in 30us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304811.795915:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00080000:0.0:1789304811.795932:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304811.795950:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785702144:0@lo:400:kworker.0 00000100:00100000:0.0:1789304811.795959:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785702656:0@lo:400:kworker.0 00000100:00100000:3.0:1789304811.796275:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785702400:0@lo:400:kworker.0 00010000:00010000:1.0:1789304811.859298:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304812.463811:0:92330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd231f42a0 20000000:00000080:1.0:1789304812.463832:0:92330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b0208dc00 uarg=0000000000000000 10000000:01000000:1.0:1789304812.463880:0:92330:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304812.463911:0:92330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304812.463930:0:92330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304812.463940:0:92330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304812.463948:0:92330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304812.463955:0:92330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304812.463968:0:92330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304812.463974:0:92330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304812.463979:0:92330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304812.463985:0:92330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304812.463999:0:92330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304812.464006:0:92330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304812.464013:0:92330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370800/0xefc0bb7231297252 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304812.887022:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304813.010188:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304813.010198:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304813.010205:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304813.010256:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304813.010269:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304813.010282:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304813.010309:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785702784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304813.010376:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304813.010422:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0246d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789304813.010593:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785702784 00000100:00100000:3.0:1789304813.010602:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785702784 00000100:00100000:3.0:1789304813.010667:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1789304813.010686:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785702784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304813.010699:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304813.010714:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297260 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297259 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304813.010738:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297260 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297259 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304813.010749:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297260 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297259 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304813.010763:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304813.010824:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785702784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304813.010830:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1789304813.012130:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785702784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304813.012155:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304813.012167:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304813.012190:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304813.012195:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304813.012203:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304813.906419:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304814.355314:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785702912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304814.355402:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304814.355580:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785702912 00000100:00100000:1.0:1789304814.355590:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785702912 00000100:00100000:1.0:1789304814.355686:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1789304814.355697:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785702912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304814.355738:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304814.355790:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785702912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304814.355797:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1789304814.355847:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785702912:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304814.356025:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304814.433789:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304814.433829:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304814.433859:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304814.433895:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304814.433925:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765630208 00000100:00100000:2.0:1789304814.433934:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765630208 00000100:00100000:2.0:1789304814.433985:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765630336 00000100:00100000:2.0:1789304814.433988:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765630336 00000100:00100000:2.0:1789304814.434011:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1233 00000100:00100000:2.0:1789304814.434019:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765630208:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304814.434085:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765630208:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304814.434127:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1233 00000100:00100000:2.0:1789304814.434143:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1234 00000100:00100000:2.0:1789304814.434150:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765630336:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304814.434174:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765630336:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304814.434179:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1234 00000100:00080000:2.0:1789304814.434194:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304814.434198:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304814.435050:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765629952 00000100:00100000:3.0:1789304814.435058:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765629952 00000100:00100000:3.0:1789304814.435120:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1279 00000100:00100000:3.0:1789304814.435128:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765629952:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304814.435172:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765629952:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 46us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304814.435179:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1279 00000100:00100000:1.0:1789304814.435579:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765630080 00000100:00100000:1.0:1789304814.435584:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765630080 00000100:00100000:1.0:1789304814.435642:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1616 00000100:00100000:1.0:1789304814.435650:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765630080:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304814.435700:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765630080:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 52us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304814.435706:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1616 00000100:00080000:3.0:1789304814.435937:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304814.930826:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304815.378600:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304815.385025:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785703040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304815.390488:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304815.390538:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785703040 00000100:00100000:1.0:1789304815.390545:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785703040 00000100:00100000:1.0:1789304815.390597:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:1.0:1789304815.390617:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785703040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304815.390794:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304815.390863:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785703040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 258us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304815.390871:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00080000:1.0:1789304815.390900:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304815.390961:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785703040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304815.923680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304815.923781:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765630464 00000100:00100000:1.0:1789304815.923793:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765630464 00000100:00100000:1.0:1789304815.923860:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:1.0:1789304815.923872:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:5593:x1876219765630464:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304815.923895:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304815.923898:0:5838:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231297221) 00010000:00010000:1.0:1789304815.923900:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304815.923970:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:5593:x1876219765630464:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 100us (308us total) trans 0 rc 116/116 00000100:00100000:1.0:1789304815.923977:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 16 00010000:00010000:3.0:1789304815.954308:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304816.915667:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304816.915692:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785703552:0@lo:400:kworker.0 00000100:00100000:1.0:1789304816.915743:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785703680:0@lo:400:kworker.0 00000100:00100000:1.0:1789304816.915811:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304816.915823:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785703296:0@lo:400:kworker.0 00000100:00100000:0.0:1789304816.915852:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304816.915872:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785703808:0@lo:400:kworker.0 00000100:00100000:1.0:1789304816.915874:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785703424:0@lo:400:kworker.0 00000100:00100000:0.0:1789304816.915895:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304816.915924:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785703808 00000100:00100000:0.0:1789304816.915931:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785703680 00000100:00100000:1.0:1789304816.915932:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785703808 00000100:00100000:0.0:1789304816.915933:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785703680 00000100:00100000:0.0:1789304816.915977:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785703296 00000100:00100000:0.0:1789304816.915980:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785703296 00000100:00100000:2.0:1789304816.915982:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:2.0:1789304816.915992:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785703680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304816.915999:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:0.0:1789304816.916003:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785703296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304816.916039:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785703680:12345-0@lo:400:kworker.0 Request processed in 48us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304816.916039:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785703296:12345-0@lo:400:kworker.0 Request processed in 33us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304816.916046:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000100:00100000:3.0:1789304816.916356:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304816.916381:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785703168:0@lo:400:kworker.0 00000100:00100000:3.0:1789304816.916408:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304816.916463:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785703168 00000100:00100000:3.0:1789304816.916468:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785703168 00000100:00100000:3.0:1789304816.916497:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1789304816.916504:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785703168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304816.916540:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785703168:12345-0@lo:400:kworker.0 Request processed in 37us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304816.916546:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1789304816.916622:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785703168:0@lo:400:kworker.0 00000100:00100000:2.0:1789304816.916858:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785703552 00000100:00100000:2.0:1789304816.916864:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785703552 00000100:00100000:1.0:1789304816.916955:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1789304816.916964:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785703808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304816.917005:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785703808:12345-0@lo:400:kworker.0 Request processed in 43us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304816.917015:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1789304816.917049:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785703680:0@lo:400:kworker.0 00000100:00100000:0.0:1789304816.917708:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00100000:2.0:1789304816.917728:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:2.0:1789304816.917738:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785703552:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789304816.917745:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304816.917794:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785703552:12345-0@lo:400:kworker.0 Request processed in 53us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304816.917801:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:1.0:1789304816.917831:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785703552:0@lo:400:kworker.0 00000100:00080000:0.0:1789304816.917907:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304816.917933:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304816.917983:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785703296:0@lo:400:kworker.0 00000100:00100000:0.0:1789304816.917990:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785703808:0@lo:400:kworker.0 00000100:00100000:2.0:1789304816.918121:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785703424 00000100:00100000:2.0:1789304816.918127:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785703424 00000100:00100000:2.0:1789304816.918160:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:2.0:1789304816.918167:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785703424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304816.918241:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785703424:12345-0@lo:400:kworker.0 Request processed in 65us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304816.918247:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1789304816.918574:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785703424:0@lo:400:kworker.0 00010000:00010000:3.0:1789304816.984129:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304817.609038:0:92576:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd93351d80 20000000:00000080:3.0:1789304817.609056:0:92576:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f5f8c00 uarg=0000000000000000 00010000:00010000:3.0:1789304817.614532:0:92576:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789304817.614550:0:92576:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789304817.614563:0:92576:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304817.614593:0:92576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.614614:0:92576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297260 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297259 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.614626:0:92576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.615343:0:92576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297260 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297259 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.615359:0:92576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297260 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297259 expref: 18 pid: 5847 timeout: 2417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304817.615374:0:92576:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92576:1876219785703936:0@lo:104: 00000100:00100000:3.0:1789304817.615505:0:92576:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304817.615627:0:92576:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b04091780 going to sleep for 11 seconds 00000100:00100000:0.0:1789304817.615833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785703936 00000100:00100000:0.0:1789304817.615842:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785703936 00000100:00100000:0.0:1789304817.615933:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789304817.615943:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:92576:x1876219785703936:12345-0@lo:104: 00010000:00010000:0.0:1789304817.615957:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304817.616035:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304817.616041:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:92576:x1876219785703936:12345-0@lo:104: Request processed in 100us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304817.616048:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789304817.616149:0:92576:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92576:1876219785703936:0@lo:104: 00010000:00010000:3.0:1789304817.616170:0:92576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304817.616217:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304817.616226:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304817.616233:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304817.616237:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304817.616245:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304817.616252:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304817.616259:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304817.616299:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304817.616306:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304817.616328:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304817.616336:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecda00/0xefc0bb7231297259 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297260 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304817.616358:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304817.616360:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304817.616361:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304817.616372:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785704064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304817.616405:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304817.616468:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785704064 00000100:00100000:3.0:1789304817.616475:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785704064 00010000:00010000:3.0:1789304817.616494:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297260 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297259 expref: 19 pid: 5847 timeout: 2417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304817.616524:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1789304817.616531:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785704064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304817.616543:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304817.616548:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297260 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297259 expref: 19 pid: 5847 timeout: 2417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616559:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297260 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297259 expref: 19 pid: 5847 timeout: 2417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616572:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297260 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297259 expref: 19 pid: 5847 timeout: 2417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616596:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616605:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616618:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616626:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616642:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616648:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616654:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304817.616658:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616665:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616683:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304817.616693:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304817.616723:0:92576:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304817.616731:0:92576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304817.616739:0:92576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f600/0xefc0bb7231297267 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304817.616744:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785704064:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304817.616751:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1789304817.616802:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785704064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304818.004980:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304818.962912:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304818.962921:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304818.962926:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304818.962982:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304818.962994:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304818.963006:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304818.963031:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785704192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304818.963122:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304818.963184:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13d74c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789304818.963603:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785704192 00000100:00100000:2.0:1789304818.963691:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785704192 00000100:00100000:2.0:1789304818.963755:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:2.0:1789304818.964458:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785704192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304818.964482:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304818.964504:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231297275 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129726e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304818.964536:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231297275 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129726e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304818.964549:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231297275 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129726e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304818.964559:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd600, rc 0) 00000100:00100000:2.0:1789304818.965559:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785704192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1789us (2431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304818.965580:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:1.0:1789304818.965659:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785704192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304818.965685:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304818.965698:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304818.965724:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304818.965729:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304818.965737:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304819.030621:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304819.476862:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304819.476884:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785704320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304819.476950:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304819.477017:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785704320 00000100:00100000:1.0:1789304819.477025:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785704320 00000100:00100000:1.0:1789304819.477074:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:1.0:1789304819.477082:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785704320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304819.477137:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304819.477189:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785704320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304819.477196:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00080000:1.0:1789304819.477216:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304819.477251:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785704320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304819.553735:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304819.553770:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304819.553811:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304819.553850:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304819.553880:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765630976 00000100:00100000:2.0:1789304819.553893:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765630976 00000100:00100000:3.0:1789304819.553898:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765630848 00000100:00100000:3.0:1789304819.553901:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765630848 00000100:00100000:2.0:1789304819.553966:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1237 00000100:00100000:2.0:1789304819.553976:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765630976:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304819.554051:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765630976:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304819.554059:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1237 00000100:00100000:0.0:1789304819.554440:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765630720 00000100:00100000:0.0:1789304819.554446:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765630720 00000100:00100000:3.0:1789304819.556947:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1238 00000100:00100000:3.0:1789304819.556963:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765630848:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304819.557045:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765630848:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 88us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304819.557051:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1238 00000100:00100000:0.0:1789304819.558670:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1620 00000100:00100000:0.0:1789304819.558696:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765630720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304819.558757:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765630720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 67us (5033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304819.558765:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1620 00000100:00100000:3.0:1789304819.574197:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765630592 00000100:00100000:3.0:1789304819.574223:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765630592 00000100:00100000:3.0:1789304819.574287:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1282 00000100:00100000:3.0:1789304819.574298:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765630592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304819.574377:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765630592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (20565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304819.574386:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1282 00000100:00080000:1.0:1789304819.576213:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304819.576223:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304819.576225:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304820.051158:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304820.498291:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785704448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304820.498390:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304820.498634:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785704448 00000100:00100000:1.0:1789304820.498643:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785704448 00000100:00100000:1.0:1789304820.498717:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1789304820.498726:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785704448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304820.498763:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304820.498815:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785704448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304820.498822:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00080000:0.0:1789304820.498934:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304820.499015:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785704448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304820.819074:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304820.819188:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765631104 00000100:00100000:3.0:1789304820.819198:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765631104 00000100:00100000:3.0:1789304820.819254:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1046 00000100:00100000:3.0:1789304820.819265:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:54376:x1876219765631104:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304820.819289:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304820.819310:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129727c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100746 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304820.819370:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297283 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304820.819385:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297283 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304820.819398:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297283 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304820.819434:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789304820.819438:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304820.819460:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297283 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304820.819497:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129727c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100746 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304820.819520:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297283 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100746 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304820.819528:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304820.819531:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304820.819534:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304820.819837:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:54376:x1876219765631104:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 572us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304820.819844:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1046 00000100:00100000:3.0:1789304820.829918:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304820.830398:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765631232 00000100:00100000:1.0:1789304820.830409:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765631232 00000100:00100000:1.0:1789304820.831377:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1047 00000100:00100000:1.0:1789304820.831391:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54376:x1876219765631232:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304820.831413:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304820.831433:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb723129728a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610074d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.831506:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297291 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.831521:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.831532:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.831560:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297298 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.831568:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.831574:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832367:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129729f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832380:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129729f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832387:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129729f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304820.832423:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:1.0:1789304820.832428:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304820.832448:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129729f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832460:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297291 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832528:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297291 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832535:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297291 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832545:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304820.832549:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297291 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832567:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297291 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832579:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:1.0:1789304820.832581:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304820.832586:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297291 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832592:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297291 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832605:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297298 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832681:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297298 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832688:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297298 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832693:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304820.832696:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297298 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832702:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297298 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832713:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c14add900) 00010000:00010000:1.0:1789304820.832716:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304820.832719:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297298 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832725:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297298 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832759:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb723129728a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610074d expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832772:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129729f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610074d expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304820.832780:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:1.0:1789304820.832782:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304820.832785:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371a00, rc 0) 00000100:00100000:1.0:1789304820.833248:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:54376:x1876219765631232:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 1855us (3337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304820.833257:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1047 00000100:00100000:2.0:1789304820.836957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304820.843346:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765631488 00000100:00100000:3.0:1789304820.843363:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765631488 00000100:00100000:3.0:1789304820.843424:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1048 00000100:00100000:3.0:1789304820.843435:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:54376:x1876219765631488:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304820.845316:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304820.845354:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129729f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610074d expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304820.845373:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:3.0:1789304820.845383:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304820.845409:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304820.845422:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304820.845432:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304820.904801:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0e9e36c reply state 00000000bbb84496 transno 4294967699 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304820.904822:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789304820.904839:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000100:00100000:2.0:1789304820.904960:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:54376:x1876219765631488:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 61521us (68006us total) trans 4294967699 rc 0/0 00000100:00100000:2.0:1789304820.904970:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1048 00000001:00080000:2.0:1789304820.905013:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967699 is committed 00010000:00010000:2.0:1789304820.905036:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304820.905045:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304820.905053:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304820.905060:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304820.905064:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304820.905078:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304820.905122:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:2.0:1789304820.905126:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789304820.905132:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304820.905139:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb72312972a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304821.076501:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304821.882436:0:92772:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff9b0a59e0 20000000:00000080:3.0:1789304821.882454:0:92772:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c10e6a400 uarg=0000000000000000 00010000:00010000:3.0:1789304821.882922:0:92772:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789304821.882957:0:92772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304821.882960:0:92772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304821.882971:0:92772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297283 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100746 expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304821.882993:0:92772:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789304821.883006:0:92772:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304821.883019:0:92772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304821.883031:0:92772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231297275 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129726e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304821.883038:0:92772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304821.883072:0:92772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231297275 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129726e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304821.883084:0:92772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231297275 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129726e expref: 18 pid: 5847 timeout: 2421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304821.883121:0:92772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92772:1876219785704576:0@lo:104: 00000100:00100000:3.0:1789304821.883177:0:92772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304821.883233:0:92772:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0172ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304821.883531:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785704576 00000100:00100000:1.0:1789304821.883549:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785704576 00000100:00100000:1.0:1789304821.883603:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789304821.883613:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:92772:x1876219785704576:12345-0@lo:104: 00010000:00010000:1.0:1789304821.883626:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304821.883699:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304821.883705:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:92772:x1876219785704576:12345-0@lo:104: Request processed in 95us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304821.883712:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00010000:00010000:0.0:1789304821.883884:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304821.883892:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.883900:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370e00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304821.883904:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.883913:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304821.883920:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304821.883930:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304821.883967:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.883974:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304821.883998:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884008:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129726e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297275 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884021:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304821.884022:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304821.884024:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304821.884062:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785704704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304821.884131:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304821.884741:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785704704 00000100:00100000:0.0:1789304821.884748:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785704704 00010000:00010000:0.0:1789304821.884777:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231297275 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129726e expref: 19 pid: 5847 timeout: 2421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304821.884811:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1789304821.884819:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785704704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304821.884832:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304821.884837:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231297275 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129726e expref: 19 pid: 5847 timeout: 2421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884848:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231297275 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129726e expref: 19 pid: 5847 timeout: 2421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884865:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884875:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884890:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884901:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884909:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884916:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884922:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304821.884926:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884933:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884942:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304821.884951:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304821.885001:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785704704:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304821.885007:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789304821.885081:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785704704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304821.886352:0:92772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd600/0xefc0bb7231297275 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129726e expref: 18 pid: 5847 timeout: 2421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304821.886370:0:92772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92772:1876219785704576:0@lo:104: 00010000:00010000:3.0:1789304821.886391:0:92772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304821.886400:0:92772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304821.886407:0:92772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304821.886413:0:92772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312972ad lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304822.038471:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785705216:0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.038551:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304822.038609:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789304822.038616:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785704832:0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.038639:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304822.038657:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785705344:0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.038680:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304822.038707:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785704960:0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.038729:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304822.038747:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304822.038752:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785705088:0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.038770:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304822.038799:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785705216 00000100:00100000:1.0:1789304822.038806:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785705216 00000100:00100000:1.0:1789304822.038858:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785704832 00000100:00100000:1.0:1789304822.038861:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785704832 00000100:00100000:1.0:1789304822.038878:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785705088 00000100:00100000:1.0:1789304822.038881:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785705088 00000100:00100000:1.0:1789304822.038898:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:1.0:1789304822.038905:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785705216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.038952:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785705216:12345-0@lo:400:kworker.0 Request processed in 47us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304822.038960:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000100:00100000:1.0:1789304822.038976:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1789304822.038982:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785704832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.039006:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785704832:12345-0@lo:400:kworker.0 Request processed in 25us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304822.039012:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1789304822.039023:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:1.0:1789304822.039028:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785705088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.039055:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785705088:12345-0@lo:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304822.039060:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00100000:1.0:1789304822.039080:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785705344 00000100:00100000:1.0:1789304822.039083:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785705344 00000100:00100000:1.0:1789304822.039134:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785704960 00000100:00100000:1.0:1789304822.039138:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785704960 00000100:00100000:1.0:1789304822.039156:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1789304822.039162:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785705344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.039190:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785705344:12345-0@lo:400:kworker.0 Request processed in 28us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304822.040377:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1789304822.040405:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1789304822.041304:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785704960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.041388:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785704960:12345-0@lo:400:kworker.0 Request processed in 975us (2657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304822.041396:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00080000:1.0:1789304822.041985:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304822.041992:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304822.041996:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304822.042071:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785705088:0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.042087:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785704960:0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.042146:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785704832:0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.042157:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785705344:0@lo:400:kworker.0 00000100:00100000:1.0:1789304822.042168:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785705216:0@lo:400:kworker.0 00010000:00010000:0.0:1789304822.099403:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304823.122251:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304823.122258:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304823.122263:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304823.122309:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304823.122322:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304823.122335:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304823.122361:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785705472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304823.122432:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304823.122487:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c2042b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304823.122567:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785705472 00000100:00100000:2.0:1789304823.122591:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785705472 00000100:00100000:2.0:1789304823.122663:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:2.0:1789304823.122672:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785705472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304823.122686:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304823.122701:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312972bb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312972b4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304823.122723:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312972bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312972b4 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304823.122734:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312972bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312972b4 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304823.122748:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40eccc00, rc 0) 00000100:00100000:2.0:1789304823.122803:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785705472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304823.122809:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1789304823.122967:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785705472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304823.122981:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304823.122989:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304823.123006:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304823.123011:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304823.123018:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304823.123567:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304824.147141:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304824.595482:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785705600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304824.595868:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304824.604194:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785705600 00000100:00100000:1.0:1789304824.604211:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785705600 00000100:00100000:1.0:1789304824.604275:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1789304824.604285:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785705600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304824.604323:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304824.604428:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785705600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (8561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304824.604435:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00080000:1.0:1789304824.604468:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304824.604511:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785705600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304824.684601:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304824.684642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304824.684668:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304824.684703:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304824.684782:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765631872 00000100:00100000:0.0:1789304824.684792:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765631872 00000100:00100000:0.0:1789304824.684865:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765632000 00000100:00100000:0.0:1789304824.684869:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765632000 00000100:00100000:0.0:1789304824.684896:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 567 00000100:00100000:0.0:1789304824.684906:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765631872:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:0.0:1789304824.684941:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231296de4 00000100:00080000:0.0:1789304824.684953:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2b02ec9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789304824.684995:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967361 00000100:00100000:0.0:1789304824.685277:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765631872:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 371us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304824.685284:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 567 00000100:00100000:0.0:1789304824.685299:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 568 00000100:00100000:0.0:1789304824.685306:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765632000:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:0.0:1789304824.685317:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb72312970e6 00000100:00080000:0.0:1789304824.685322:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2c1c970800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789304824.685340:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967361 00000100:00100000:0.0:1789304824.685466:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765632000:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 160us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304824.685472:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 568 00010000:00010000:0.0:1789304824.685489:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789304824.685550:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304824.685553:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304824.685559:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304824.688073:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765631744 00000100:00100000:1.0:1789304824.688127:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765631744 00000100:00100000:1.0:1789304824.688192:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1624 00000100:00100000:1.0:1789304824.688202:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765631744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304824.688268:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765631744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 68us (3625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304824.688276:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1624 00000100:00080000:1.0:1789304824.688397:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304824.694080:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765631616 00000100:00100000:3.0:1789304824.694141:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765631616 00000100:00100000:3.0:1789304824.694196:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1284 00000100:00100000:3.0:1789304824.694206:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765631616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304824.694283:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765631616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 78us (9693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304824.694291:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1284 00000100:00100000:3.0:1789304824.999910:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304825.000709:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765632128 00000100:00100000:1.0:1789304825.000724:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765632128 00000100:00100000:1.0:1789304825.000784:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1049 00000100:00100000:1.0:1789304825.000795:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:54454:x1876219765632128:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304825.000819:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304825.000846:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312972c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100754 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.000920:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.000935:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.000950:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.000963:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.000971:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.000978:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001304:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312972d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001314:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312972d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001321:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312972d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304825.001349:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:1.0:1789304825.001353:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304825.001374:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312972d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001386:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001393:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001399:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001405:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304825.001410:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001418:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001429:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:1.0:1789304825.001432:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304825.001437:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001444:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001455:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001464:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001469:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001473:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304825.001476:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001483:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001490:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c14add500) 00010000:00010000:1.0:1789304825.001493:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304825.001496:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.001502:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.003226:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312972c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100754 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.003257:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312972d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100754 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.003265:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:1.0:1789304825.003267:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304825.003271:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371c00, rc 0) 00000100:00100000:1.0:1789304825.004782:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54454:x1876219765632128:12345-192.168.202.29@tcp:101:touch.0 Request processed in 3978us (4872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304825.004795:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1049 00000100:00100000:3.0:1789304825.018818:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304825.019471:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765632384 00000100:00100000:1.0:1789304825.019484:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765632384 00000100:00100000:1.0:1789304825.019578:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1050 00000100:00100000:1.0:1789304825.019590:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:54454:x1876219765632384:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304825.019612:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304825.019637:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312972de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610075b expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.019910:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.019928:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.019941:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.019957:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.019964:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.019971:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789304825.020734:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21:0x0], index 0: 0 00010000:00010000:1.0:1789304825.021020:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312972f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021032:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312972f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021041:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312972f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021076:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021083:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021112:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021118:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304825.021122:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021129:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021140:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:1.0:1789304825.021143:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304825.021148:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021154:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312972e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304825.021171:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013f936a5 reply state 00000000f780e761 transno 4294967700 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304825.021181:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789304825.021214:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312972de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610075b expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021229:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312972f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610075b expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.021236:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:1.0:1789304825.021239:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304825.021242:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371000, rc 0) 00000100:00100000:1.0:1789304825.021321:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:54454:x1876219765632384:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1734us (2516us total) trans 4294967700 rc 0/0 00000100:00100000:1.0:1789304825.021329:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1050 00010000:00010000:0.0:1789304825.030558:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.030578:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.030588:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.030594:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304825.030599:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.030611:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.030627:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c14add600) 00010000:00010000:0.0:1789304825.030630:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304825.030635:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.030641:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb72312972ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304825.031020:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304825.032881:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765632640 00000100:00100000:1.0:1789304825.032893:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765632640 00000100:00100000:1.0:1789304825.032953:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1051 00000100:00100000:1.0:1789304825.032960:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:54454:x1876219765632640:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:1.0:1789304825.033011:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304825.033035:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312972f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610075b expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.033050:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:1.0:1789304825.033058:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304825.033630:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.033647:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.033658:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304825.033795:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064471078 reply state 00000000cc04c987 transno 4294967701 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304825.033806:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304825.033912:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:54454:x1876219765632640:12345-192.168.202.29@tcp:36:touch.0 Request processed in 951us (2895us total) trans 4294967701 rc 0/0 00000100:00100000:1.0:1789304825.033918:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1051 00010000:00010000:0.0:1789304825.035353:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.035367:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.035374:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.035381:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304825.035387:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.035394:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.035410:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff9e2c14adda00) 00010000:00010000:0.0:1789304825.035413:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304825.035428:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.035440:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297301 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304825.036387:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304825.036977:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765632768 00000100:00100000:1.0:1789304825.036988:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765632768 00000100:00100000:1.0:1789304825.037074:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1052 00000100:00100000:1.0:1789304825.037085:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:54454:x1876219765632768:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304825.037146:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304825.037168:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231297308 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100762 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.037232:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231297308 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100762 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.037246:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231297308 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100762 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304825.037286:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:1.0:1789304825.037290:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789304825.037294:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370000, rc 0) 00000100:00100000:1.0:1789304825.037347:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:54454:x1876219765632768:12345-192.168.202.29@tcp:101:touch.0 Request processed in 264us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304825.037354:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1052 00000100:00100000:2.0:1789304825.042673:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304825.042877:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765632896 00000100:00100000:1.0:1789304825.042888:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765632896 00000100:00100000:1.0:1789304825.042968:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 569 00000100:00100000:1.0:1789304825.042977:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876219765632896:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:1.0:1789304825.043011:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 2274 last 0 00000020:00000080:1.0:1789304825.043042:0:6693:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb723129730f 00002000:00100000:1.0:1789304825.043054:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c20271000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789304825.043077:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789304825.043188:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789304825.043216:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2c20272800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789304825.043279:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765632896:12345-192.168.202.29@tcp:8:touch.0 Request processed in 301us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304825.043299:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 569 00000100:00100000:3.0:1789304825.046243:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304825.046292:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765633024 00000100:00100000:1.0:1789304825.046302:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765633024 00000100:00100000:1.0:1789304825.046423:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 570 00000100:00100000:1.0:1789304825.046436:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765633024:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:2.0:1789304825.046888:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1789304825.083960:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304825.083970:0:6723:0:(genops.c:885:class_export_put()) final put ffff9e2b02ecc000/99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00080000:3.0:1789304825.083996:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967362 is committed 00000001:00100000:3.0:1789304825.084004:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304825.084014:0:490:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b02ecc000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0000 00000020:00000080:3.0:1789304825.084061:0:490:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b02ec9000 for lustre-OST0000 00000100:00100000:1.0:1789304825.084216:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:0:x1876219765633024:12345-192.168.202.29@tcp:2:touch.0 Request processed in 37777us (37973us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789304825.084228:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 570 00000100:00100000:3.0:1789304825.087085:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304825.087220:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765633280 00000100:00100000:0.0:1789304825.087228:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765633280 00000100:00100000:0.0:1789304825.087280:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 108 00000100:00100000:0.0:1789304825.087288:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:54454:x1876219765633280:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:0.0:1789304825.087915:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:54454:x1876219765633280:12345-192.168.202.29@tcp:35:touch.0 Request processed in 625us (837us total) trans 4294967702 rc 0/0 00000100:00100000:0.0:1789304825.087924:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 108 00000100:00100000:3.0:1789304825.137885:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304825.137979:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765633408 00000100:00100000:2.0:1789304825.137989:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765633408 00000100:00100000:2.0:1789304825.138038:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1053 00000100:00100000:2.0:1789304825.138045:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:54458:x1876219765633408:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304825.138068:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304825.138122:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297316 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100769 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138181:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129731d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138200:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129731d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138212:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129731d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138223:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138228:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138232:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138306:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129732b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138311:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129732b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138317:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129732b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304825.138353:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x56:0x0]: returning size 0 00000004:00200000:2.0:1789304825.138356:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304825.138376:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129732b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138388:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129732b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138399:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129731d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138405:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129731d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138411:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129731d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138426:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304825.138430:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129731d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138437:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129731d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138448:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:2.0:1789304825.138451:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304825.138456:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129731d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138462:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb723129731d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138474:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138481:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297324 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138486:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138492:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304825.138494:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138499:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138506:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304825.138509:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304825.138521:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297324 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138527:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138555:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297316 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100769 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138692:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129732b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100769 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.138697:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:2.0:1789304825.138699:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304825.138701:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789304825.138757:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:54458:x1876219765633408:12345-192.168.202.29@tcp:101:rm.0 Request processed in 712us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304825.138762:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1053 00000100:00100000:3.0:1789304825.141311:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304825.141428:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765633536 00000100:00100000:2.0:1789304825.141438:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765633536 00000100:00100000:2.0:1789304825.141485:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 571 00000100:00100000:2.0:1789304825.141491:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765633536:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789304825.141506:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304825.141535:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bcfec7d/0xefc0bb7231297332 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100770 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304825.141574:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x6aa69ff9, atime: 0x6aa69ff9, ctime: 0x6aa69ff9, blocks: 0x1 00010000:00010000:2.0:1789304825.141594:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=2274s v=(0 0) 00010000:00010000:2.0:1789304825.141599:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304825.141608:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bcfec7d/0xefc0bb7231297332 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100770 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.141629:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bcfec7d/0xefc0bb7231297332 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100770 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.141642:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd000, rc 0) 00000100:00100000:2.0:1789304825.141705:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765633536:12345-192.168.202.29@tcp:101:rm.0 Request processed in 213us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304825.141711:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 571 00000100:00100000:3.0:1789304825.146908:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304825.147274:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765633792 00000100:00100000:2.0:1789304825.147294:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765633792 00000100:00100000:2.0:1789304825.147358:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1054 00000100:00100000:2.0:1789304825.147368:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:54458:x1876219765633792:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304825.147442:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304825.147468:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb723129732b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100769 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.147491:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231297308 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100762 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.147501:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:2.0:1789304825.147521:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304825.147543:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297339 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.147569:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.147580:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.147594:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.147601:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.147608:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.147701:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297347 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.147710:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.147716:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304825.148245:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].33, 64 off10304 00000004:00080000:2.0:1789304825.148255:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2274826163320ns, next at 2275826161368ns, rc = 0 00010000:00010000:2.0:1789304825.148302:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148311:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148319:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148327:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148333:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148339:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148365:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304825.148383:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297347 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148388:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297347 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148394:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297347 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148400:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304825.148404:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297347 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148412:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297347 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148421:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff9e2c421d2800) 00010000:00010000:2.0:1789304825.148424:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304825.148428:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297347 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148433:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297347 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148449:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297339 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148455:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297339 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148460:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297339 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148466:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304825.148468:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297339 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148474:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297339 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148480:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:2.0:1789304825.148482:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304825.148485:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297339 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304825.148490:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297339 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304825.148498:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee82367a reply state 00000000fb13bbaf transno 4294967703 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304825.148505:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304825.148585:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:54458:x1876219765633792:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1218us (1685us total) trans 4294967703 rc 0/0 00000100:00100000:2.0:1789304825.148593:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1054 00010000:00010000:3.0:1789304825.149435:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304825.149444:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304825.149451:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304825.149455:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304825.149462:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304825.149474:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff9e2c421d2800) 00010000:00010000:3.0:1789304825.149477:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304825.149481:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304825.149487:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129734e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304825.149504:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304825.149507:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304825.149509:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304825.152641:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.152660:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.152668:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.152674:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304825.152679:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.152688:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.152705:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c421d2e00) 00010000:00010000:0.0:1789304825.152709:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304825.152715:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.152722:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297340 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304825.170281:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304825.623883:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785705728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304825.623954:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304825.624020:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785705728 00000100:00100000:1.0:1789304825.624026:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785705728 00000100:00100000:1.0:1789304825.624070:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1789304825.624077:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785705728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304825.624111:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304825.624145:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785705728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304825.624150:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00080000:1.0:1789304825.624165:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304825.624194:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785705728:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304826.197029:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304826.217662:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967702 is committed 00000001:00080000:2.0:1789304826.217689:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967703 is committed 00000004:00080000:2.0:1789304826.217693:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 86 committed 00000100:00100000:0.0:1789304826.222174:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785705856:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304826.222243:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304826.222314:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785705856 00000100:00100000:0.0:1789304826.222322:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785705856 00000100:00100000:0.0:1789304826.222368:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1789304826.222378:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785705856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789304826.222405:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:33 count 1 00010000:00010000:0.0:1789304826.222429:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.222454:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bcfec7d/0xefc0bb7231297332 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100770 expref: 5 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.222464:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789304826.222469:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304826.222473:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.222635:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bcfec7d/0xefc0bb7231297332 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100770 expref: 5 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.222650:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bcfec7d/0xefc0bb7231297332 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100770 expref: 5 pid: 6692 timeout: 2375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304826.222663:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06236680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876219785705984:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304826.222723:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c04c156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304826.227229:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304826.227314:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06236680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876219785705984:192.168.202.29@tcp:104: 00010000:00010000:1.0:1789304826.227342:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304826.231023:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765633920 00000100:00100000:2.0:1789304826.231040:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765633920 00010000:00010000:2.0:1789304826.231108:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bcfec7d/0xefc0bb7231297332 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100770 expref: 6 pid: 6692 timeout: 2375 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304826.231155:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 422 00000100:00100000:2.0:1789304826.231166:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765633920:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304826.231183:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304826.231189:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bcfec7d/0xefc0bb7231297332 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100770 expref: 6 pid: 6692 timeout: 2375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.231206:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bcfec7d/0xefc0bb7231297332 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100770 expref: 6 pid: 6692 timeout: 2375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.231231:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bcfec7d/0xefc0bb7231297332 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100770 expref: 6 pid: 6692 timeout: 2375 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.231247:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304826.231251:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304826.231256:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.231265:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.231297:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304826.231367:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765633920:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 203us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304826.231374:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 422 00010000:00010000:0.0:1789304826.231762:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.231772:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.231781:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.231789:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.231808:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789304826.232415:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785705856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10037us (10169us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789304826.232424:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00010000:00010000:0.0:1789304826.232447:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304826.232453:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.232462:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304826.232467:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.232478:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.232517:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.232526:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb7231297355 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.232543:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304826.232545:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304826.232547:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304826.232714:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c02ea8700/2, rc 0, transno 4294967363 00000100:00100000:0.0:1789304826.232722:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785705856:0@lo:6:osp-syn-0-0.0 00000001:00100000:1.0:1789304826.689115:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304826.689124:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2b02eca800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304826.689298:0:83748:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b02eca800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:3.0:1789304826.689345:0:83748:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c1c970800 for lustre-OST0001 00000020:00000080:2.0:1789304826.822297:0:93019:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0b58e680 20000000:00000080:2.0:1789304826.822313:0:93019:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c10459000 uarg=0000000000000000 00010000:00010000:2.0:1789304826.822956:0:93019:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789304826.822993:0:93019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:2.0:1789304826.822997:0:93019:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304826.823008:0:93019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb72312972d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100754 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.823030:0:93019:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789304826.823047:0:93019:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304826.823065:0:93019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.823078:0:93019:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312972bb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312972b4 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.823086:0:93019:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.823229:0:93019:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312972bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312972b4 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.823243:0:93019:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312972bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312972b4 expref: 18 pid: 5847 timeout: 2426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304826.823259:0:93019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93019:1876219785706112:0@lo:104: 00000100:00100000:2.0:1789304826.823329:0:93019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304826.823428:0:93019:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16900 going to sleep for 11 seconds 00000100:00100000:0.0:1789304826.823746:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785706112 00000100:00100000:0.0:1789304826.823756:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785706112 00000100:00100000:0.0:1789304826.823849:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1789304826.823860:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:93019:x1876219785706112:12345-0@lo:104: 00010000:00010000:0.0:1789304826.823876:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304826.823947:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304826.823954:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:93019:x1876219785706112:12345-0@lo:104: Request processed in 97us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304826.823961:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789304826.824026:0:93019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93019:1876219785706112:0@lo:104: 00010000:00010000:2.0:1789304826.824049:0:93019:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824122:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304826.824129:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824137:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304826.824140:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824149:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304826.824156:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304826.824162:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304826.824195:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824202:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304826.824223:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824231:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41371800/0xefc0bb72312972b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312972bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824245:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304826.824247:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304826.824249:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304826.824260:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785706240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304826.824295:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304826.824336:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785706240 00000100:00100000:3.0:1789304826.824340:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785706240 00010000:00010000:3.0:1789304826.824360:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312972bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312972b4 expref: 19 pid: 5847 timeout: 2426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304826.824382:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789304826.824389:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785706240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304826.824400:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304826.824404:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312972bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312972b4 expref: 19 pid: 5847 timeout: 2426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824414:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312972bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312972b4 expref: 19 pid: 5847 timeout: 2426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824427:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312972bb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312972b4 expref: 19 pid: 5847 timeout: 2426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824440:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824449:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824463:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824470:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824478:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824485:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824491:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304826.824506:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824514:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824526:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304826.824533:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304826.824657:0:93019:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.824665:0:93019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304826.824672:0:93019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb723129735c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304826.826839:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785706240:12345-0@lo:103:ldlm_bl.0 Request processed in 2440us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304826.826853:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789304826.826946:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785706240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304827.154969:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785706368:0@lo:400:kworker.0 00000100:00100000:1.0:1789304827.155054:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304827.155214:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785706624:0@lo:400:kworker.0 00000100:00100000:3.0:1789304827.155249:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785706752:0@lo:400:kworker.0 00000100:00100000:1.0:1789304827.155400:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785706880:0@lo:400:kworker.0 00000100:00100000:1.0:1789304827.155433:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304827.155454:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304827.155460:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785706496:0@lo:400:kworker.0 00000100:00100000:1.0:1789304827.155505:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304827.155535:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785706880 00000100:00100000:1.0:1789304827.155543:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785706880 00000100:00100000:1.0:1789304827.155593:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785706496 00000100:00100000:1.0:1789304827.155596:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785706496 00000100:00100000:1.0:1789304827.155618:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1789304827.155626:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785706880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304827.155680:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785706880:12345-0@lo:400:kworker.0 Request processed in 55us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304827.155688:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1789304827.155705:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:1.0:1789304827.155711:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785706496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304827.155735:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785706496:12345-0@lo:400:kworker.0 Request processed in 25us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304827.155741:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00080000:1.0:1789304827.155763:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304827.155767:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304827.155780:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304827.156238:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304827.159447:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785706368 00000100:00100000:2.0:1789304827.159463:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785706368 00000100:00100000:2.0:1789304827.159637:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785706752 00000100:00100000:2.0:1789304827.159642:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785706752 00000100:00080000:1.0:1789304827.160555:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304827.160604:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785706624 00000100:00100000:3.0:1789304827.160611:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785706624 00000100:00100000:3.0:1789304827.160653:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:3.0:1789304827.160663:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785706368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304827.160754:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785706368:12345-0@lo:400:kworker.0 Request processed in 93us (5701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304827.160762:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00100000:3.0:1789304827.160778:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:3.0:1789304827.160784:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785706752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304827.160828:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785706752:12345-0@lo:400:kworker.0 Request processed in 44us (5046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304827.160833:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:3.0:1789304827.160843:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:3.0:1789304827.160848:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785706624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304827.160872:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785706624:12345-0@lo:400:kworker.0 Request processed in 24us (4635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304827.160877:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00080000:3.0:1789304827.160889:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304827.160924:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785706752:0@lo:400:kworker.0 00000100:00100000:0.0:1789304827.162067:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785706496:0@lo:400:kworker.0 00000100:00100000:0.0:1789304827.162081:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785706880:0@lo:400:kworker.0 00000100:00100000:0.0:1789304827.162106:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785706368:0@lo:400:kworker.0 00000100:00100000:1.0:1789304827.162361:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785706624:0@lo:400:kworker.0 00010000:00010000:2.0:1789304827.218691:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304827.998342:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304827.998350:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304827.998355:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304827.998403:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304827.998415:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304827.998426:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304827.998460:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785707008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304827.998563:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304827.998622:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13d74f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789304827.998723:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785707008 00000100:00100000:2.0:1789304827.998731:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785707008 00000100:00100000:2.0:1789304827.998781:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1789304827.998797:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785707008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304827.998810:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304827.998824:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc800/0xefc0bb723129736a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297363 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304827.998845:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc800/0xefc0bb723129736a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297363 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304827.998856:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb723129736a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297363 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304827.998864:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc800, rc 0) 00000100:00100000:2.0:1789304827.998898:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785707008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304827.998904:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1789304827.999370:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785707008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304827.999386:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304827.999395:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304827.999412:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304827.999417:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304827.999424:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304828.242320:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304829.271693:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304829.717400:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304829.717429:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785707136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304829.717513:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304829.732148:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785707136 00000100:00100000:1.0:1789304829.732538:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785707136 00000100:00100000:1.0:1789304829.732606:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1789304829.732615:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785707136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304829.732652:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789304829.732900:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304829.733003:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785707136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 389us (15489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304829.733012:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:2.0:1789304829.733147:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785707136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304829.793934:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304829.793978:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304829.794006:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304829.794038:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765634176 00000100:00100000:0.0:1789304829.794049:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765634176 00000100:00100000:0.0:1789304829.794145:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1628 00000100:00100000:0.0:1789304829.794166:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765634176:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304829.794247:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765634176:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304829.794256:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1628 00000100:00080000:0.0:1789304829.794280:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304829.794661:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765634048 00000100:00100000:3.0:1789304829.794667:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765634048 00000100:00100000:3.0:1789304829.794716:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1286 00000100:00100000:3.0:1789304829.794725:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765634048:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304829.794767:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765634048:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 43us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304829.794774:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1286 00000100:00100000:1.0:1789304829.795625:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765634304 00000100:00100000:1.0:1789304829.795635:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765634304 00000100:00080000:0.0:1789304829.795686:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304829.795705:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1243 00000100:00100000:1.0:1789304829.795715:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765634304:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304829.795966:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765634304:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 253us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304829.795975:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1243 00000100:00100000:0.0:1789304829.862312:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304829.862392:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765634432 00000100:00100000:1.0:1789304829.862403:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765634432 00000100:00100000:1.0:1789304829.862461:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1055 00000100:00100000:1.0:1789304829.862483:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:54546:x1876219765634432:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304829.862503:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304829.862526:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100777 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304829.862590:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297378 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304829.862603:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304829.862616:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304829.862651:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:1.0:1789304829.862654:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304829.862672:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297378 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304829.862694:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100777 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304829.862714:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297378 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100777 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304829.862722:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:1.0:1789304829.862724:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304829.862728:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371200, rc 0) 00000100:00100000:1.0:1789304829.862787:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:54546:x1876219765634432:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 318us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304829.862794:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1055 00000100:00100000:0.0:1789304829.867235:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304829.867321:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765634688 00000100:00100000:1.0:1789304829.867333:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765634688 00000100:00100000:1.0:1789304829.867402:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1056 00000100:00100000:1.0:1789304829.867413:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:54546:x1876219765634688:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789304829.867481:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304829.867509:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297378 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100777 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304829.867525:0:7654:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312972d7) 00010000:00010000:1.0:1789304829.867529:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:1.0:1789304829.867540:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304829.867567:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304829.867581:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304829.867591:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304829.927225:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041005bcf reply state 00000000bc16dab5 transno 4294967704 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304829.927245:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304829.927263:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000001:00080000:3.0:1789304829.927315:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967704 is committed 00010000:00080000:0.0:1789304829.927683:0:7654:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789304829.927745:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:54546:x1876219765634688:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 60329us (60515us total) trans 4294967704 rc 0/0 00000100:00100000:0.0:1789304829.927754:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1056 00010000:00010000:3.0:1789304829.927806:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304829.927816:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304829.927823:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304829.927829:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304829.927833:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304829.927840:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304829.927855:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14addf00) 00010000:00010000:3.0:1789304829.927858:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304829.927863:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304829.927870:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129737f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789304830.290484:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00010000:00010000:2.0:1789304830.290911:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304830.738722:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785707264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304830.738801:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304830.739127:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785707264 00000100:00100000:1.0:1789304830.739138:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785707264 00000100:00100000:1.0:1789304830.739198:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1789304830.739208:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785707264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304830.739246:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304830.739296:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785707264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304830.739303:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1789304830.739389:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967363 gen 2 00000004:00080000:2.0:1789304830.739395:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c02ea8700, transno 4294967363 00000100:00100000:2.0:1789304830.739419:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785707264:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304830.740517:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1789304830.785497:0:93217:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb126f0c0 20000000:00000080:0.0:1789304830.785519:0:93217:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02070400 uarg=0000000000000000 00010000:00010000:0.0:1789304830.786356:0:93217:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304830.786375:0:93217:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304830.786389:0:93217:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304830.786406:0:93217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304830.786423:0:93217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb723129736a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297363 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304830.786494:0:93217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304830.786538:0:93217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc800/0xefc0bb723129736a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297363 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304830.786554:0:93217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb723129736a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297363 expref: 18 pid: 5846 timeout: 2430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304830.786569:0:93217:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93217:1876219785707392:0@lo:104: 00000100:00100000:0.0:1789304830.786635:0:93217:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304830.786754:0:93217:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789304830.786938:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785707392 00000100:00100000:2.0:1789304830.786947:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785707392 00000100:00100000:2.0:1789304830.787194:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789304830.787206:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:93217:x1876219785707392:12345-0@lo:104: 00010000:00010000:2.0:1789304830.787220:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304830.787289:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304830.787295:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:93217:x1876219785707392:12345-0@lo:104: Request processed in 92us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304830.787302:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00010000:00010000:3.0:1789304830.787353:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304830.787360:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787371:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304830.787376:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787384:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304830.787390:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304830.787396:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304830.787444:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787453:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304830.787487:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787494:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e600/0xefc0bb7231297363 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129736a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787514:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304830.787516:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304830.787518:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304830.787538:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785707520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304830.787570:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304830.787621:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785707520 00000100:00100000:3.0:1789304830.787626:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785707520 00010000:00010000:3.0:1789304830.787650:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb723129736a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297363 expref: 19 pid: 5846 timeout: 2430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304830.787676:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1789304830.787684:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785707520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304830.787695:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304830.787701:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc800/0xefc0bb723129736a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297363 expref: 19 pid: 5846 timeout: 2430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787711:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc800/0xefc0bb723129736a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297363 expref: 19 pid: 5846 timeout: 2430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787730:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787739:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787755:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787763:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787770:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787777:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787783:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304830.787788:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787796:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787805:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304830.787814:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304830.787846:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785707520:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304830.787853:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1789304830.787895:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785707520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304830.788002:0:93217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb723129736a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297363 expref: 18 pid: 5846 timeout: 2430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304830.788014:0:93217:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93217:1876219785707392:0@lo:104: 00010000:00010000:0.0:1789304830.788028:0:93217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304830.788042:0:93217:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304830.788048:0:93217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304830.788055:0:93217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa600/0xefc0bb7231297386 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304831.318576:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304832.274492:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785707776:0@lo:400:kworker.0 00000100:00100000:0.0:1789304832.274495:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304832.274511:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785707904:0@lo:400:kworker.0 00000100:00100000:2.0:1789304832.276380:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785707648:0@lo:400:kworker.0 00000100:00100000:0.0:1789304832.276853:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304832.276977:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785708032:0@lo:400:kworker.0 00000100:00100000:0.0:1789304832.277013:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304832.277167:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785707904 00000100:00100000:3.0:1789304832.277176:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785707904 00000100:00100000:3.0:1789304832.277237:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1789304832.277246:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785707904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304832.277306:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785707904:12345-0@lo:400:kworker.0 Request processed in 62us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304832.277313:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1789304832.277589:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785708032 00000100:00100000:0.0:1789304832.277594:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785708032 00000100:00100000:0.0:1789304832.277628:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00100000:0.0:1789304832.277636:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785708032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304832.277672:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785708032:12345-0@lo:400:kworker.0 Request processed in 37us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304832.277678:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000100:00080000:0.0:1789304832.277695:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304832.277699:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304832.277717:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304832.277724:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785708032:0@lo:400:kworker.0 00000100:00100000:0.0:1789304832.277734:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785707904:0@lo:400:kworker.0 00000100:00100000:1.0:1789304832.277779:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785708288:0@lo:400:kworker.0 00000100:00100000:1.0:1789304832.277805:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304832.277826:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785707776 00000100:00100000:1.0:1789304832.277829:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304832.277830:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785707776 00000100:00100000:1.0:1789304832.277834:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785708160:0@lo:400:kworker.0 00000100:00100000:3.0:1789304832.277851:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:1.0:1789304832.277855:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304832.277857:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785707776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304832.277890:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785707776:12345-0@lo:400:kworker.0 Request processed in 32us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304832.277895:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:1.0:1789304832.277902:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785707776:0@lo:400:kworker.0 00000100:00100000:3.0:1789304832.277906:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785708160 00000100:00100000:3.0:1789304832.277908:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785708160 00000100:00100000:3.0:1789304832.277929:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:3.0:1789304832.277935:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785708160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304832.277972:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785708160:12345-0@lo:400:kworker.0 Request processed in 38us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304832.277978:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:1.0:1789304832.278036:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785708160:0@lo:400:kworker.0 00000100:00100000:0.0:1789304832.278038:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785708288 00000100:00100000:0.0:1789304832.278043:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785708288 00000100:00100000:0.0:1789304832.278371:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1789304832.278379:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785708288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304832.278516:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304832.278620:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785708288:12345-0@lo:400:kworker.0 Request processed in 233us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304832.278627:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1789304832.278638:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785708288:0@lo:400:kworker.0 00000100:00080000:0.0:1789304832.278641:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304832.278644:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304832.278750:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785707648 00000100:00100000:2.0:1789304832.278755:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785707648 00000100:00100000:2.0:1789304832.278829:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:2.0:1789304832.278837:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785707648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304832.278877:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785707648:12345-0@lo:400:kworker.0 Request processed in 42us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304832.278883:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1789304832.278944:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785707648:0@lo:400:kworker.0 10000000:01000000:3.0:1789304832.338161:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304832.338171:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304832.338178:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304832.338226:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304832.338240:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304832.338252:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304832.338279:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785708416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304832.338353:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789304832.338369:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304832.338423:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752000 going to sleep for 11 seconds 00000100:00100000:0.0:1789304832.338487:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785708416 00000100:00100000:0.0:1789304832.338498:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785708416 00000100:00100000:0.0:1789304832.338557:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1789304832.338577:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785708416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304832.338591:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304832.338604:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297394 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129738d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304832.338629:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297394 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129738d expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304832.338639:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297394 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129738d expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304832.338649:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbc00, rc 0) 00000100:00100000:0.0:1789304832.338698:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785708416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304832.338704:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:3.0:1789304832.338809:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785708416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304832.338824:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304832.338833:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304832.338858:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304832.338863:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304832.338870:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.368472:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304833.874143:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304833.874192:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765634816 00000100:00100000:3.0:1789304833.874204:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765634816 00000100:00100000:3.0:1789304833.874280:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1057 00000100:00100000:3.0:1789304833.874291:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:54622:x1876219765634816:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304833.874371:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304833.874391:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129739b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610077e expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789304833.874394:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304833.874469:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.874484:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.874660:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.874676:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.874685:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.874691:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875079:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312973b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875116:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312973b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875127:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312973b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304833.875151:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789304833.875155:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304833.875175:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312973b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875187:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875195:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875203:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875210:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304833.875214:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875223:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875235:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304833.875238:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304833.875242:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875249:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875260:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875267:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875273:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875277:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304833.875279:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875284:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875290:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c2ea19000) 00010000:00010000:3.0:1789304833.875293:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304833.875295:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875302:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875674:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129739b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610077e expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875693:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312973b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610077e expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.875701:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304833.875704:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304833.875707:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304833.875893:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:54622:x1876219765634816:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1603us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304833.875901:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1057 00000100:00100000:0.0:1789304833.886775:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304833.886867:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765635072 00000100:00100000:1.0:1789304833.886878:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765635072 00000100:00100000:1.0:1789304833.886938:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1058 00000100:00100000:1.0:1789304833.886951:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54622:x1876219765635072:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304833.886973:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304833.886995:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312973b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100785 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887121:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312973be lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887140:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312973be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887154:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312973be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887170:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312973c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887176:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312973c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887183:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312973c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304833.887196:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00010000:1.0:1789304833.887215:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312973be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887222:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312973be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887229:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312973be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887239:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304833.887244:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312973be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887251:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312973be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887262:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:1.0:1789304833.887265:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304833.887270:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312973be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887275:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312973be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887288:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312973c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887293:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312973c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887299:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312973c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887304:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304833.887307:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312973c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887313:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312973c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887323:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c14add200) 00010000:00010000:1.0:1789304833.887326:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304833.887328:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312973c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887334:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb72312973c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887364:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312973b7 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100785 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887375:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:1.0:1789304833.887377:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304833.887380:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312973b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100785 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304833.887388:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371000, rc 0) 00000100:00100000:1.0:1789304833.887457:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54622:x1876219765635072:12345-192.168.202.29@tcp:101:touch.0 Request processed in 508us (691us total) trans 0 rc 301/301 00000100:00100000:1.0:1789304833.887464:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1058 00000100:00100000:2.0:1789304833.891235:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304833.891350:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765635200 00000100:00100000:0.0:1789304833.891359:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765635200 00000100:00100000:0.0:1789304833.891410:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1059 00000100:00100000:0.0:1789304833.891420:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:54622:x1876219765635200:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789304833.891454:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304833.891479:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312973cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610078c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891552:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312973d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891568:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312973d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891580:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312973d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891597:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312973da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891605:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312973da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891610:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312973da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891631:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312973d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891638:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312973d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891646:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312973d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891651:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304833.891656:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312973d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891663:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312973d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891675:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:0.0:1789304833.891678:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304833.891683:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312973d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891689:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312973d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891700:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312973da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891707:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312973da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891712:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312973da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891717:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304833.891720:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312973da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891731:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312973da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891738:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c0558d000) 00010000:00010000:0.0:1789304833.891740:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304833.891743:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312973da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891748:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312973da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891777:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312973cc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610078c expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891786:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:0.0:1789304833.891788:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304833.891791:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312973cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610078c expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304833.891800:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789304833.891867:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:54622:x1876219765635200:12345-192.168.202.29@tcp:101:touch.0 Request processed in 447us (643us total) trans 0 rc 301/301 00000100:00100000:0.0:1789304833.891874:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1059 00000100:00100000:0.0:1789304833.894534:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304833.894597:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765635328 00000100:00100000:3.0:1789304833.894605:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765635328 00000100:00100000:3.0:1789304833.894660:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1060 00000100:00100000:3.0:1789304833.894669:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:54622:x1876219765635328:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304833.894686:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304833.894702:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312973e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100793 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895063:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895080:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895375:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895393:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895402:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895409:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895439:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895446:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895452:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895458:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304833.895463:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.895470:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.896031:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304833.896033:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304833.896038:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.896045:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb72312973e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.896063:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.896070:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.896076:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.896082:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304833.896085:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.897629:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.897647:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304833.897649:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304833.897654:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.897661:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312973ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.897716:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312973e1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100793 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.897727:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304833.897729:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304833.897733:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312973e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100793 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304833.897742:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ea00, rc 0) 00000100:00100000:3.0:1789304833.897823:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:54622:x1876219765635328:12345-192.168.202.29@tcp:101:touch.0 Request processed in 3153us (3296us total) trans 0 rc 301/301 00000100:00100000:3.0:1789304833.897832:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1060 00010000:00010000:3.0:1789304834.395159:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304834.834371:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304834.834394:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785708544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304834.834474:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304834.834533:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785708544 00000100:00100000:1.0:1789304834.834541:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785708544 00000100:00100000:1.0:1789304834.834595:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:1.0:1789304834.834605:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785708544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304834.834641:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304834.834685:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785708544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304834.834693:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00080000:1.0:1789304834.834873:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304834.834906:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785708544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304834.913379:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304834.913413:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304834.913453:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304834.913487:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765635712 00000100:00100000:1.0:1789304834.913496:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765635712 00000100:00100000:1.0:1789304834.913552:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1246 00000100:00100000:1.0:1789304834.913560:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765635712:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304834.913621:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765635712:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 62us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304834.913629:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1246 00000100:00080000:1.0:1789304834.913647:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304834.913828:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765635456 00000100:00100000:2.0:1789304834.913833:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765635456 00000100:00100000:2.0:1789304834.913873:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1289 00000100:00100000:2.0:1789304834.913880:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765635456:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304834.913918:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765635456:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304834.913925:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1289 00000100:00100000:2.0:1789304834.913952:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765635584 00000100:00100000:2.0:1789304834.913966:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765635584 00000100:00100000:2.0:1789304834.913995:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1632 00000100:00100000:2.0:1789304834.914002:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765635584:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304834.914039:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765635584:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304834.914046:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1632 00010000:00010000:2.0:1789304835.411826:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304835.425445:0:93462:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcbb222cf0 20000000:00000080:2.0:1789304835.425461:0:93462:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c38bd5800 uarg=0000000000000000 00010000:00010000:2.0:1789304835.426655:0:93462:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789304835.426689:0:93462:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:2.0:1789304835.426693:0:93462:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789304835.426704:0:93462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312973b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610077e expref: 5 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304835.426724:0:93462:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789304835.426737:0:93462:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304835.426751:0:93462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304835.426768:0:93462:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297394 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129738d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304835.426776:0:93462:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304835.426809:0:93462:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297394 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129738d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304835.426824:0:93462:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297394 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129738d expref: 18 pid: 5846 timeout: 2435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304835.426838:0:93462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93462:1876219785708672:0@lo:104: 00000100:00100000:2.0:1789304835.426905:0:93462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304835.427015:0:93462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789304835.427185:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789304835.427197:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785708672 00000100:00100000:0.0:1789304835.427203:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785708672 00000100:00100000:0.0:1789304835.427277:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789304835.427345:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3846ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:93462:x1876219785708672:12345-0@lo:104: 00010000:00010000:0.0:1789304835.427360:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304835.427464:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304835.427477:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3846ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:93462:x1876219785708672:12345-0@lo:104: Request processed in 185us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304835.427484:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00010000:00010000:3.0:1789304835.427570:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304835.427577:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427585:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304835.427589:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427597:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304835.427604:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304835.427610:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304835.427640:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427646:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304835.427669:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427675:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb723129738d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297394 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427689:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304835.427691:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304835.427693:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304835.427711:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785708800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304835.427740:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304835.427784:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785708800 00000100:00100000:3.0:1789304835.427788:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785708800 00010000:00010000:3.0:1789304835.427807:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297394 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129738d expref: 19 pid: 5846 timeout: 2435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304835.427826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789304835.427832:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785708800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304835.427841:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304835.427845:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297394 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129738d expref: 19 pid: 5846 timeout: 2435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427854:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297394 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129738d expref: 19 pid: 5846 timeout: 2435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427867:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427875:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427887:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427894:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427902:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427908:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427913:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304835.427917:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427923:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427930:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304835.427937:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304835.427964:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785708800:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304835.427970:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789304835.428007:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785708800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304835.428379:0:93462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297394 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129738d expref: 18 pid: 5846 timeout: 2435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304835.428391:0:93462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93462:1876219785708672:0@lo:104: 00010000:00010000:2.0:1789304835.428404:0:93462:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304835.428412:0:93462:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304835.428428:0:93462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304835.428434:0:93462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312973f6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304835.861814:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785708928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304835.861894:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304835.861985:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785708928 00000100:00100000:2.0:1789304835.861995:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785708928 00000100:00100000:2.0:1789304835.862067:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:2.0:1789304835.862078:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785708928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304835.862143:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304835.862198:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785708928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304835.862205:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:2.0:1789304835.862252:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785708928:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304835.862346:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304836.434414:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304837.202340:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304837.202350:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304837.202355:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304837.202414:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304837.202427:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304837.202439:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304837.202531:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785709056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304837.202612:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304837.202660:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16900 going to sleep for 11 seconds 00000100:00100000:0.0:1789304837.202683:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785709056 00000100:00100000:0.0:1789304837.202691:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785709056 00000100:00100000:0.0:1789304837.202748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:0.0:1789304837.202758:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785709056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304837.202773:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304837.202787:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297404 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312973fd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304837.202810:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297404 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312973fd expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304837.202821:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297404 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312973fd expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304837.202830:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afaa00, rc 0) 00000100:00100000:0.0:1789304837.202873:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785709056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304837.202880:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1789304837.203592:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785709056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304837.204319:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304837.204334:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304837.204360:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304837.204365:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304837.204373:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304837.394887:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785709568:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.394972:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304837.395033:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789304837.395039:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785709184:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.395073:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304837.395120:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785709696:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.395144:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304837.395179:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785709568 00000100:00100000:2.0:1789304837.395188:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785709568 00000100:00100000:2.0:1789304837.395253:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785709696 00000100:00100000:2.0:1789304837.395256:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785709696 00000100:00100000:2.0:1789304837.395278:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:2.0:1789304837.395287:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785709568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.395339:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785709568:12345-0@lo:400:kworker.0 Request processed in 53us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304837.395345:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:2.0:1789304837.395363:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:2.0:1789304837.395369:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785709696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.395406:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785709696:12345-0@lo:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304837.395413:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00100000:2.0:1789304837.395432:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785709184 00000100:00100000:2.0:1789304837.395436:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785709184 00000100:00100000:2.0:1789304837.395456:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1789304837.395462:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785709184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.395500:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785709184:12345-0@lo:400:kworker.0 Request processed in 38us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304837.395506:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1789304837.395554:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785709184:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.395567:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785709696:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.395576:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785709568:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.396202:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785709440:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.396252:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304837.396280:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789304837.396286:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785709312:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.396305:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304837.396322:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785709824:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.396343:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304837.396375:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785709440 00000100:00100000:2.0:1789304837.396380:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785709440 00000100:00100000:2.0:1789304837.396430:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785709824 00000100:00100000:2.0:1789304837.396434:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785709824 00000100:00100000:2.0:1789304837.396458:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1789304837.396464:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785709440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.397635:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785709440:12345-0@lo:400:kworker.0 Request processed in 1164us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304837.397646:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1789304837.397670:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1789304837.397678:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785709824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.397709:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785709824:12345-0@lo:400:kworker.0 Request processed in 33us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304837.397715:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1789304837.397738:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785709312 00000100:00100000:2.0:1789304837.397744:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785709312 00000100:00100000:2.0:1789304837.397772:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:2.0:1789304837.397778:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785709312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.397808:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785709312:12345-0@lo:400:kworker.0 Request processed in 30us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304837.397813:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00100000:2.0:1789304837.397859:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785709312:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.397870:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785709824:0@lo:400:kworker.0 00000100:00100000:2.0:1789304837.397879:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785709440:0@lo:400:kworker.0 00000100:00080000:3.0:1789304837.402774:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304837.402783:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304837.402786:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304837.460132:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304838.447968:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304838.448075:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765635840 00000100:00100000:1.0:1789304838.448087:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765635840 00000100:00100000:0.0:1789304838.448742:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1061 00000100:00100000:0.0:1789304838.448754:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:54709:x1876219765635840:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304838.448774:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304838.448795:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129740b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610079a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304838.448864:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304838.448879:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304838.448891:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304838.448929:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:0.0:1789304838.448931:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304838.448949:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304838.448971:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb723129740b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610079a expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304838.448991:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610079a expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304838.448999:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:0.0:1789304838.449002:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304838.449006:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304838.449072:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54709:x1876219765635840:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 320us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304838.449079:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1061 00000100:00080000:3.0:1789304838.449749:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304838.452615:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304838.452705:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765636096 00000100:00100000:2.0:1789304838.452715:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765636096 00000100:00100000:2.0:1789304838.452782:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1062 00000100:00100000:2.0:1789304838.452793:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:54709:x1876219765636096:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:2.0:1789304838.452848:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304838.452874:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610079a expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304838.452890:0:5853:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312973b0) 00010000:00010000:2.0:1789304838.452894:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:2.0:1789304838.452903:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304838.452926:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304838.452937:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304838.452946:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304838.453307:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e90f9ca reply state 000000009fd1ad28 transno 4294967705 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304838.453316:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789304838.453324:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000100:00100000:2.0:1789304838.453414:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:54709:x1876219765636096:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 621us (806us total) trans 4294967705 rc 0/0 00000100:00100000:2.0:1789304838.453421:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1062 00010000:00010000:3.0:1789304838.462461:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304838.462480:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304838.462487:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304838.462492:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304838.462498:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304838.462505:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304838.462522:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:3.0:1789304838.462525:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304838.462530:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304838.462537:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297419 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304838.482532:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304839.244270:0:93658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc7b2dfa0 20000000:00000080:1.0:1789304839.244288:0:93658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c40c74000 uarg=0000000000000000 00010000:00010000:1.0:1789304839.244544:0:93658:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304839.244559:0:93658:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304839.244575:0:93658:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304839.244595:0:93658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.244612:0:93658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297404 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312973fd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.244620:0:93658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.244661:0:93658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297404 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312973fd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.244676:0:93658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297404 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312973fd expref: 18 pid: 5846 timeout: 2438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304839.244691:0:93658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93658:1876219785709952:0@lo:104: 00000100:00100000:1.0:1789304839.244759:0:93658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304839.244811:0:93658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38835f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789304839.245478:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785709952 00000100:00100000:2.0:1789304839.245489:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785709952 00000100:00100000:2.0:1789304839.245538:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789304839.245547:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:93658:x1876219785709952:12345-0@lo:104: 00010000:00010000:2.0:1789304839.245561:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304839.245676:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304839.245683:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:93658:x1876219785709952:12345-0@lo:104: Request processed in 138us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304839.245689:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789304839.245761:0:93658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93658:1876219785709952:0@lo:104: 00010000:00010000:3.0:1789304839.245783:0:93658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304839.245999:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304839.246007:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304839.246015:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304839.246019:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304839.246028:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304839.246039:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304839.246046:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304839.246247:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304839.246254:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789304839.246298:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785710080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304839.246336:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304839.246411:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785710080 00000100:00100000:1.0:1789304839.246416:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785710080 00010000:00010000:1.0:1789304839.246439:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297404 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312973fd expref: 19 pid: 5846 timeout: 2438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304839.246465:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1789304839.246472:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785710080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304839.246483:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304839.246489:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297404 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312973fd expref: 19 pid: 5846 timeout: 2438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246500:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297404 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312973fd expref: 19 pid: 5846 timeout: 2438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246521:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297404 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312973fd expref: 19 pid: 5846 timeout: 2438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246535:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246544:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246559:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246567:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246574:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246581:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246586:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304839.246591:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246598:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246611:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304839.246624:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304839.246672:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304839.246679:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb72312973fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297404 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304839.246694:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304839.246696:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304839.246697:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304839.246794:0:93658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304839.246803:0:93658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304839.246810:0:93658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370600/0xefc0bb7231297420 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304839.247914:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785710080:12345-0@lo:103:ldlm_bl.0 Request processed in 1436us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304839.247926:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1789304839.248004:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785710080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304839.506277:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304839.958774:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785710208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304839.958847:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304839.959009:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785710208 00000100:00100000:3.0:1789304839.959017:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785710208 00000100:00100000:3.0:1789304839.959079:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:3.0:1789304839.959106:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785710208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304839.959142:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304839.959187:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785710208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304839.959194:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00080000:2.0:1789304839.959248:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304839.959277:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785710208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304840.035689:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304840.035738:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304840.035781:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304840.036553:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765636480 00000100:00100000:3.0:1789304840.036568:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765636480 00000100:00100000:3.0:1789304840.036650:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1249 00000100:00100000:3.0:1789304840.036662:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765636480:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304840.036746:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765636480:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304840.036753:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1249 00000100:00100000:2.0:1789304840.036945:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765636224 00000100:00100000:2.0:1789304840.036950:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765636224 00000100:00100000:2.0:1789304840.036988:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1292 00000100:00100000:2.0:1789304840.036996:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765636224:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304840.037030:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765636224:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 35us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304840.037036:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1292 00000100:00080000:1.0:1789304840.038462:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304840.039730:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765636352 00000100:00100000:2.0:1789304840.039746:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765636352 00000100:00100000:2.0:1789304840.039834:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1636 00000100:00100000:2.0:1789304840.039844:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765636352:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304840.039922:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765636352:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (4140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304840.039929:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1636 00000100:00080000:1.0:1789304840.040223:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304840.533653:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304840.590871:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967705 is committed 00000100:00100000:0.0:1789304840.978512:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785710336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304840.978591:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304840.978630:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785710336 00000100:00100000:2.0:1789304840.978638:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785710336 00000100:00100000:2.0:1789304840.978737:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1789304840.978747:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785710336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304840.978783:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304840.978828:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785710336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304840.978835:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:0.0:1789304840.978868:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785710336:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304840.981595:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1789304841.042756:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304841.042766:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304841.042771:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304841.042817:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304841.042828:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304841.042839:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304841.042862:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785710464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304841.042930:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304841.043028:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c08b2d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304841.044579:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785710464 00000100:00100000:1.0:1789304841.044592:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785710464 00000100:00100000:1.0:1789304841.047315:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:1.0:1789304841.047337:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785710464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304841.047355:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304841.049592:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371a00/0xefc0bb723129742e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297427 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304841.049710:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371a00/0xefc0bb723129742e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297427 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304841.049725:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371a00/0xefc0bb723129742e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297427 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304841.049736:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371a00, rc 0) 00000100:00100000:1.0:1789304841.049826:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785710464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2501us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304841.049834:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:1.0:1789304841.049925:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785710464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304841.049945:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304841.049955:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304841.049977:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304841.049982:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304841.049990:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304841.555035:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304842.518328:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785710592:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.518418:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304842.518470:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785711104:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.518501:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304842.518529:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789304842.518537:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785710720:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.518558:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304842.518577:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785711232:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.518600:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304842.518627:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785710848:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.518647:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304842.518665:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304842.518671:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785710976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.518690:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304842.518727:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785710592 00000100:00100000:0.0:1789304842.518737:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785710592 00000100:00100000:0.0:1789304842.518789:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1789304842.518797:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785710592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.518849:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785710592:12345-0@lo:400:kworker.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.518857:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1789304842.518891:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785711104 00000100:00100000:0.0:1789304842.518895:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785711104 00000100:00100000:0.0:1789304842.518930:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785710720 00000100:00100000:0.0:1789304842.518933:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785710720 00000100:00100000:0.0:1789304842.518950:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785710976 00000100:00100000:0.0:1789304842.518953:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785710976 00000100:00100000:0.0:1789304842.518968:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:0.0:1789304842.518974:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785711104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.519004:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785711104:12345-0@lo:400:kworker.0 Request processed in 30us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.519010:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00100000:0.0:1789304842.519022:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:0.0:1789304842.519028:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785710720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.519053:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785710720:12345-0@lo:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.519059:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:0.0:1789304842.519070:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1789304842.519075:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785710976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.519131:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785710976:12345-0@lo:400:kworker.0 Request processed in 56us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.519136:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1789304842.519157:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785711232 00000100:00100000:0.0:1789304842.519161:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785711232 00000100:00100000:0.0:1789304842.519184:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785710848 00000100:00100000:0.0:1789304842.519187:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785710848 00000100:00100000:0.0:1789304842.519204:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1789304842.519211:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785711232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.519243:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785711232:12345-0@lo:400:kworker.0 Request processed in 33us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.519249:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1789304842.519260:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1789304842.519266:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785710848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.519292:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785710848:12345-0@lo:400:kworker.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.519297:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00080000:0.0:1789304842.519323:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304842.519327:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304842.519330:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304842.519382:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785710976:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.519394:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785710848:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.519426:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785710720:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.519435:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785711232:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.519444:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785710592:0@lo:400:kworker.0 00000100:00100000:0.0:1789304842.519452:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785711104:0@lo:400:kworker.0 00010000:00010000:1.0:1789304842.582499:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304842.870049:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304842.874679:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765636608 00000100:00100000:0.0:1789304842.874698:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765636608 00000100:00100000:1.0:1789304842.874942:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1063 00000100:00100000:1.0:1789304842.874955:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765636608:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304842.875073:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765636608:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 120us (5032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304842.875081:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1063 00000100:00080000:0.0:1789304842.876439:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304842.878303:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304842.878463:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765636736 00000100:00100000:0.0:1789304842.878475:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765636736 00000100:00100000:0.0:1789304842.878604:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 573 00000100:00100000:0.0:1789304842.878615:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765636736:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304842.879082:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765636736:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 468us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.879123:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 573 00000100:00080000:1.0:1789304842.879325:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304842.880978:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304842.881064:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765636864 00000100:00100000:0.0:1789304842.881075:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765636864 00000100:00100000:0.0:1789304842.881142:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 574 00000100:00100000:0.0:1789304842.881150:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876219765636864:12345-192.168.202.29@tcp:8:lfs.0 00010000:00080000:0.0:1789304842.881184:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 2292 last 0 00000020:00000080:0.0:1789304842.881213:0:6692:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231297435 00002000:00100000:0.0:1789304842.881225:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c02f8e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789304842.881249:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789304842.881660:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789304842.881691:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9e2c02f88000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789304842.881858:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765636864:12345-192.168.202.29@tcp:8:lfs.0 Request processed in 707us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.881866:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 574 00000100:00100000:3.0:1789304842.884926:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304842.885008:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765636992 00000100:00100000:2.0:1789304842.885021:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765636992 00000100:00080000:1.0:1789304842.885160:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304842.885260:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 575 00000100:00100000:2.0:1789304842.885271:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54794:x1876219765636992:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304842.885776:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54794:x1876219765636992:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 505us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304842.885785:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 575 00000100:00100000:1.0:1789304842.887947:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304842.888034:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765637120 00000100:00100000:0.0:1789304842.888045:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765637120 00000100:00100000:3.0:1789304842.888211:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1064 00000100:00100000:3.0:1789304842.888223:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765637120:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304842.888670:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765637120:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 448us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304842.888678:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1064 00000100:00100000:3.0:1789304842.891340:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304842.892082:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765637248 00000100:00100000:2.0:1789304842.892134:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765637248 00000100:00100000:2.0:1789304842.892655:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1065 00000100:00100000:2.0:1789304842.892668:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765637248:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304842.892775:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765637248:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 111us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304842.892783:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1065 00000100:00100000:3.0:1789304842.894486:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304842.894766:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765637376 00000100:00100000:0.0:1789304842.894777:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765637376 00000100:00100000:0.0:1789304842.894831:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 576 00000100:00100000:0.0:1789304842.894841:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765637376:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304842.895230:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765637376:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 388us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.895238:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 576 00000100:00100000:3.0:1789304842.896759:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304842.896874:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765637504 00000100:00100000:0.0:1789304842.896884:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765637504 00000100:00100000:0.0:1789304842.896938:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 577 00000100:00100000:0.0:1789304842.896947:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:54794:x1876219765637504:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304842.897518:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:54794:x1876219765637504:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 570us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.897527:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 577 00000100:00100000:1.0:1789304842.899330:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304842.899592:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765637632 00000100:00100000:0.0:1789304842.899603:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765637632 00000100:00100000:0.0:1789304842.899858:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1066 00000100:00100000:0.0:1789304842.899868:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765637632:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304842.900323:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:54794:x1876219765637632:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 456us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.900331:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1066 00000100:00100000:3.0:1789304842.965455:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304842.965530:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765637760 00000100:00100000:0.0:1789304842.965543:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765637760 00000100:00100000:0.0:1789304842.965669:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1067 00000100:00100000:0.0:1789304842.965681:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:54798:x1876219765637760:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789304842.965702:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304842.965728:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129743c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007a1 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.965802:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297443 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.965816:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.965830:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.965846:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129744a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.965853:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129744a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.965859:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129744a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966232:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297451 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966241:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966248:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304842.966269:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:0.0:1789304842.966273:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304842.966293:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966306:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966312:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297443 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966319:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297443 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966325:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304842.966329:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297443 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966336:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297443 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966361:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:0.0:1789304842.966364:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304842.966370:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297443 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966380:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966405:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129744a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966412:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129744a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966419:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129744a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966423:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304842.966426:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129744a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966432:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129744a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966440:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c0558d100) 00010000:00010000:0.0:1789304842.966443:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304842.966445:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129744a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966452:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129744a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966485:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129743c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007a1 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966505:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007a1 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.966512:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304842.966514:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304842.966516:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbc00, rc 0) 00000100:00100000:0.0:1789304842.966591:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:54798:x1876219765637760:12345-192.168.202.29@tcp:101:dd.0 Request processed in 913us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.966599:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1067 00000100:00100000:3.0:1789304842.971182:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304842.971251:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765638016 00000100:00100000:0.0:1789304842.971261:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765638016 00000100:00100000:0.0:1789304842.971383:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1068 00000100:00100000:0.0:1789304842.971408:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:54798:x1876219765638016:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789304842.971430:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304842.971452:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297458 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007a8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.971908:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129745f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.971923:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129745f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.971934:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129745f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.971947:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.971955:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.971961:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789304842.972893:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21:0x0], index 1: 0 00010000:00010000:0.0:1789304842.973298:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129746d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973312:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129746d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973323:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129746d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973367:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129745f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973376:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129745f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973383:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129745f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973389:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304842.973593:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129745f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973603:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129745f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973620:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304842.973623:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304842.973694:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129745f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973702:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb723129745f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304842.973716:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005327b61e reply state 0000000002fd2187 transno 4294967706 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304842.973726:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789304842.973761:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297458 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007a8 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973775:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129746d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007a8 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.973783:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:0.0:1789304842.973786:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304842.973789:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afae00, rc 0) 00000100:00100000:0.0:1789304842.973875:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:54798:x1876219765638016:12345-192.168.202.29@tcp:101:dd.0 Request processed in 2482us (2702us total) trans 4294967706 rc 0/0 00000100:00100000:0.0:1789304842.973884:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1068 00010000:00010000:0.0:1789304842.978634:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.978652:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.978665:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.978672:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304842.978677:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.978686:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.978704:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c0558dd00) 00010000:00010000:0.0:1789304842.978707:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304842.978713:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.978719:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297466 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304842.983170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304842.983245:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765638144 00000100:00100000:0.0:1789304842.983257:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765638144 00000100:00100000:0.0:1789304842.983320:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 578 00000100:00100000:0.0:1789304842.983330:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:54798:x1876219765638144:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789304842.983358:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304842.983379:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb723129747b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007af expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304842.983406:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789304842.983430:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=2292s v=(0 0) 00010000:00010000:0.0:1789304842.983435:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304842.983446:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb723129747b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007af expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.983464:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb723129747b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007af expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304842.983477:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304842.983541:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:54798:x1876219765638144:12345-192.168.202.29@tcp:101:dd.0 Request processed in 212us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304842.983548:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 578 00000100:00100000:1.0:1789304843.003969:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304843.004064:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765638272 00000100:00100000:2.0:1789304843.004076:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765638272 00002000:00100000:2.0:1789304843.004174:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (0->1048575) req@ffff9e2c38652d80 x1876219765638272/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:154/0 lens 488/0 e 0 to 0 dl 1789304854 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304843.004186:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c38652d80 with x1876219765638272 ext(0->1048575) 00002000:00010000:2.0:1789304843.004193:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c38652d80 00000100:00100000:2.0:1789304843.004228:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:2.0:1789304843.004238:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765638272:12345-192.168.202.29@tcp:4:dd.0 00000001:00100000:3.0:1789304843.092457:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:2.0:1789304843.097512:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765638272:12345-192.168.202.29@tcp:4:dd.0 Request processed in 93266us (93542us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789304843.097528:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 26 00002000:00100000:2.0:1789304843.097544:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (0->1048575) req@ffff9e2c38652d80 x1876219765638272/t4294967362(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:154/0 lens 488/448 e 0 to 0 dl 1789304854 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304843.097554:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c38652d80 with x1876219765638272 ext(0->1048575) 00002000:00010000:2.0:1789304843.097560:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c38652d80 00000100:00100000:1.0:1789304843.099433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304843.099699:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765638400 00000100:00100000:2.0:1789304843.099711:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765638400 00000100:00100000:2.0:1789304843.099762:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1069 00000100:00100000:2.0:1789304843.099770:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:54798:x1876219765638400:12345-192.168.202.29@tcp:44:dd.0 00000001:00080000:0.0:1789304843.169332:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967706 is committed 00000100:00100000:2.0:1789304843.169490:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:54798:x1876219765638400:12345-192.168.202.29@tcp:44:dd.0 Request processed in 69713us (70061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304843.169502:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1069 00000100:00100000:3.0:1789304843.172914:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304843.173516:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765638528 00000100:00100000:2.0:1789304843.173529:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765638528 00000100:00100000:2.0:1789304843.173594:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 579 00000100:00100000:2.0:1789304843.173603:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2357:x1876219765638528:12345-192.168.202.29@tcp:16:dd.0 00000001:00080000:0.0:1789304843.207922:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967362 is committed 00000100:00100000:3.0:1789304843.208105:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765638528:12345-192.168.202.29@tcp:16:dd.0 Request processed in 34480us (35181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304843.208182:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 579 00000100:00100000:0.0:1789304843.214867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304843.214968:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765638784 00000100:00100000:2.0:1789304843.214979:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765638784 00000100:00100000:2.0:1789304843.215041:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 109 00000100:00100000:2.0:1789304843.215052:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:54798:x1876219765638784:12345-192.168.202.29@tcp:35:dd.0 00000100:00100000:2.0:1789304843.215837:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:54798:x1876219765638784:12345-192.168.202.29@tcp:35:dd.0 Request processed in 783us (976us total) trans 4294967707 rc 0/0 00000100:00100000:2.0:1789304843.215846:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 109 00010000:00010000:3.0:1789304843.609393:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304844.635272:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304844.639080:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967707 is committed 00000100:00100000:1.0:1789304845.078238:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304845.078264:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785711360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304845.078354:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304845.078761:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785711360 00000100:00100000:2.0:1789304845.078770:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785711360 00000100:00100000:2.0:1789304845.078854:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1789304845.078865:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785711360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304845.078906:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789304845.079542:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785711360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 677us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304845.079553:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00080000:1.0:1789304845.079624:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304845.085202:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785711360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304845.156599:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304845.156658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304845.156695:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304845.156802:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304845.156838:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765639168 00000100:00100000:2.0:1789304845.156849:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765639168 00000100:00100000:2.0:1789304845.156909:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765639296 00000100:00100000:2.0:1789304845.156913:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765639296 00000100:00100000:2.0:1789304845.156938:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1252 00000100:00100000:2.0:1789304845.156949:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765639168:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304845.157029:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765639168:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304845.157038:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1252 00000100:00100000:2.0:1789304845.157056:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1253 00000100:00100000:2.0:1789304845.157063:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765639296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304845.157139:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765639296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304845.157146:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1253 00000100:00080000:2.0:1789304845.157303:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304845.157308:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304845.158343:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765638912 00000100:00100000:3.0:1789304845.158356:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765638912 00000100:00100000:3.0:1789304845.158413:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1295 00000100:00100000:3.0:1789304845.158422:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765638912:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304845.158492:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765638912:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304845.158500:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1295 00000100:00100000:1.0:1789304845.160733:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765639040 00000100:00100000:1.0:1789304845.160755:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765639040 00000100:00100000:1.0:1789304845.160909:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1640 00000100:00100000:1.0:1789304845.160926:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765639040:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304845.161037:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765639040:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 119us (4340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304845.161044:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1640 00000100:00080000:2.0:1789304845.164591:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304845.656539:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304846.048952:0:93907:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2295726858157ns, next at 2275826161368ns, rc = 0 00000004:00080000:3.0:1789304846.049147:0:93907:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2295727055425ns, next at 2236632851999ns, rc = 0 00000004:00080000:0.0:1789304846.051599:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 93 committed 00000004:00080000:0.0:1789304846.051632:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 87 committed 00000100:00100000:3.0:1789304846.098390:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785711488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304846.098460:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304846.101018:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785711488 00000100:00100000:2.0:1789304846.101038:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785711488 00000100:00100000:2.0:1789304846.101131:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1789304846.101142:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785711488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304846.101191:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304846.101276:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785711488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304846.101284:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1789304846.101352:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785711488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304846.101958:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304846.679340:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304847.454971:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304847.456483:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765639424 00000100:00100000:3.0:1789304847.456499:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765639424 00000100:00100000:3.0:1789304847.456578:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1070 00000100:00100000:3.0:1789304847.456589:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:54991:x1876219765639424:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304847.456692:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:54991:x1876219765639424:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 105us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304847.456701:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1070 00000100:00080000:2.0:1789304847.456758:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304847.459228:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304847.459288:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765639552 00000100:00100000:2.0:1789304847.459300:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765639552 00000100:00100000:2.0:1789304847.459390:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 580 00000100:00100000:2.0:1789304847.459401:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:54991:x1876219765639552:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304847.459794:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:54991:x1876219765639552:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 394us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304847.459804:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 580 00000100:00080000:3.0:1789304847.460084:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304847.462466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304847.462568:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765639680 00000100:00100000:3.0:1789304847.462578:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765639680 00000100:00100000:3.0:1789304847.462647:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 581 00000100:00100000:3.0:1789304847.462658:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54991:x1876219765639680:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304847.463049:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54991:x1876219765639680:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 393us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304847.463056:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 581 00000100:00080000:2.0:1789304847.463406:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304847.473513:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304847.473590:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765639808 00000100:00100000:3.0:1789304847.473603:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765639808 00000100:00100000:3.0:1789304847.473673:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1071 00000100:00100000:3.0:1789304847.473686:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:54991:x1876219765639808:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304847.475605:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:54991:x1876219765639808:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 1911us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304847.475621:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1071 00000100:00100000:3.0:1789304847.480638:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304847.488599:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765639936 00000100:00100000:2.0:1789304847.488621:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765639936 00000100:00100000:2.0:1789304847.488686:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1072 00000100:00100000:2.0:1789304847.488697:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:54991:x1876219765639936:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304847.488862:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:54991:x1876219765639936:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 165us (8235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304847.488869:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1072 00000100:00100000:2.0:1789304847.514476:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304847.514549:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765640064 00000100:00100000:3.0:1789304847.514561:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765640064 00000100:00100000:3.0:1789304847.514621:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 582 00000100:00100000:3.0:1789304847.514631:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:54991:x1876219765640064:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304847.515007:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:54991:x1876219765640064:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 376us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304847.515015:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 582 00000100:00100000:2.0:1789304847.531840:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304847.533243:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765640192 00000100:00100000:1.0:1789304847.533258:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765640192 00000100:00100000:1.0:1789304847.533369:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 583 00000100:00100000:1.0:1789304847.533382:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54991:x1876219765640192:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304847.533790:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:54991:x1876219765640192:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 410us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304847.533797:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 583 00000100:00100000:2.0:1789304847.539338:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304847.539394:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765640320 00000100:00100000:0.0:1789304847.539405:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765640320 00000100:00100000:0.0:1789304847.539466:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1073 00000100:00100000:0.0:1789304847.539476:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:54991:x1876219765640320:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304847.539920:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:54991:x1876219765640320:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 444us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304847.539928:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1073 00000100:00100000:3.0:1789304847.637279:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785711744:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.637371:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304847.637422:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785712256:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.637445:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304847.637469:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789304847.637475:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785711616:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.637503:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304847.637527:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785712128:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.637550:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304847.637576:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785711872:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.637600:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304847.637617:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304847.637622:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785712000:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.637643:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304847.637675:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785711744 00000100:00100000:3.0:1789304847.637684:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785711744 00000100:00100000:3.0:1789304847.637728:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785712128 00000100:00100000:3.0:1789304847.637730:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785712128 00000100:00100000:3.0:1789304847.637758:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785712000 00000100:00100000:3.0:1789304847.637761:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785712000 00000100:00100000:3.0:1789304847.637777:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:3.0:1789304847.637784:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785711744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.637839:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785711744:12345-0@lo:400:kworker.0 Request processed in 55us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304847.637847:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00100000:3.0:1789304847.637867:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:3.0:1789304847.637874:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785712128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.637902:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785712128:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304847.637908:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00100000:3.0:1789304847.637925:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:3.0:1789304847.637930:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785712000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.637959:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785712000:12345-0@lo:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304847.637965:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:3.0:1789304847.637982:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785712256 00000100:00100000:3.0:1789304847.637986:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785712256 00000100:00100000:3.0:1789304847.638010:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785711872 00000100:00100000:3.0:1789304847.638012:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785711872 00000100:00100000:3.0:1789304847.638028:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1789304847.638034:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785712256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.638066:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785712256:12345-0@lo:400:kworker.0 Request processed in 32us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304847.638072:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:3.0:1789304847.638084:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1789304847.638111:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785711872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.638138:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785711872:12345-0@lo:400:kworker.0 Request processed in 49us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304847.638147:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1789304847.638164:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785711616 00000100:00100000:3.0:1789304847.638168:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785711616 00000100:00100000:3.0:1789304847.638190:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1789304847.638196:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785711616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.638223:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785711616:12345-0@lo:400:kworker.0 Request processed in 28us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304847.638229:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00080000:3.0:1789304847.638266:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304847.638272:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304847.638315:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785711616:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.638331:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785712128:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.638341:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785711744:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.638349:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785712256:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.638385:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785712000:0@lo:400:kworker.0 00000100:00100000:3.0:1789304847.638394:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785711872:0@lo:400:kworker.0 00000100:00100000:2.0:1789304847.674617:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304847.678810:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765640576 00000100:00100000:3.0:1789304847.678826:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765640576 00000100:00100000:2.0:1789304847.678984:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1074 00000100:00100000:2.0:1789304847.678996:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:54995:x1876219765640576:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304847.679055:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304847.679234:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb723129746d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007a8 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.679256:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9e2c0558d900) 00010000:00010000:2.0:1789304847.679269:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304847.679294:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297482 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.679322:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297482 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.679332:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297482 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.679348:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.679355:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.679362:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.679691:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297490 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.679701:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.679708:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304847.680791:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].33, 64 off10304 00000004:00080000:2.0:1789304847.680805:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2297358713285ns, next at 2298358710667ns, rc = 0 00010000:00010000:2.0:1789304847.680907:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.680922:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.680937:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.680946:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.680952:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.680958:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681486:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304847.681521:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681528:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297490 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681535:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297490 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681541:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304847.681546:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297490 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681555:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297490 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681570:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:2.0:1789304847.681574:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304847.681580:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297490 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681598:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297490 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681632:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297482 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681638:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297482 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681643:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297482 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681648:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304847.681650:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297482 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681656:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297482 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681663:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:2.0:1789304847.681665:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304847.681668:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297482 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304847.681673:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297482 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304847.681684:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e47eaa1b reply state 00000000ae66ae63 transno 4294967708 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304847.681697:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304847.681810:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:54995:x1876219765640576:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2811us (7199us total) trans 4294967708 rc 0/0 00000100:00100000:2.0:1789304847.681820:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1074 00010000:00010000:0.0:1789304847.687724:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304847.687741:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304847.687754:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304847.687759:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304847.687769:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304847.687789:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:0.0:1789304847.687792:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789304847.687798:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304847.687804:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297497 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304847.687839:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304847.687841:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304847.687843:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304847.691041:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304847.691063:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304847.691071:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304847.691077:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304847.691082:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304847.691116:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304847.691134:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c421d2600) 00010000:00010000:1.0:1789304847.691137:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304847.691142:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304847.691147:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297489 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304847.698338:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304848.723351:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304849.746605:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304850.192315:0:94052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2299869995632ns, next at 2275826161368ns, rc = 0 00000004:00080000:3.0:1789304850.192481:0:94052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2299870390078ns, next at 2298358710667ns, rc = 0 00000004:00080000:0.0:1789304850.196366:0:8095:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2299874271564ns, next at 2300874268904ns, rc = 0 00000100:00100000:0.0:1789304850.196399:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785712384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304850.196475:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304850.196550:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785712384 00000100:00100000:0.0:1789304850.196560:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785712384 00000100:00100000:0.0:1789304850.196618:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1789304850.196628:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785712384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304850.196662:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789304850.196709:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785712384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304850.196717:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00080000:0.0:1789304850.196740:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304850.198018:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785712384:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789304850.249558:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967708 is committed 00000004:00080000:3.0:1789304850.249570:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 94 committed 00000004:00080000:3.0:1789304850.249587:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 95 committed 00000004:00080000:3.0:1789304850.249594:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 88 committed 00000100:00100000:0.0:1789304850.250018:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785712512:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789304850.250436:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304850.250658:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785712512 00000100:00100000:3.0:1789304850.250667:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785712512 00000100:00100000:3.0:1789304850.250756:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1789304850.250767:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785712512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789304850.250798:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:33 count 1 00010000:00010000:3.0:1789304850.250825:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304850.250850:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb723129747b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007af expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304850.250861:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1789304850.250865:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304850.250869:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304850.250900:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb723129747b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007af expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304850.250915:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb723129747b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007af expref: 5 pid: 17212 timeout: 2399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304850.250927:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38460700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785712640:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304850.251000:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f6a53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304850.255813:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38460700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785712640:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789304850.255847:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304850.260675:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304850.260766:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765640704 00000100:00100000:1.0:1789304850.260777:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765640704 00010000:00010000:1.0:1789304850.260839:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb723129747b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007af expref: 6 pid: 17212 timeout: 2399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304850.260885:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 427 00000100:00100000:1.0:1789304850.260896:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765640704:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304850.260911:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304850.260916:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb723129747b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007af expref: 6 pid: 17212 timeout: 2399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304850.260944:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb723129747b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007af expref: 6 pid: 17212 timeout: 2399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304850.260974:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b6b3db/0xefc0bb723129747b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007af expref: 6 pid: 17212 timeout: 2399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304850.260991:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304850.260996:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304850.261001:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304850.261011:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304850.261048:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1789304850.261233:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304850.261384:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765640704:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 487us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304850.261393:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 427 00010000:00010000:2.0:1789304850.261904:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304850.261919:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304850.261932:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304850.261940:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304850.261966:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789304850.262672:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785712512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11904us (12578us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789304850.262682:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000004:00080000:0.0:1789304850.262866:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c36eac700/2, rc 0, transno 4294967363 00000100:00100000:0.0:1789304850.262888:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785712512:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789304850.265074:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304850.265117:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304850.265133:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304850.265139:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304850.265151:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304850.265179:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304850.265187:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c1b8cbb/0xefc0bb723129749e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304850.265213:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304850.265215:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304850.265216:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304850.267513:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 96 committed 00000100:00100000:3.0:1789304850.273423:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304850.273469:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304850.273501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304850.273547:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765640832 00000100:00100000:3.0:1789304850.273558:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765640832 00000100:00100000:3.0:1789304850.273607:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1297 00000100:00100000:3.0:1789304850.273617:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765640832:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304850.273684:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765640832:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 68us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304850.273693:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1297 00000100:00100000:3.0:1789304850.273724:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765641088 00000100:00100000:3.0:1789304850.273728:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765641088 00000100:00100000:3.0:1789304850.273762:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1256 00000100:00100000:3.0:1789304850.273769:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765641088:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304850.273799:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765641088:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304850.273806:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1256 00000100:00080000:3.0:1789304850.273825:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304850.274065:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765640960 00000100:00100000:2.0:1789304850.274070:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765640960 00000100:00100000:2.0:1789304850.274129:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1644 00000100:00100000:2.0:1789304850.274138:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765640960:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304850.274181:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765640960:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 46us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304850.274189:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1644 00000100:00080000:3.0:1789304850.274476:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304850.770258:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304851.218515:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304851.218542:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785712768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304851.218623:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304851.218685:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785712768 00000100:00100000:0.0:1789304851.218693:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785712768 00000100:00100000:0.0:1789304851.218749:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:0.0:1789304851.218759:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785712768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304851.218795:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304851.218842:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785712768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304851.218850:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00080000:0.0:1789304851.218871:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304851.218907:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785712768:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304851.795976:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304852.755751:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785712896:0@lo:400:kworker.0 00000100:00100000:2.0:1789304852.755807:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785713152:0@lo:400:kworker.0 00000100:00100000:3.0:1789304852.755833:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304852.755851:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785713280:0@lo:400:kworker.0 00000100:00100000:2.0:1789304852.755853:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304852.755879:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785712896 00000100:00100000:3.0:1789304852.755887:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785712896 00000100:00100000:1.0:1789304852.755895:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304852.755915:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789304852.755926:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785713024:0@lo:400:kworker.0 00000100:00100000:1.0:1789304852.755930:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304852.755935:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1789304852.755937:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785713408:0@lo:400:kworker.0 00000100:00100000:3.0:1789304852.755943:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785712896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304852.755959:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304852.755982:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304852.755989:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785713536:0@lo:400:kworker.0 00000100:00100000:3.0:1789304852.755996:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785712896:12345-0@lo:400:kworker.0 Request processed in 53us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304852.756004:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1789304852.756017:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785713280 00000100:00100000:2.0:1789304852.756022:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304852.756033:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785713280 00000100:00100000:3.0:1789304852.756042:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785713024 00000100:00100000:3.0:1789304852.756046:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785713024 00000100:00100000:2.0:1789304852.756073:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785713152 00000100:00100000:3.0:1789304852.756077:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785713408 00000100:00100000:2.0:1789304852.756079:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785713152 00000100:00100000:3.0:1789304852.756082:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785713408 00000100:00100000:2.0:1789304852.756143:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785713536 00000100:00100000:2.0:1789304852.756147:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785713536 00000100:00100000:2.0:1789304852.756169:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1789304852.756175:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785713152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304852.756216:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785713152:12345-0@lo:400:kworker.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304852.756223:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1789304852.756239:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1789304852.756247:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785713536:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789304852.756247:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304852.756264:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304852.756293:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785713536:12345-0@lo:400:kworker.0 Request processed in 47us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304852.756301:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1789304852.756738:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1645 00000100:00100000:1.0:1789304852.756750:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785713024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304852.756788:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785713024:12345-0@lo:400:kworker.0 Request processed in 42us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304852.756795:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1645 00000100:00100000:1.0:1789304852.756807:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:1.0:1789304852.756813:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785713280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304852.756845:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785713280:12345-0@lo:400:kworker.0 Request processed in 32us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304852.756851:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:1.0:1789304852.756862:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:1.0:1789304852.756867:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785713408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304852.756889:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785713408:12345-0@lo:400:kworker.0 Request processed in 22us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304852.756895:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:1.0:1789304852.756930:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785713408:0@lo:400:kworker.0 00000100:00100000:1.0:1789304852.756940:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785713280:0@lo:400:kworker.0 00000100:00100000:3.0:1789304852.765018:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785712896:0@lo:400:kworker.0 00000100:00100000:3.0:1789304852.765123:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785713024:0@lo:400:kworker.0 00000100:00100000:3.0:1789304852.765138:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785713536:0@lo:400:kworker.0 00000100:00100000:3.0:1789304852.765149:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785713152:0@lo:400:kworker.0 00010000:00010000:0.0:1789304852.823481:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304852.845523:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967363 is committed 00010000:00010000:1.0:1789304853.842624:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304854.866309:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304855.323908:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304855.323931:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785713664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304855.324011:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304855.324446:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785713664 00000100:00100000:0.0:1789304855.324455:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785713664 00000100:00100000:0.0:1789304855.324521:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1789304855.324532:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785713664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304855.324567:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304855.324623:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785713664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304855.324630:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00080000:3.0:1789304855.324722:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304855.324805:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967363 gen 2 00000004:00080000:0.0:1789304855.324811:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c36eac700, transno 4294967363 00000100:00100000:0.0:1789304855.324868:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785713664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304855.394970:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304855.395700:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304855.395758:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304855.395787:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304855.395817:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765641216 00000100:00100000:3.0:1789304855.395830:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765641216 00000100:00100000:3.0:1789304855.395887:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1299 00000100:00100000:3.0:1789304855.395898:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765641216:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304855.395977:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765641216:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304855.395985:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1299 00000100:00100000:3.0:1789304855.396017:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765641600 00000100:00100000:3.0:1789304855.396021:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765641600 00000100:00100000:3.0:1789304855.396054:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765641472 00000100:00100000:3.0:1789304855.396058:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765641472 00000100:00100000:3.0:1789304855.396079:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1259 00000100:00100000:3.0:1789304855.396085:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765641600:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304855.396138:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765641600:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 53us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304855.396145:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1259 00000100:00100000:3.0:1789304855.396157:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1260 00000100:00100000:3.0:1789304855.396164:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765641472:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304855.396193:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765641472:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304855.396198:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1260 00000100:00080000:3.0:1789304855.396367:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304855.396373:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304855.405735:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765641344 00000100:00100000:2.0:1789304855.405768:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765641344 00000100:00100000:3.0:1789304855.406665:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1648 00000100:00100000:3.0:1789304855.406680:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765641344:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304855.406958:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765641344:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 280us (12000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304855.406966:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1648 00000100:00080000:2.0:1789304855.408250:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304855.895132:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304856.338502:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785713792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304856.338576:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304856.338673:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785713792 00000100:00100000:2.0:1789304856.338682:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785713792 00000100:00100000:2.0:1789304856.338755:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1789304856.338765:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785713792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304856.338804:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789304856.338886:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304856.349026:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785713792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10247us (10433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304856.349050:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:1.0:1789304856.360414:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785713792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304856.914408:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304857.877408:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785714048:0@lo:400:kworker.0 00000100:00100000:2.0:1789304857.877431:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785714176:0@lo:400:kworker.0 00000100:00100000:0.0:1789304857.877488:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304857.877489:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304857.877551:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785714560:0@lo:400:kworker.0 00000100:00100000:0.0:1789304857.877575:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304857.877585:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785713920:0@lo:400:kworker.0 00000100:00100000:0.0:1789304857.877621:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785714304:0@lo:400:kworker.0 00000100:00100000:3.0:1789304857.877630:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304857.877664:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785714432:0@lo:400:kworker.0 00000100:00100000:0.0:1789304857.879430:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304857.879518:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785714048 00000100:00100000:0.0:1789304857.879527:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785714048 00000100:00100000:0.0:1789304857.879574:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785714304 00000100:00100000:0.0:1789304857.879577:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785714304 00000100:00100000:0.0:1789304857.879610:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:0.0:1789304857.879619:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785714048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304857.879688:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785714048:12345-0@lo:400:kworker.0 Request processed in 70us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304857.879695:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00100000:0.0:1789304857.879712:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:0.0:1789304857.879718:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785714304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304857.879751:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785714304:12345-0@lo:400:kworker.0 Request processed in 33us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304857.879756:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00080000:0.0:1789304857.879771:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304857.879807:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785714048:0@lo:400:kworker.0 00000100:00100000:0.0:1789304857.879837:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785714304:0@lo:400:kworker.0 00000100:00100000:0.0:1789304857.879919:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785713920 00000100:00100000:1.0:1789304857.883628:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785714176 00000100:00100000:1.0:1789304857.883645:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785714176 00000100:00100000:1.0:1789304857.883696:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785714560 00000100:00100000:1.0:1789304857.883698:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785714560 00000100:00100000:1.0:1789304857.883723:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1789304857.883730:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785714176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304857.883815:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785714176:12345-0@lo:400:kworker.0 Request processed in 87us (6331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304857.883821:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1789304857.883834:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1789304857.883838:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785714560:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789304857.883876:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304857.883876:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785714560:12345-0@lo:400:kworker.0 Request processed in 36us (6299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304857.883885:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1789304857.884471:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785713920 00000100:00100000:0.0:1789304857.884506:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:0.0:1789304857.884511:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785713920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304857.884543:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785713920:12345-0@lo:400:kworker.0 Request processed in 32us (6915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304857.884547:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:2.0:1789304857.884594:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785714176:0@lo:400:kworker.0 00000100:00100000:3.0:1789304857.884732:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304857.884777:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785714432 00000100:00100000:0.0:1789304857.884780:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785714432 00000100:00100000:3.0:1789304857.884807:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785713920:0@lo:400:kworker.0 00000100:00100000:0.0:1789304857.884811:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:0.0:1789304857.884820:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785714432:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789304857.884844:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304857.884856:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785714432:12345-0@lo:400:kworker.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304857.884866:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00100000:3.0:1789304857.884869:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785714432:0@lo:400:kworker.0 00000100:00100000:1.0:1789304857.885053:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785714560:0@lo:400:kworker.0 00010000:00010000:0.0:1789304857.938857:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304858.962342:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304859.987291:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304860.434807:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304860.434832:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785714688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304860.434919:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304860.435210:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785714688 00000100:00100000:3.0:1789304860.435218:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785714688 00000100:00100000:3.0:1789304860.435290:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1789304860.435299:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785714688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304860.435333:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304860.435382:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785714688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304860.435390:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00080000:1.0:1789304860.435456:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304860.435490:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785714688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304860.516763:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304860.516819:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304860.516853:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304860.516974:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765641984 00000100:00100000:2.0:1789304860.516992:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765641984 00000100:00100000:2.0:1789304860.517059:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1263 00000100:00100000:2.0:1789304860.517070:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765641984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304860.517171:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765641984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 103us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304860.517191:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1263 00000100:00100000:0.0:1789304860.518943:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765641728 00000100:00100000:0.0:1789304860.518962:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765641728 00000100:00100000:0.0:1789304860.519032:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1301 00000100:00100000:0.0:1789304860.519041:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765641728:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304860.519130:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765641728:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 90us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304860.519137:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1301 00000100:00100000:0.0:1789304860.519235:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304860.519340:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765642112 00000100:00100000:0.0:1789304860.519344:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765642112 00000100:00100000:0.0:1789304860.519377:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1264 00000100:00100000:0.0:1789304860.519382:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765642112:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304860.519411:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765642112:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304860.519417:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1264 00000100:00080000:2.0:1789304860.524325:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304860.524335:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304860.524404:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765641856 00000100:00100000:1.0:1789304860.524418:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765641856 00000100:00100000:1.0:1789304860.524544:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1652 00000100:00100000:1.0:1789304860.524556:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765641856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304860.524636:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765641856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (7782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304860.524643:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1652 00000100:00080000:2.0:1789304860.525164:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304861.010331:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304861.458759:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785714816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304861.458845:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304861.459123:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785714816 00000100:00100000:0.0:1789304861.459133:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785714816 00000100:00100000:0.0:1789304861.459390:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1789304861.459403:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785714816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304861.459444:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789304861.459660:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304861.459704:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785714816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 306us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304861.459713:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1789304861.461873:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785714816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304862.034697:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304862.994395:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785714944:0@lo:400:kworker.0 00000100:00100000:3.0:1789304862.994474:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304862.994603:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785714944 00000100:00100000:2.0:1789304862.994614:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785714944 00000100:00100000:2.0:1789304862.994678:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1789304862.994687:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785714944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304862.994974:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785715072:0@lo:400:kworker.0 00000100:00100000:1.0:1789304862.995010:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304862.995046:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304862.995053:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785715200:0@lo:400:kworker.0 00000100:00100000:1.0:1789304862.995078:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304862.995145:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785714944:12345-0@lo:400:kworker.0 Request processed in 457us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304862.995163:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:1.0:1789304862.995217:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785715328:0@lo:400:kworker.0 00000100:00100000:2.0:1789304862.995228:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785715072 00000100:00100000:2.0:1789304862.995234:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785715072 00000100:00100000:1.0:1789304862.995247:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304862.995276:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785715328 00000100:00100000:2.0:1789304862.995280:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785715328 00000100:00100000:1.0:1789304862.995290:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:1.0:1789304862.995302:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785715072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304862.995316:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:2.0:1789304862.995325:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785715328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304862.995349:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785715072:12345-0@lo:400:kworker.0 Request processed in 50us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304862.995357:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:2.0:1789304862.995377:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785715328:12345-0@lo:400:kworker.0 Request processed in 54us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304862.995385:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:1.0:1789304862.995401:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785715072:0@lo:400:kworker.0 00000100:00100000:2.0:1789304862.995409:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785715200 00000100:00100000:2.0:1789304862.995414:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785715200 00000100:00100000:2.0:1789304862.995442:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1789304862.995450:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785715200:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789304862.995484:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304862.995492:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785715200:12345-0@lo:400:kworker.0 Request processed in 42us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304862.995498:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1789304862.995531:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785715200:0@lo:400:kworker.0 00000100:00100000:2.0:1789304862.995557:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785715328:0@lo:400:kworker.0 00000100:00100000:3.0:1789304862.997076:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785714944:0@lo:400:kworker.0 00000100:00100000:3.0:1789304862.998925:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785715456:0@lo:400:kworker.0 00000100:00100000:3.0:1789304862.999132:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304862.999215:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785715456 00000100:00100000:2.0:1789304862.999223:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785715456 00000100:00100000:2.0:1789304862.999288:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:2.0:1789304862.999296:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785715456:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789304862.999371:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304862.999543:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785715584:0@lo:400:kworker.0 00000100:00100000:0.0:1789304862.999572:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304862.999607:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785715584 00000100:00100000:0.0:1789304862.999611:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785715584 00000100:00100000:0.0:1789304862.999641:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1789304862.999658:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785715584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304862.999694:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785715584:12345-0@lo:400:kworker.0 Request processed in 47us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304862.999700:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1789304862.999753:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785715584:0@lo:400:kworker.0 00000100:00080000:0.0:1789304862.999774:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304863.000427:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785715456:12345-0@lo:400:kworker.0 Request processed in 1130us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304863.000434:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:3.0:1789304863.000486:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785715456:0@lo:400:kworker.0 00010000:00010000:1.0:1789304863.058566:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304864.089447:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304865.106365:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304865.555918:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304865.557389:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785715712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304865.557568:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304865.557701:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785715712 00000100:00100000:3.0:1789304865.557711:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785715712 00000100:00100000:3.0:1789304865.557778:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1789304865.557787:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785715712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304865.557821:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304865.557878:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785715712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304865.557885:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:2.0:1789304865.557995:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785715712:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304865.558991:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304865.636519:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304865.636568:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304865.636610:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304865.636646:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304865.636736:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765642368 00000100:00100000:2.0:1789304865.636747:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765642368 00000100:00100000:2.0:1789304865.636829:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1656 00000100:00100000:2.0:1789304865.636839:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765642368:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304865.636914:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765642368:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 77us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304865.636921:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1656 00000100:00100000:2.0:1789304865.636946:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765642624 00000100:00100000:2.0:1789304865.636950:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765642624 00000100:00100000:2.0:1789304865.636986:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765642496 00000100:00100000:2.0:1789304865.636990:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765642496 00000100:00100000:2.0:1789304865.637015:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1267 00000100:00100000:2.0:1789304865.637021:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765642624:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304865.637048:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765642624:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304865.637055:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1267 00000100:00100000:2.0:1789304865.637066:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1268 00000100:00100000:2.0:1789304865.637072:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765642496:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304865.637143:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765642496:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 59us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304865.637150:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1268 00000100:00080000:0.0:1789304865.637646:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304865.637651:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304865.637654:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304865.637833:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765642240 00000100:00100000:1.0:1789304865.637840:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765642240 00000100:00100000:1.0:1789304865.637884:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1303 00000100:00100000:1.0:1789304865.637893:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765642240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304865.637940:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765642240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 49us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304865.637948:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1303 00000100:00100000:0.0:1789304865.801447:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304865.801587:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765642752 00000100:00100000:2.0:1789304865.801597:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765642752 00000100:00100000:2.0:1789304865.801654:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1075 00000100:00100000:2.0:1789304865.801664:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:55213:x1876219765642752:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304865.801781:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:55213:x1876219765642752:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 118us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304865.801788:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1075 00000100:00100000:0.0:1789304865.809026:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304865.809170:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765642880 00000100:00100000:3.0:1789304865.809181:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765642880 00000100:00100000:3.0:1789304865.809244:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 585 00000100:00100000:3.0:1789304865.809253:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:55213:x1876219765642880:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304865.809651:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:55213:x1876219765642880:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 398us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304865.809661:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 585 00000100:00100000:3.0:1789304865.818575:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304865.818927:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765643008 00000100:00100000:2.0:1789304865.818937:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765643008 00000100:00100000:2.0:1789304865.818990:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 586 00000100:00100000:2.0:1789304865.819000:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:55213:x1876219765643008:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304865.819606:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:55213:x1876219765643008:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 606us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304865.819613:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 586 00000100:00100000:3.0:1789304865.831891:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304865.833881:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765643136 00000100:00100000:2.0:1789304865.833899:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765643136 00000100:00100000:2.0:1789304865.833985:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1076 00000100:00100000:2.0:1789304865.833996:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55213:x1876219765643136:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304865.834526:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55213:x1876219765643136:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 531us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304865.834535:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1076 00000100:00100000:0.0:1789304865.843436:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304865.844457:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765643264 00000100:00100000:2.0:1789304865.844472:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765643264 00000100:00100000:2.0:1789304865.844598:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1077 00000100:00100000:2.0:1789304865.844610:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:55213:x1876219765643264:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304865.844748:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:55213:x1876219765643264:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 139us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304865.844756:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1077 00000100:00100000:0.0:1789304865.850164:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304865.850404:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765643392 00000100:00100000:3.0:1789304865.850416:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765643392 00000100:00100000:3.0:1789304865.850481:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 587 00000100:00100000:3.0:1789304865.850493:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:55213:x1876219765643392:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304865.850883:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:55213:x1876219765643392:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 393us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304865.850892:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 587 00000100:00100000:3.0:1789304865.852586:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304865.854451:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765643520 00000100:00100000:2.0:1789304865.854474:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765643520 00000100:00100000:2.0:1789304865.854560:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 588 00000100:00100000:2.0:1789304865.854572:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:55213:x1876219765643520:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304865.855579:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:55213:x1876219765643520:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 1002us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304865.855590:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 588 00000100:00100000:1.0:1789304865.857657:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304865.858203:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765643648 00000100:00100000:2.0:1789304865.858216:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765643648 00000100:00100000:2.0:1789304865.858293:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1078 00000100:00100000:2.0:1789304865.858304:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:55213:x1876219765643648:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304865.858774:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:55213:x1876219765643648:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 471us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304865.858782:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1078 00010000:00010000:2.0:1789304866.138735:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304866.582743:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785715840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304866.582823:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304866.582936:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785715840 00000100:00100000:2.0:1789304866.582945:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785715840 00000100:00100000:2.0:1789304866.583011:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:2.0:1789304866.583021:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785715840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304866.583060:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789304866.587757:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304866.603393:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785715840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 20364us (20559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304866.603411:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1789304866.603652:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785715840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304867.155526:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304868.116743:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785715968:0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.116820:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304868.116875:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785716480:0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.116903:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304868.116930:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304868.116935:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785716352:0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.116957:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304868.116981:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785716096:0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.117003:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304868.117021:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785716608:0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.117042:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304868.117059:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789304868.117064:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785716224:0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.117083:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304868.117142:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785715968 00000100:00100000:2.0:1789304868.117150:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785715968 00000100:00100000:2.0:1789304868.117206:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:2.0:1789304868.117214:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785715968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304868.117304:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785716608 00000100:00100000:0.0:1789304868.117309:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785716608 00000100:00100000:0.0:1789304868.117343:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785716224 00000100:00100000:0.0:1789304868.117346:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785716224 00000100:00100000:0.0:1789304868.117367:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1789304868.117373:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785716608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.117391:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785715968:12345-0@lo:400:kworker.0 Request processed in 177us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304868.117399:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:0.0:1789304868.117408:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785716608:12345-0@lo:400:kworker.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304868.117413:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1789304868.117424:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1789304868.117431:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785716224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.117432:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785716480 00000100:00100000:2.0:1789304868.117435:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785716480 00000100:00100000:2.0:1789304868.117458:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785716352 00000100:00100000:2.0:1789304868.117461:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785716352 00000100:00100000:2.0:1789304868.117479:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785716096 00000100:00100000:2.0:1789304868.117481:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785716096 00000100:00100000:2.0:1789304868.117494:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:2.0:1789304868.117500:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785716480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.117540:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785716480:12345-0@lo:400:kworker.0 Request processed in 40us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304868.117546:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:2.0:1789304868.117560:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:2.0:1789304868.117565:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785716352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.117591:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785716352:12345-0@lo:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304868.117596:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00100000:2.0:1789304868.117608:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:2.0:1789304868.117614:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785716096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.117638:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785716096:12345-0@lo:400:kworker.0 Request processed in 24us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304868.117643:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:0.0:1789304868.117686:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785716224:12345-0@lo:400:kworker.0 Request processed in 256us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304868.117689:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785716352:0@lo:400:kworker.0 00000100:00100000:0.0:1789304868.117693:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1789304868.117697:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785715968:0@lo:400:kworker.0 00000100:00100000:2.0:1789304868.117705:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785716480:0@lo:400:kworker.0 00000100:00080000:0.0:1789304868.117709:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304868.117713:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304868.117715:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304868.117735:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785716224:0@lo:400:kworker.0 00000100:00100000:0.0:1789304868.117744:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785716096:0@lo:400:kworker.0 00000100:00100000:0.0:1789304868.117751:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785716608:0@lo:400:kworker.0 00010000:00010000:2.0:1789304868.178487:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304868.257359:0:94319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca290d6b0 20000000:00000080:1.0:1789304868.257379:0:94319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854d000 uarg=0000000000000000 00010000:00010000:1.0:1789304868.257869:0:94319:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304868.257905:0:94319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:1.0:1789304868.257909:0:94319:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304868.257921:0:94319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297451 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007a1 expref: 5 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304868.257941:0:94319:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304868.257958:0:94319:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304868.257971:0:94319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304868.257984:0:94319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41371a00/0xefc0bb723129742e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297427 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304868.257991:0:94319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304868.258027:0:94319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41371a00/0xefc0bb723129742e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297427 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304868.258042:0:94319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41371a00/0xefc0bb723129742e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297427 expref: 18 pid: 5846 timeout: 2467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304868.258055:0:94319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94319:1876219785716736:0@lo:104: 00000100:00100000:1.0:1789304868.258925:0:94319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304868.259015:0:94319:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752240 going to sleep for 11 seconds 00000100:00100000:2.0:1789304868.259087:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785716736 00000100:00100000:2.0:1789304868.259614:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785716736 00000100:00100000:2.0:1789304868.259708:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789304868.259717:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:94319:x1876219785716736:12345-0@lo:104: 00010000:00010000:2.0:1789304868.259731:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304868.259809:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304868.259816:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:94319:x1876219785716736:12345-0@lo:104: Request processed in 101us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304868.259823:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789304868.259907:0:94319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94319:1876219785716736:0@lo:104: 00010000:00010000:3.0:1789304868.259929:0:94319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260126:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304868.260134:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260141:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304868.260145:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260161:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304868.260168:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304868.260174:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304868.260214:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260221:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304868.260255:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260262:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e200/0xefc0bb7231297427 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129742e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260281:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304868.260283:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304868.260284:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304868.260297:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785716864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304868.260339:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304868.260386:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785716864 00000100:00100000:0.0:1789304868.260390:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785716864 00010000:00010000:0.0:1789304868.260410:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41371a00/0xefc0bb723129742e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297427 expref: 19 pid: 5846 timeout: 2467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304868.260434:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789304868.260441:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785716864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304868.260453:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304868.260458:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41371a00/0xefc0bb723129742e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297427 expref: 19 pid: 5846 timeout: 2467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260469:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41371a00/0xefc0bb723129742e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297427 expref: 19 pid: 5846 timeout: 2467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260482:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371a00/0xefc0bb723129742e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297427 expref: 19 pid: 5846 timeout: 2467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260495:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260504:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260519:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260526:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260533:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260539:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260545:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304868.260549:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260557:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260568:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304868.260580:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304868.260610:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785716864:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304868.260617:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789304868.260646:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785716864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304868.260864:0:94319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304868.260877:0:94319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304868.260883:0:94319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312974a5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304869.206656:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304869.778442:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304869.778451:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304869.778457:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304869.778506:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304869.778518:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304869.778528:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304869.778553:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785716992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304869.778622:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304869.778701:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752540 going to sleep for 11 seconds 00000100:00100000:3.0:1789304869.779302:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785716992 00000100:00100000:3.0:1789304869.779313:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785716992 00000100:00100000:3.0:1789304869.780296:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1789304869.780311:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785716992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304869.780328:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304869.780347:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312974b3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312974ac expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304869.780373:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312974b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312974ac expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304869.780384:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312974b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312974ac expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304869.780392:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789304869.780457:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785716992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304869.780464:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:1.0:1789304869.780862:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785716992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304869.780880:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304869.780890:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304869.780914:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304869.780919:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304869.780927:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304870.227601:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304870.675666:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304870.675690:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785717120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304870.675759:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304870.675815:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785717120 00000100:00100000:2.0:1789304870.675823:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785717120 00000100:00100000:2.0:1789304870.675893:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:2.0:1789304870.677407:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785717120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304870.677445:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304870.677514:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785717120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304870.677522:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00080000:2.0:1789304870.677553:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304870.677604:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785717120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304870.766872:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304870.766913:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304870.768507:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304870.768541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304870.768599:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765643904 00000100:00100000:3.0:1789304870.768609:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765643904 00000100:00100000:3.0:1789304870.768675:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1660 00000100:00100000:3.0:1789304870.768685:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765643904:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304870.768762:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765643904:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304870.768770:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1660 00000100:00100000:1.0:1789304870.768932:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765643776 00000100:00100000:1.0:1789304870.768938:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765643776 00000100:00100000:1.0:1789304870.768983:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1306 00000100:00100000:1.0:1789304870.768991:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765643776:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304870.769031:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765643776:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304870.769037:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1306 00000100:00080000:3.0:1789304870.770516:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304870.772122:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765644032 00000100:00100000:2.0:1789304870.772150:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765644032 00000100:00100000:2.0:1789304870.772215:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765644160 00000100:00100000:2.0:1789304870.772219:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765644160 00000100:00100000:2.0:1789304870.772247:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1271 00000100:00100000:2.0:1789304870.772256:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765644032:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304870.772336:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765644032:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (5421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304870.772344:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1271 00000100:00100000:2.0:1789304870.772362:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1272 00000100:00100000:2.0:1789304870.772369:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765644160:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304870.772394:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765644160:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (3853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304870.772400:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1272 00000100:00080000:3.0:1789304870.772906:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304870.772911:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304870.956495:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304870.956855:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765644288 00000100:00100000:2.0:1789304870.956866:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765644288 00000100:00100000:3.0:1789304870.956972:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1079 00000100:00100000:3.0:1789304870.956985:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:55300:x1876219765644288:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304870.957007:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304870.957030:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312974ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007b6 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304870.957138:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304870.957153:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304870.957166:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304870.957203:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789304870.957207:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304870.957227:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304870.957252:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312974ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007b6 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304870.957280:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007b6 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304870.957288:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789304870.957291:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304870.957294:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f000, rc 0) 00000100:00100000:3.0:1789304870.957517:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55300:x1876219765644288:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 534us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304870.957524:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1079 00000100:00100000:0.0:1789304870.970660:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304870.970756:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765644544 00000100:00100000:1.0:1789304870.970766:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765644544 00000100:00100000:1.0:1789304870.974150:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1080 00000100:00100000:1.0:1789304870.974172:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:55300:x1876219765644544:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789304870.974225:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304870.974253:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007b6 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304870.974273:0:5852:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231297451) 00010000:00010000:1.0:1789304870.974277:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:1.0:1789304870.974288:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304870.974314:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304870.974327:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304870.974337:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304871.028414:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000178bd6e3 reply state 0000000000deb9af transno 4294967709 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304871.028434:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304871.028451:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000100:00100000:1.0:1789304871.028551:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:55300:x1876219765644544:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 54385us (57895us total) trans 4294967709 rc 0/0 00000100:00100000:1.0:1789304871.028560:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1080 00000001:00080000:2.0:1789304871.030611:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967709 is committed 00010000:00010000:1.0:1789304871.030697:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304871.030710:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304871.030718:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304871.030724:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304871.030728:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304871.030735:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304871.030752:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:1.0:1789304871.030755:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304871.030760:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304871.030853:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312974c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304871.250425:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304871.698470:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785717248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304871.698540:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304871.698643:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785717248 00000100:00100000:1.0:1789304871.698652:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785717248 00000100:00100000:1.0:1789304871.698718:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1789304871.698729:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785717248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304871.698765:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789304871.699181:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304871.701915:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785717248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3179us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304871.701929:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:0.0:1789304871.702444:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785717248:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789304871.779826:0:94517:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea3128e00 20000000:00000080:1.0:1789304871.779843:0:94517:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854e400 uarg=0000000000000000 00010000:00010000:1.0:1789304871.780660:0:94517:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304871.780676:0:94517:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304871.780690:0:94517:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304871.780708:0:94517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304871.780725:0:94517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312974b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312974ac expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304871.780732:0:94517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304871.780770:0:94517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312974b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312974ac expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304871.780784:0:94517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312974b3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312974ac expref: 18 pid: 5846 timeout: 2471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304871.780799:0:94517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94517:1876219785717376:0@lo:104: 00000100:00100000:1.0:1789304871.780856:0:94517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304871.780950:0:94517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c012ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304871.780993:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785717376 00000100:00100000:0.0:1789304871.781001:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785717376 00000100:00100000:0.0:1789304871.781114:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789304871.781273:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:94517:x1876219785717376:12345-0@lo:104: 00010000:00010000:0.0:1789304871.781286:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304871.781489:0:94517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94517:1876219785717376:0@lo:104: 00010000:00010000:2.0:1789304871.781506:0:94517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304871.781557:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304871.781564:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:94517:x1876219785717376:12345-0@lo:104: Request processed in 441us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304871.781571:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00010000:00010000:3.0:1789304871.781701:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304871.781709:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.781717:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304871.781722:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.781731:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304871.781738:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304871.781744:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304871.781957:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.781965:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304871.781995:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782002:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41371200/0xefc0bb72312974ac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312974b3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782019:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304871.782021:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304871.782023:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304871.782067:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785717504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304871.782148:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304871.782459:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785717504 00000100:00100000:3.0:1789304871.782465:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785717504 00010000:00010000:3.0:1789304871.782487:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312974b3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312974ac expref: 19 pid: 5846 timeout: 2471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304871.782517:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1789304871.782525:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785717504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304871.782535:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304871.782540:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312974b3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312974ac expref: 19 pid: 5846 timeout: 2471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782551:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312974b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312974ac expref: 19 pid: 5846 timeout: 2471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782563:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312974b3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312974ac expref: 19 pid: 5846 timeout: 2471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782576:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782583:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782601:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782608:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782614:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782620:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782625:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304871.782628:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782634:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782654:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304871.782662:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304871.782702:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785717504:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304871.782708:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:3.0:1789304871.782736:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785717504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304871.782837:0:94517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304871.782846:0:94517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304871.782852:0:94517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370600/0xefc0bb72312974cf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304872.275422:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304873.234484:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785718016:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.234555:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304873.234622:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789304873.234629:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785717632:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.234660:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304873.234684:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785718144:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.234705:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304873.234732:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785717760:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.234765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304873.234783:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785718272:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.234806:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304873.234827:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304873.234832:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785717888:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.234850:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304873.234879:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785718016 00000100:00100000:3.0:1789304873.234886:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785718016 00000100:00100000:3.0:1789304873.234935:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785718144 00000100:00100000:3.0:1789304873.234938:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785718144 00000100:00100000:3.0:1789304873.234957:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785717760 00000100:00100000:3.0:1789304873.234960:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785717760 00000100:00100000:3.0:1789304873.234973:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:3.0:1789304873.234981:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785718016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235032:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785718016:12345-0@lo:400:kworker.0 Request processed in 51us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304873.235039:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00100000:3.0:1789304873.235053:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:3.0:1789304873.235072:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785718144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235123:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785718144:12345-0@lo:400:kworker.0 Request processed in 63us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304873.235128:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:3.0:1789304873.235140:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:3.0:1789304873.235145:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785717760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235175:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785717760:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304873.235181:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:3.0:1789304873.235196:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785717632 00000100:00100000:3.0:1789304873.235199:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785717632 00000100:00100000:3.0:1789304873.235219:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1789304873.235224:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785717632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235253:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785717632:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304873.235259:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1789304873.235290:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785718272 00000100:00100000:3.0:1789304873.235293:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785718272 00000100:00100000:3.0:1789304873.235326:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785717888 00000100:00100000:3.0:1789304873.235329:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785717888 00000100:00100000:3.0:1789304873.235351:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1789304873.235356:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785718272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235385:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785718272:12345-0@lo:400:kworker.0 Request processed in 30us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304873.235391:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1789304873.235402:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1789304873.235408:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785717888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235437:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785717888:12345-0@lo:400:kworker.0 Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304873.235443:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00080000:3.0:1789304873.235462:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304873.235467:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304873.235469:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304873.235512:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785717888:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235523:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785717760:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235531:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785718272:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235558:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785717632:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235567:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785718144:0@lo:400:kworker.0 00000100:00100000:3.0:1789304873.235575:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785718016:0@lo:400:kworker.0 00010000:00010000:0.0:1789304873.298753:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304873.429484:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304873.429493:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304873.429499:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304873.429554:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304873.429568:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304873.429580:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304873.429613:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785718400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304873.429689:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304873.430310:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785718400 00000100:00100000:0.0:1789304873.430320:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785718400 00000100:00100000:3.0:1789304873.430458:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38835000 going to sleep for 11 seconds 00000100:00100000:0.0:1789304873.431854:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:0.0:1789304873.431867:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785718400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304873.431885:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304873.431902:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312974dd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312974d6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304873.431926:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312974dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312974d6 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304873.431937:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312974dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312974d6 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304873.431945:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa000, rc 0) 00000100:00100000:0.0:1789304873.432021:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785718400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304873.432027:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1789304873.432143:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785718400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304873.432161:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304873.432171:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304873.432190:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304873.432195:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304873.432214:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.323327:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304874.822634:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304874.823698:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765644672 00000100:00100000:3.0:1789304874.823715:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765644672 00000100:00100000:3.0:1789304874.823796:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1081 00000100:00100000:3.0:1789304874.823807:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:55376:x1876219765644672:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304874.823840:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304874.823873:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312974e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007bd expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.823959:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.823978:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.823992:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.824005:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312974f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.824011:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312974f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.824016:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312974f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789304874.824291:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304874.825783:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312974f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825806:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312974f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825819:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312974f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304874.825860:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789304874.825865:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304874.825892:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312974f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825907:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825919:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825927:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825933:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304874.825938:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825946:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825959:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19400) 00010000:00010000:3.0:1789304874.825961:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304874.825967:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825973:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312974eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825988:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312974f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.825994:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312974f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.826000:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312974f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.826005:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304874.826009:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312974f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.826015:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312974f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.826021:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304874.826023:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304874.826026:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312974f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.826031:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312974f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.826083:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312974e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007bd expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.826125:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312974f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007bd expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.826132:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304874.826134:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304874.826137:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304874.826462:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:55376:x1876219765644672:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 2655us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304874.826473:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1081 00000100:00100000:0.0:1789304874.845406:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304874.849417:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765644928 00000100:00100000:3.0:1789304874.849437:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765644928 00000100:00100000:3.0:1789304874.849523:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1082 00000100:00100000:3.0:1789304874.849534:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55376:x1876219765644928:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304874.849565:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304874.849594:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297500 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007c4 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.849952:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.849973:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.849987:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.850002:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.850009:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.850016:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304874.850836:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1789304874.851194:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851210:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851220:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851268:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851276:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297507 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851282:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851289:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304874.851293:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851302:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297507 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851315:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304874.851319:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304874.851325:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297507 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851332:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297507 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304874.851348:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaab9c6f reply state 00000000f7f9895b transno 4294967710 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304874.851357:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304874.851398:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297500 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007c4 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851420:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007c4 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304874.851428:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:3.0:1789304874.851431:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304874.851433:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e000, rc 0) 00000100:00100000:3.0:1789304874.851533:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:55376:x1876219765644928:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 1999us (6140us total) trans 4294967710 rc 0/0 00000100:00100000:3.0:1789304874.851543:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1082 00000100:00100000:0.0:1789304874.864653:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304874.864714:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765645184 00000100:00100000:0.0:1789304874.864729:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765645184 00000100:00100000:0.0:1789304874.864799:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1083 00000100:00100000:0.0:1789304874.864811:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:55376:x1876219765645184:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:0.0:1789304874.864890:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304874.864928:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007c4 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.864954:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:0.0:1789304874.864969:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304874.865029:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.865056:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.865069:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304874.865927:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304874.865948:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304874.865957:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304874.865964:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304874.865970:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304874.865980:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304874.865995:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c2ea19700) 00010000:00010000:1.0:1789304874.865998:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304874.866004:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304874.866011:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb723129750e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304874.866975:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000722e8bce reply state 000000008de3a95f transno 4294967711 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304874.866996:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304874.867797:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:55376:x1876219765645184:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 2979us (3146us total) trans 4294967711 rc 0/0 00000100:00100000:0.0:1789304874.867809:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1083 00000100:00100000:0.0:1789304874.876610:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:0.0:1789304874.876649:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.876664:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.876674:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.876682:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304874.876689:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.876699:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.876719:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:0.0:1789304874.876722:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304874.876728:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.876735:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297523 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304874.876786:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765645312 00000100:00100000:0.0:1789304874.876799:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765645312 00000100:00100000:0.0:1789304874.876854:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1084 00000100:00100000:0.0:1789304874.876864:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:55376:x1876219765645312:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:0.0:1789304874.876893:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304874.876913:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129752a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007cb expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.876982:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129752a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007cb expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.876997:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129752a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007cb expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.877016:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:0.0:1789304874.877019:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789304874.877022:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789304874.877127:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:55376:x1876219765645312:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 264us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304874.877135:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1084 00000100:00100000:1.0:1789304874.883126:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304874.883173:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765645440 00000100:00100000:1.0:1789304874.883187:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765645440 00000100:00100000:1.0:1789304874.883277:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 589 00000100:00100000:1.0:1789304874.883292:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765645440:12345-192.168.202.29@tcp:2:touch.60003 00000100:00100000:1.0:1789304874.883733:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765645440:12345-192.168.202.29@tcp:2:touch.60003 Request processed in 445us (641us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789304874.883742:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 589 00000100:00080000:1.0:1789304874.883774:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304874.888040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304874.888291:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765645696 00000100:00100000:3.0:1789304874.888306:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765645696 00000100:00100000:3.0:1789304874.888378:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 110 00000100:00100000:3.0:1789304874.888391:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:55376:x1876219765645696:12345-192.168.202.29@tcp:35:touch.60003 00000100:00100000:3.0:1789304874.888833:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:55376:x1876219765645696:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 442us (804us total) trans 4294967712 rc 0/0 00000100:00100000:3.0:1789304874.888841:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 110 00000100:00100000:1.0:1789304874.973226:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304874.973519:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765645824 00000100:00100000:0.0:1789304874.973539:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765645824 00000100:00100000:0.0:1789304874.973694:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1085 00000100:00100000:0.0:1789304874.973711:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:55380:x1876219765645824:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:0.0:1789304874.973753:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304874.973793:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297531 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.973898:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297538 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.973919:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297538 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.973936:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297538 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.973956:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129753f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.973963:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129753f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.973970:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129753f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974165:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974176:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974183:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304874.974247:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 0 00000004:00200000:0.0:1789304874.974253:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304874.974305:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974320:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974329:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297538 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974336:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297538 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974344:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297538 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974350:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304874.974357:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297538 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974366:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297538 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974380:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:0.0:1789304874.974384:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304874.974391:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297538 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974397:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297538 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974415:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129753f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974420:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129753f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974426:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129753f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974431:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304874.974433:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129753f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974438:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129753f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974445:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c0558db00) 00010000:00010000:0.0:1789304874.974447:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304874.974450:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129753f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974455:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129753f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974494:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297531 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d2 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974513:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d2 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304874.974521:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:0.0:1789304874.974524:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304874.974526:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa400, rc 0) 00000100:00100000:0.0:1789304874.974643:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:55380:x1876219765645824:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 935us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304874.974652:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1085 00000100:00100000:2.0:1789304874.982381:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304874.992332:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765645952 00000100:00100000:3.0:1789304874.992370:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765645952 00000100:00100000:2.0:1789304874.992565:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 590 00000100:00100000:2.0:1789304874.992582:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765645952:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:2.0:1789304874.992615:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304874.992652:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129754d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007d9 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304874.992708:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa6a02b, atime: 0x6aa6a02b, ctime: 0x6aa6a02b, blocks: 0x1 00010000:00010000:2.0:1789304874.992746:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=2324s v=(0 0) 00010000:00010000:2.0:1789304874.992752:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304874.992767:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129754d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d9 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304874.992794:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129754d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d9 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304874.992815:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc800, rc 0) 00000100:00100000:2.0:1789304874.992936:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765645952:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 357us (10570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304874.992944:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 590 00000100:00100000:2.0:1789304875.018919:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304875.022214:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765646208 00000100:00100000:0.0:1789304875.022291:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765646208 00000100:00100000:1.0:1789304875.031861:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1086 00000100:00100000:1.0:1789304875.031884:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:55380:x1876219765646208:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:1.0:1789304875.031966:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304875.032009:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297546 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d2 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.032053:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb723129752a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007cb expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.032066:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:1.0:1789304875.032080:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304875.032176:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297554 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.032194:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297554 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.032206:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297554 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.032224:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.032231:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.032239:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.032817:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297562 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.032828:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297562 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.032837:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297562 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789304875.040082:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].34, 64 off10368 00000004:00080000:1.0:1789304875.040745:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2324718653377ns, next at 2325718646637ns, rc = 0 00010000:00010000:1.0:1789304875.040889:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.040913:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.040929:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.040942:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.040950:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.040957:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041026:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304875.041073:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297562 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041082:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297562 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041119:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297562 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041127:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304875.041133:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297562 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041141:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297562 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041156:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:1.0:1789304875.041159:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789304875.041165:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297562 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041172:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb7231297562 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041199:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297554 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041206:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297554 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041212:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297554 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041216:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304875.041220:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297554 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041226:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297554 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041235:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:1.0:1789304875.041238:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304875.041241:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297554 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304875.041247:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297554 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304875.041258:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007c4b81d reply state 00000000a7ce6a65 transno 4294967713 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304875.041270:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304875.044040:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:55380:x1876219765646208:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 12144us (25119us total) trans 4294967713 rc 0/0 00000100:00100000:1.0:1789304875.044067:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1086 00010000:00010000:3.0:1789304875.047867:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304875.047885:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.047900:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304875.047905:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.047922:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.047946:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:3.0:1789304875.047949:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304875.047956:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.047962:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297569 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.047992:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304875.047994:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304875.047996:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304875.048381:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.048392:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.048399:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.048405:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304875.048409:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.048416:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.048425:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c14add500) 00010000:00010000:3.0:1789304875.048429:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304875.048432:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304875.048438:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb723129755b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304875.349202:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304875.797561:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785718528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304875.797684:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304875.797876:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785718528 00000100:00100000:2.0:1789304875.797889:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785718528 00000100:00100000:2.0:1789304875.797987:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1789304875.798000:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785718528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304875.798063:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304875.798173:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785718528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304875.798182:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1789304875.798253:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785718528:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304875.798757:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304875.873932:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304875.873973:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304875.874002:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304875.874050:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304875.874854:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765646464 00000100:00100000:3.0:1789304875.874866:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765646464 00000100:00100000:3.0:1789304875.875279:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1664 00000100:00100000:3.0:1789304875.875292:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:2356:x1876219765646464:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304875.875386:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:2356:x1876219765646464:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 97us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304875.875395:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1664 00000100:00100000:3.0:1789304875.875430:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765646720 00000100:00100000:3.0:1789304875.875435:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765646720 00000100:00100000:3.0:1789304875.875915:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765646592 00000100:00100000:3.0:1789304875.875920:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765646592 00000100:00100000:3.0:1789304875.875964:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1275 00000100:00100000:3.0:1789304875.875975:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765646720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304875.876020:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765646720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 48us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304875.876027:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1275 00000100:00100000:3.0:1789304875.876050:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1276 00000100:00100000:3.0:1789304875.876058:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765646592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304875.876128:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765646592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 70us (2077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304875.876138:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1276 00000100:00100000:3.0:1789304875.876164:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765646336 00000100:00100000:3.0:1789304875.876169:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765646336 00000100:00100000:3.0:1789304875.876200:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1309 00000100:00100000:3.0:1789304875.876209:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765646336:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304875.876242:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765646336:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304875.876250:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1309 00000100:00080000:3.0:1789304875.876295:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304876.372345:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304876.415297:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967711 is committed 00000001:00080000:2.0:1789304876.415314:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967713 is committed 00000004:00080000:2.0:1789304876.415318:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 89 committed 00000100:00100000:0.0:1789304876.415494:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789304876.415514:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785718656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304876.415582:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304876.415644:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785718656 00000100:00100000:0.0:1789304876.415652:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785718656 00000100:00100000:0.0:1789304876.415708:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1789304876.415717:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785718656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789304876.415746:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:34 count 1 00010000:00010000:0.0:1789304876.415773:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.416014:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129754d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d9 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.416023:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789304876.416028:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304876.416042:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.416069:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129754d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d9 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789304876.416219:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304876.416893:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129754d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d9 expref: 6 pid: 6693 timeout: 2426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304876.416908:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876219785718784:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304876.416985:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38835540 going to sleep for 11 seconds 00000100:00100000:3.0:1789304876.427008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304876.427173:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765646848 00000100:00100000:1.0:1789304876.427181:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765646848 00010000:00010000:1.0:1789304876.427242:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129754d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d9 expref: 7 pid: 6693 timeout: 2426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304876.427267:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876219785718784:192.168.202.29@tcp:104: 00000100:00100000:1.0:1789304876.427277:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 430 00010000:00010000:0.0:1789304876.427290:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304876.427292:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c063f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765646848:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304876.427307:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304876.427313:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129754d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d9 expref: 7 pid: 6693 timeout: 2426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.427325:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129754d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d9 expref: 7 pid: 6693 timeout: 2426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.427353:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d259313/0xefc0bb723129754d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007d9 expref: 7 pid: 6693 timeout: 2426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.427369:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304876.427374:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304876.427379:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.427390:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.427415:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304876.427467:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c063f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765646848:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 181us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304876.427475:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 430 00010000:00010000:1.0:1789304876.427671:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.427681:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.427693:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.427702:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.427720:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789304876.428331:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785718656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12613us (12747us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789304876.428341:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00010000:00010000:1.0:1789304876.428367:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304876.428373:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.428382:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304876.428386:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.428396:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.428412:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.428420:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c02497b5/0xefc0bb7231297570 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.428438:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304876.428440:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304876.428442:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304876.428473:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c06237800/2, rc 0, transno 4294967365 00000100:00100000:1.0:1789304876.428479:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785718656:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1789304876.428894:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304876.821449:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304876.821473:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785718912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304876.821549:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304876.822148:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785718912 00000100:00100000:1.0:1789304876.822155:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785718912 00000100:00100000:1.0:1789304876.822349:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:1.0:1789304876.822356:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785718912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304876.822389:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304876.822445:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785718912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304876.822450:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:1.0:1789304876.822489:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785718912:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789304876.918918:0:94761:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd8b965f0 20000000:00000080:1.0:1789304876.918936:0:94761:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854ec00 uarg=0000000000000000 00010000:00010000:1.0:1789304876.920004:0:94761:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304876.920056:0:94761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:1.0:1789304876.920061:0:94761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304876.920366:0:94761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb72312974f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007bd expref: 5 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.920393:0:94761:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304876.920414:0:94761:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304876.920428:0:94761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.920443:0:94761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312974dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312974d6 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.920454:0:94761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.920493:0:94761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312974dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312974d6 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304876.920508:0:94761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312974dd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312974d6 expref: 18 pid: 5847 timeout: 2476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304876.920521:0:94761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94761:1876219785719040:0@lo:104: 00000100:00100000:1.0:1789304876.920587:0:94761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304876.920697:0:94761:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c205b5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789304876.920907:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785719040 00000100:00100000:2.0:1789304876.920915:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785719040 00000100:00100000:2.0:1789304876.920997:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789304876.921008:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:94761:x1876219785719040:12345-0@lo:104: 00010000:00010000:2.0:1789304876.921021:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304876.921136:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304876.921142:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:94761:x1876219785719040:12345-0@lo:104: Request processed in 137us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304876.921149:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789304876.921238:0:94761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94761:1876219785719040:0@lo:104: 00010000:00010000:3.0:1789304876.921257:0:94761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921373:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304876.921381:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921389:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304876.921393:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921402:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304876.921408:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304876.921414:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304876.921451:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921458:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304876.921481:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921487:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb72312974d6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312974dd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921502:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304876.921504:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304876.921506:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304876.921517:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785719168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304876.921552:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304876.921595:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785719168 00000100:00100000:0.0:1789304876.921600:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785719168 00010000:00010000:0.0:1789304876.921618:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312974dd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312974d6 expref: 19 pid: 5847 timeout: 2476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304876.921640:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1789304876.921647:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785719168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304876.921657:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304876.921662:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312974dd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312974d6 expref: 19 pid: 5847 timeout: 2476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921672:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312974dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312974d6 expref: 19 pid: 5847 timeout: 2476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921685:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa000/0xefc0bb72312974dd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312974d6 expref: 19 pid: 5847 timeout: 2476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921697:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921705:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921718:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921725:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921732:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921738:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921744:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370c00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304876.921748:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921756:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921766:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304876.921774:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304876.921801:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785719168:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304876.921808:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1789304876.921835:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785719168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304876.922017:0:94761:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304876.922036:0:94761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304876.922042:0:94761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370c00/0xefc0bb7231297577 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304877.396202:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304878.100052:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304878.100060:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304878.100066:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304878.100146:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304878.100160:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304878.100172:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304878.100199:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785719296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304878.100275:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304878.100338:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b024b50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304878.100435:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785719296 00000100:00100000:1.0:1789304878.100445:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785719296 00000100:00100000:1.0:1789304878.100507:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:1.0:1789304878.100516:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785719296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304878.100530:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304878.100544:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297585 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129757e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304878.100568:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297585 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129757e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304878.100578:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297585 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129757e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304878.100586:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370000, rc 0) 00000100:00100000:1.0:1789304878.100629:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785719296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304878.100636:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:1.0:1789304878.100685:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785719296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304878.100699:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304878.100708:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304878.100725:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304878.100730:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304878.100738:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304878.354434:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785719552:0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.354517:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304878.354584:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785720064:0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.354612:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304878.354639:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304878.354645:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785719680:0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.354666:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304878.354702:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785719552 00000100:00100000:3.0:1789304878.354710:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785719552 00000100:00100000:3.0:1789304878.354757:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1789304878.354766:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785719552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.354816:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785719552:12345-0@lo:400:kworker.0 Request processed in 51us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304878.354824:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1789304878.354848:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785720064 00000100:00100000:3.0:1789304878.354852:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785720064 00000100:00100000:3.0:1789304878.354882:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785719680 00000100:00100000:3.0:1789304878.354885:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785719680 00000100:00100000:3.0:1789304878.354905:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1789304878.354912:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785720064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.354942:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785720064:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304878.354948:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1789304878.354959:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1789304878.354965:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785719680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.354989:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785719680:12345-0@lo:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304878.354995:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00080000:3.0:1789304878.355027:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304878.355030:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304878.355069:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785719680:0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.355080:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785719552:0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.355088:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785720064:0@lo:400:kworker.0 00000100:00100000:1.0:1789304878.355255:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785719808:0@lo:400:kworker.0 00000100:00100000:1.0:1789304878.355286:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304878.355315:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789304878.355321:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785719424:0@lo:400:kworker.0 00000100:00100000:1.0:1789304878.355345:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304878.355362:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785719936:0@lo:400:kworker.0 00000100:00100000:1.0:1789304878.355382:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304878.357749:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785719808 00000100:00100000:3.0:1789304878.357764:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785719808 00000100:00100000:3.0:1789304878.357943:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785719936 00000100:00100000:3.0:1789304878.357948:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785719936 00000100:00100000:3.0:1789304878.357973:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1789304878.357981:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785719808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.358141:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785719808:12345-0@lo:400:kworker.0 Request processed in 160us (2853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304878.358149:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1789304878.358167:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:3.0:1789304878.358173:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785719936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.358202:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785719936:12345-0@lo:400:kworker.0 Request processed in 30us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304878.358208:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00000100:00100000:3.0:1789304878.358229:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785719424 00000100:00100000:3.0:1789304878.358233:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785719424 00000100:00100000:3.0:1789304878.358257:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:3.0:1789304878.358264:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785719424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.358294:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785719424:12345-0@lo:400:kworker.0 Request processed in 32us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304878.358300:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:3.0:1789304878.358367:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785719424:0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.358382:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785719936:0@lo:400:kworker.0 00000100:00100000:3.0:1789304878.358392:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785719808:0@lo:400:kworker.0 00000100:00080000:2.0:1789304878.358828:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304878.419001:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304878.441133:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00000001:00080000:3.0:1789304878.441150:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00010000:00010000:2.0:1789304879.443198:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304879.963876:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304879.964223:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765646976 00000100:00100000:3.0:1789304879.964233:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765646976 00000100:00100000:3.0:1789304879.964296:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1087 00000100:00100000:3.0:1789304879.964307:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:55468:x1876219765646976:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304879.964328:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304879.964351:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129758c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007e0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304879.964420:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297593 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304879.964434:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304879.964448:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304879.964482:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789304879.964486:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304879.964505:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304879.964531:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb723129758c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007e0 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304879.964554:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007e0 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304879.964562:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304879.964565:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304879.964569:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fa00, rc 0) 00000100:00100000:3.0:1789304879.964876:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:55468:x1876219765646976:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 570us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304879.964885:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1087 00000100:00080000:3.0:1789304879.964908:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304879.970339:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304879.970453:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765647232 00000100:00100000:3.0:1789304879.970465:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765647232 00000100:00100000:3.0:1789304879.970526:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1088 00000100:00100000:3.0:1789304879.970535:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55468:x1876219765647232:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304879.970592:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304879.970864:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297593 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007e0 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304879.970883:0:7654:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312974f9) 00010000:00010000:3.0:1789304879.970887:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304879.970898:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304879.970930:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304879.970946:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304879.970958:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789304880.007062:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967714 is committed 00000004:00010000:3.0:1789304880.007713:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb49e256 reply state 000000000fa24ee5 transno 4294967714 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304880.007729:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304880.007745:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00080000:3.0:1789304880.007949:0:7654:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304880.007973:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55468:x1876219765647232:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 37435us (37641us total) trans 4294967714 rc 0/0 00000100:00100000:3.0:1789304880.007983:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1088 00010000:00010000:0.0:1789304880.008175:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304880.008186:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304880.008194:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304880.008201:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304880.008206:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304880.008215:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304880.008230:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19f00) 00010000:00010000:0.0:1789304880.008233:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304880.008238:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304880.008244:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb723129759a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304880.467010:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304880.719398:0:94958:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdce0da7b0 20000000:00000080:2.0:1789304880.719415:0:94958:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c10e68800 uarg=0000000000000000 00010000:00010000:2.0:1789304880.720353:0:94958:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789304880.720372:0:94958:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789304880.720386:0:94958:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304880.720405:0:94958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304880.720424:0:94958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297585 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129757e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304880.720432:0:94958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304880.720471:0:94958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297585 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129757e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304880.720486:0:94958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297585 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129757e expref: 18 pid: 5847 timeout: 2480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304880.720501:0:94958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94958:1876219785720192:0@lo:104: 00000100:00100000:2.0:1789304880.720564:0:94958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304880.720682:0:94958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304880.720949:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785720192 00000100:00100000:0.0:1789304880.720957:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785720192 00000100:00100000:0.0:1789304880.721062:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789304880.721073:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:94958:x1876219785720192:12345-0@lo:104: 00010000:00010000:0.0:1789304880.721120:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304880.721194:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304880.721200:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:94958:x1876219785720192:12345-0@lo:104: Request processed in 130us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304880.721207:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789304880.721292:0:94958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94958:1876219785720192:0@lo:104: 00010000:00010000:2.0:1789304880.721311:0:94958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721375:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304880.721383:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721391:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304880.721395:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721404:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304880.721411:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304880.721417:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304880.721455:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721461:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304880.721478:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721485:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb723129757e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297585 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721501:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304880.721503:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304880.721504:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304880.721515:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785720320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304880.721546:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304880.721594:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785720320 00000100:00100000:3.0:1789304880.721597:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785720320 00010000:00010000:3.0:1789304880.721629:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297585 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129757e expref: 19 pid: 5847 timeout: 2480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304880.721653:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1789304880.721660:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785720320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304880.721671:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304880.721675:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297585 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129757e expref: 19 pid: 5847 timeout: 2480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721684:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297585 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129757e expref: 19 pid: 5847 timeout: 2480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721697:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297585 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129757e expref: 19 pid: 5847 timeout: 2480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721709:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721716:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721729:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721736:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721743:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721760:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721776:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304880.721780:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721787:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721959:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304880.721970:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304880.722015:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785720320:12345-0@lo:103:ldlm_bl.0 Request processed in 355us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304880.722022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1789304880.722054:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785720320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304880.722263:0:94958:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304880.722271:0:94958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304880.722277:0:94958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312975a1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304880.920620:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785720448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304880.920685:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304880.920751:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785720448 00000100:00100000:2.0:1789304880.920759:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785720448 00000100:00100000:2.0:1789304880.921383:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1789304880.921397:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785720448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304880.921437:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304880.921494:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785720448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304880.921499:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1789304880.921553:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785720448:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304880.921585:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304880.993918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304880.993951:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304880.993980:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304880.994011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304880.994279:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765647488 00000100:00100000:3.0:1789304880.994290:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765647488 00000100:00100000:3.0:1789304880.994357:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1668 00000100:00100000:3.0:1789304880.994367:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765647488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304880.994449:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765647488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 84us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304880.994458:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1668 00000100:00100000:3.0:1789304880.994481:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765647744 00000100:00100000:3.0:1789304880.994485:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765647744 00000100:00100000:3.0:1789304880.994519:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765647616 00000100:00100000:3.0:1789304880.994521:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765647616 00000100:00100000:3.0:1789304880.994543:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1279 00000100:00100000:3.0:1789304880.994549:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765647744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304880.994577:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765647744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304880.994584:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1279 00000100:00100000:3.0:1789304880.994596:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1280 00000100:00100000:3.0:1789304880.994602:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765647616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304880.994625:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765647616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 23us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304880.994631:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1280 00000100:00100000:3.0:1789304880.994650:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765647360 00000100:00100000:3.0:1789304880.994653:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765647360 00000100:00100000:3.0:1789304880.994675:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1312 00000100:00100000:3.0:1789304880.994681:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765647360:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304880.994705:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765647360:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304880.994711:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1312 00000100:00080000:1.0:1789304880.995172:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304880.995178:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789304881.491741:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304881.946365:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785720576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304881.946455:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304881.946542:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785720576 00000100:00100000:0.0:1789304881.946550:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785720576 00000100:00100000:0.0:1789304881.946611:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1789304881.946620:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785720576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304881.946654:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304881.946695:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785720576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304881.946702:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00080000:0.0:1789304881.946723:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304881.946748:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:0.0:1789304881.946753:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c06237800, transno 4294967365 00000100:00100000:0.0:1789304881.946769:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785720576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304882.516206:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304882.578295:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304882.578305:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304882.578312:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304882.578364:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304882.578376:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304882.578388:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304882.578412:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785720704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304882.578482:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304882.578547:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8600 going to sleep for 11 seconds 00000100:00100000:3.0:1789304882.578620:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785720704 00000100:00100000:3.0:1789304882.578629:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785720704 00000100:00100000:3.0:1789304882.578689:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1789304882.578697:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785720704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304882.578711:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304882.578725:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fc00/0xefc0bb72312975af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312975a8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304882.578764:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fc00/0xefc0bb72312975af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312975a8 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304882.578775:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb72312975af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312975a8 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304882.578784:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304882.578836:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785720704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304882.578842:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1789304882.580910:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785720704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304882.580938:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304882.580951:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304882.580983:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304882.580989:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304882.580997:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304883.480701:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785720832:0@lo:400:kworker.0 00000100:00100000:0.0:1789304883.480780:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304883.481205:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785720832 00000100:00100000:3.0:1789304883.481216:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785720832 00000100:00100000:3.0:1789304883.481263:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1789304883.481272:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785720832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304883.481328:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785720832:12345-0@lo:400:kworker.0 Request processed in 58us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304883.481335:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1789304883.482325:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785720832:0@lo:400:kworker.0 00000100:00100000:0.0:1789304883.482336:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785721344:0@lo:400:kworker.0 00000100:00100000:0.0:1789304883.482374:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304883.482410:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789304883.482416:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785720960:0@lo:400:kworker.0 00000100:00100000:0.0:1789304883.482436:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304883.482455:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785721472:0@lo:400:kworker.0 00000100:00100000:0.0:1789304883.482477:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304883.482506:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785721088:0@lo:400:kworker.0 00000100:00100000:0.0:1789304883.482527:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304883.482541:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304883.482546:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785721216:0@lo:400:kworker.0 00000100:00100000:0.0:1789304883.482565:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304883.483185:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785721344 00000100:00100000:3.0:1789304883.483193:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785721344 00000100:00100000:3.0:1789304883.483239:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785720960 00000100:00100000:3.0:1789304883.483242:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785720960 00000100:00100000:3.0:1789304883.483258:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785721216 00000100:00100000:3.0:1789304883.483261:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785721216 00000100:00100000:3.0:1789304883.483275:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1789304883.483283:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785721344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304883.483342:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785721344:12345-0@lo:400:kworker.0 Request processed in 60us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304883.483352:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:3.0:1789304883.483367:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1789304883.483372:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785720960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304883.483396:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785720960:12345-0@lo:400:kworker.0 Request processed in 24us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304883.483402:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1789304883.483411:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:3.0:1789304883.483417:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785721216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304883.483444:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785721216:12345-0@lo:400:kworker.0 Request processed in 28us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304883.483449:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00100000:3.0:1789304883.483464:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785721472 00000100:00100000:3.0:1789304883.483467:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785721472 00000100:00100000:3.0:1789304883.483488:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785721088 00000100:00100000:3.0:1789304883.483492:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785721088 00000100:00100000:3.0:1789304883.483512:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1789304883.483517:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785721472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304883.483547:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785721472:12345-0@lo:400:kworker.0 Request processed in 30us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304883.483552:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1789304883.483562:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1789304883.483568:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785721088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304883.483594:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785721088:12345-0@lo:400:kworker.0 Request processed in 27us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304883.483598:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00080000:3.0:1789304883.483618:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304883.483621:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304883.483623:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304883.483650:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785720960:0@lo:400:kworker.0 00000100:00100000:3.0:1789304883.483661:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785721472:0@lo:400:kworker.0 00000100:00100000:3.0:1789304883.483670:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785721344:0@lo:400:kworker.0 00000100:00100000:3.0:1789304883.483697:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785721216:0@lo:400:kworker.0 00000100:00100000:3.0:1789304883.483707:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785721088:0@lo:400:kworker.0 00010000:00010000:3.0:1789304883.539313:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304883.966838:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304883.966875:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765647872 00000100:00100000:0.0:1789304883.966886:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765647872 00000100:00100000:0.0:1789304883.967305:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1089 00000100:00100000:0.0:1789304883.967316:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:55545:x1876219765647872:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:0.0:1789304883.967338:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304883.967360:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312975b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.967432:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312975bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.967447:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312975bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.967461:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312975bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.967474:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312975c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.967480:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312975c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.967486:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312975c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.967995:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312975cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789304883.969230:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304883.969605:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312975cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969624:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312975cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304883.969675:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:0.0:1789304883.969680:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304883.969707:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312975cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969722:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312975bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969729:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312975bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969737:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312975bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969743:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304883.969747:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312975bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969754:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312975bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969766:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:0.0:1789304883.969770:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304883.969775:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312975bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969781:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312975bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969794:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312975c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969799:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312975c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969805:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312975c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969809:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304883.969812:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312975c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969818:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312975c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969825:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c0558de00) 00010000:00010000:0.0:1789304883.969828:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304883.969831:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312975c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969837:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312975c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969878:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312975b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007e7 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969903:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312975cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007e7 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304883.969911:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304883.969914:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304883.969916:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789304883.970016:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:55545:x1876219765647872:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 2701us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304883.970026:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1089 00010000:00010000:2.0:1789304884.562223:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304885.587086:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304885.615720:0:95203:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff292450a0 20000000:00000080:1.0:1789304885.615748:0:95203:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36ae8800 uarg=0000000000000000 00010000:00010000:1.0:1789304885.617233:0:95203:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789304885.617297:0:95203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:1.0:1789304885.617302:0:95203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304885.617322:0:95203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312975cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007e7 expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304885.617354:0:95203:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789304885.617376:0:95203:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304885.617396:0:95203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304885.617414:0:95203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860fc00/0xefc0bb72312975af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312975a8 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304885.617423:0:95203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304885.617479:0:95203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860fc00/0xefc0bb72312975af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312975a8 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304885.617497:0:95203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb72312975af lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312975a8 expref: 18 pid: 5847 timeout: 2485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304885.617514:0:95203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95203:1876219785721600:0@lo:104: 00000100:00100000:1.0:1789304885.617606:0:95203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304885.617747:0:95203:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38835300 going to sleep for 11 seconds 00000100:00100000:2.0:1789304885.617808:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785721600 00000100:00100000:2.0:1789304885.617817:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785721600 00000100:00100000:2.0:1789304885.618057:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789304885.618070:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:95203:x1876219785721600:12345-0@lo:104: 00010000:00010000:2.0:1789304885.618123:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304885.618212:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304885.618218:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:95203:x1876219785721600:12345-0@lo:104: Request processed in 151us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304885.618226:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789304885.618320:0:95203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95203:1876219785721600:0@lo:104: 00010000:00010000:3.0:1789304885.618346:0:95203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618418:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304885.618427:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618435:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789304885.618440:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618449:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789304885.618456:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304885.618463:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789304885.618513:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618521:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789304885.618551:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618559:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd800/0xefc0bb72312975a8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312975af expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618579:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304885.618581:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304885.618583:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304885.618599:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785721728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304885.618639:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304885.618694:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785721728 00000100:00100000:0.0:1789304885.618700:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785721728 00010000:00010000:0.0:1789304885.618725:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860fc00/0xefc0bb72312975af lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312975a8 expref: 19 pid: 5847 timeout: 2485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304885.618750:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1789304885.618757:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785721728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304885.618771:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304885.618777:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860fc00/0xefc0bb72312975af lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312975a8 expref: 19 pid: 5847 timeout: 2485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618788:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860fc00/0xefc0bb72312975af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312975a8 expref: 19 pid: 5847 timeout: 2485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618802:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fc00/0xefc0bb72312975af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312975a8 expref: 19 pid: 5847 timeout: 2485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618819:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618833:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618866:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618875:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618883:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618889:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618895:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304885.618899:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618907:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618920:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304885.618930:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304885.618974:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785721728:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304885.618981:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1789304885.619013:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785721728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304885.619321:0:95203:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304885.619331:0:95203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304885.619337:0:95203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371000/0xefc0bb72312975d2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304886.034459:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789304886.034567:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785721856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304886.034771:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304886.034965:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785721856 00000100:00100000:3.0:1789304886.034976:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785721856 00000100:00080000:0.0:1789304886.035120:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304886.035257:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1789304886.035268:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785721856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304886.035321:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304886.035396:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785721856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304886.035404:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1789304886.035488:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785721856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304886.115012:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304886.115070:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304886.115153:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304886.115191:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304886.115236:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765648128 00000100:00100000:3.0:1789304886.115251:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765648128 00000100:00100000:3.0:1789304886.115352:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1672 00000100:00100000:3.0:1789304886.115367:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765648128:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304886.115471:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765648128:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 108us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304886.115480:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1672 00000100:00100000:0.0:1789304886.115616:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765648000 00000100:00100000:0.0:1789304886.115622:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765648000 00000100:00100000:0.0:1789304886.115660:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1315 00000100:00100000:0.0:1789304886.115668:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765648000:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304886.115702:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765648000:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 35us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304886.115709:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1315 00000100:00100000:2.0:1789304886.115807:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765648256 00000100:00100000:2.0:1789304886.115812:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765648256 00000100:00100000:2.0:1789304886.115854:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765648384 00000100:00100000:2.0:1789304886.115856:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765648384 00000100:00100000:2.0:1789304886.115881:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1283 00000100:00100000:2.0:1789304886.115887:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765648256:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304886.115915:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765648256:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304886.115921:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1283 00000100:00100000:2.0:1789304886.115932:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 592 00000100:00100000:2.0:1789304886.115949:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765648384:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:2.0:1789304886.115976:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231297435 00000100:00080000:2.0:1789304886.115999:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9e2c02f88000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789304886.116057:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967363 00000100:00100000:2.0:1789304886.116394:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765648384:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 453us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304886.116402:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 592 00010000:00010000:2.0:1789304886.116430:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789304886.116473:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304886.116479:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789304886.116483:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304886.615756:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304887.058420:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304887.062237:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785721984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304887.062366:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304887.062769:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785721984 00000100:00100000:0.0:1789304887.062783:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785721984 00000100:00100000:0.0:1789304887.062895:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1789304887.062908:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785721984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304887.062976:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789304887.063085:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304887.063264:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785721984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 358us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304887.063273:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1789304887.063490:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785721984:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1789304887.453659:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304887.453671:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304887.453680:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304887.453759:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304887.453776:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304887.453792:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304887.453828:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785722112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304887.453954:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304887.454177:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38835b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789304887.460815:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785722112 00000100:00100000:3.0:1789304887.460839:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785722112 00000100:00100000:3.0:1789304887.460951:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:3.0:1789304887.460964:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785722112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304887.461284:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304887.461315:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312975e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312975d9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304887.461357:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312975e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312975d9 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304887.461377:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312975e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312975d9 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304887.461389:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ea00, rc 0) 00000100:00100000:3.0:1789304887.461634:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785722112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 673us (7680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304887.461643:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1789304887.461767:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785722112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304887.461793:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304887.461805:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304887.461833:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304887.461839:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304887.461852:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304887.634245:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304888.601828:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785722240:0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.601969:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304888.602488:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785722240 00000100:00100000:2.0:1789304888.602501:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785722240 00000100:00100000:2.0:1789304888.602565:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:2.0:1789304888.602576:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785722240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304888.602644:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785722240:12345-0@lo:400:kworker.0 Request processed in 70us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304888.602651:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:0.0:1789304888.602784:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785722240:0@lo:400:kworker.0 00000100:00100000:1.0:1789304888.615848:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785722368:0@lo:400:kworker.0 00000100:00100000:1.0:1789304888.615959:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304888.617285:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785722368 00000100:00100000:3.0:1789304888.617851:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785722368 00000100:00100000:3.0:1789304888.617944:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1673 00000100:00100000:3.0:1789304888.617956:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785722368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304888.625928:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785722368:12345-0@lo:400:kworker.0 Request processed in 7949us (9945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304888.625948:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1673 00000100:00100000:0.0:1789304888.629617:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785722496:0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.631568:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304888.631877:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785722496 00000100:00100000:2.0:1789304888.631891:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785722496 00000100:00100000:2.0:1789304888.631978:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1789304888.631990:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785722496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304888.632615:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785722368:0@lo:400:kworker.0 00000100:00100000:2.0:1789304888.632935:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785722496:12345-0@lo:400:kworker.0 Request processed in 927us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304888.632946:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:0.0:1789304888.634399:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785722496:0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.634507:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785722624:0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.634585:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304888.634651:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785722624 00000100:00100000:0.0:1789304888.634660:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785722624 00000100:00100000:0.0:1789304888.634754:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:0.0:1789304888.634765:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785722624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.634821:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785722624:12345-0@lo:400:kworker.0 Request processed in 58us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304888.634828:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00000100:00080000:0.0:1789304888.634852:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304888.634873:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785722624:0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.634903:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785722752:0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.634943:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304888.634976:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785722752 00000100:00100000:0.0:1789304888.634980:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785722752 00000100:00100000:0.0:1789304888.635008:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:0.0:1789304888.635013:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785722752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.635060:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785722752:12345-0@lo:400:kworker.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304888.635067:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00080000:0.0:1789304888.635080:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304888.635120:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785722752:0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.635158:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785722880:0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.635191:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304888.635223:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785722880 00000100:00100000:0.0:1789304888.635227:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785722880 00000100:00100000:0.0:1789304888.635258:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:0.0:1789304888.635265:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785722880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304888.635299:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785722880:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304888.635306:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00080000:0.0:1789304888.635318:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304888.635336:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785722880:0@lo:400:kworker.0 00010000:00010000:0.0:1789304888.670337:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789304888.721582:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304888.721596:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2c02f8e000/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789304888.721671:0:490:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c02f8e000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:0.0:1789304888.721737:0:490:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c02f88000 for lustre-OST0001 00000100:00100000:1.0:1789304889.467429:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304889.467548:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765648512 00000100:00100000:2.0:1789304889.467562:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765648512 00000100:00100000:2.0:1789304889.467665:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1090 00000100:00100000:2.0:1789304889.467678:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:55630:x1876219765648512:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304889.467708:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304889.467739:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312975e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007ee expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304889.467841:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312975ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304889.467859:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312975ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304889.467877:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312975ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304889.467964:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:2.0:1789304889.467971:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304889.467999:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312975ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304889.468034:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb72312975e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007ee expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304889.468064:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312975ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007ee expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304889.468073:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304889.468075:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304889.468080:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd200, rc 0) 00000100:00100000:2.0:1789304889.468214:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:55630:x1876219765648512:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 538us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304889.468221:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1090 00000100:00080000:1.0:1789304889.468295:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304889.474180:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304889.475406:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765648768 00000100:00100000:2.0:1789304889.475432:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765648768 00000100:00100000:2.0:1789304889.475523:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1091 00000100:00100000:2.0:1789304889.475538:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:55630:x1876219765648768:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:2.0:1789304889.475617:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304889.475654:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb72312975ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007ee expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304889.475679:0:5854:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb72312975cb) 00010000:00010000:2.0:1789304889.475684:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304889.475698:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304889.475732:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304889.475749:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304889.475761:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304889.476294:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000825d3f71 reply state 00000000dba4120c transno 4294967715 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304889.476311:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789304889.476322:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000100:00100000:2.0:1789304889.476446:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:55630:x1876219765648768:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 909us (2281us total) trans 4294967715 rc 0/0 00000100:00100000:2.0:1789304889.476456:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1091 00010000:00010000:0.0:1789304889.481990:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304889.482015:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304889.482024:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304889.482031:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304889.482037:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304889.482045:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304889.482068:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c421d2a00) 00010000:00010000:0.0:1789304889.482071:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304889.482078:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304889.482105:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312975f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304889.686838:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304890.200604:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967715 is committed 00000020:00000080:0.0:1789304890.454741:0:95402:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed82ef5e0 20000000:00000080:0.0:1789304890.454765:0:95402:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e7a400 uarg=0000000000000000 00010000:00010000:0.0:1789304890.455785:0:95402:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304890.455807:0:95402:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304890.455823:0:95402:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304890.455848:0:95402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304890.455868:0:95402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312975e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312975d9 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304890.455878:0:95402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304890.455942:0:95402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312975e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312975d9 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304890.456037:0:95402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312975e0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312975d9 expref: 18 pid: 5847 timeout: 2490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304890.456057:0:95402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95402:1876219785723008:0@lo:104: 00000100:00100000:0.0:1789304890.456307:0:95402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304890.456422:0:95402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05a08cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304890.456485:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789304890.456501:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785723008 00000100:00100000:1.0:1789304890.456511:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785723008 00000100:00100000:1.0:1789304890.456611:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789304890.456623:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02071850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:95402:x1876219785723008:12345-0@lo:104: 00010000:00010000:1.0:1789304890.456639:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304890.456758:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304890.456766:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02071850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:95402:x1876219785723008:12345-0@lo:104: Request processed in 146us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304890.456775:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00010000:00010000:3.0:1789304890.456867:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304890.456878:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304890.456887:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371e00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304890.456891:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304890.456912:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304890.456922:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304890.456929:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304890.456981:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304890.456989:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304890.457019:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304890.457027:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb72312975d9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312975e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304890.457048:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304890.457050:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304890.457052:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304890.457346:0:95402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95402:1876219785723008:0@lo:104: 00010000:00010000:0.0:1789304890.457371:0:95402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304890.457400:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785723136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304890.457438:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304890.457540:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785723136 00000100:00100000:2.0:1789304890.457546:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785723136 00010000:00010000:2.0:1789304890.457576:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312975e0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312975d9 expref: 19 pid: 5847 timeout: 2490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304890.457612:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1789304890.457620:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785723136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304890.457635:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304890.457641:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312975e0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312975d9 expref: 19 pid: 5847 timeout: 2490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457653:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312975e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312975d9 expref: 19 pid: 5847 timeout: 2490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457675:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ea00/0xefc0bb72312975e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312975d9 expref: 19 pid: 5847 timeout: 2490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457693:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457704:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457722:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457730:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457737:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457743:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457750:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304890.457756:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457765:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457777:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304890.457790:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304890.457828:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785723136:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304890.457835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1789304890.457864:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785723136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304890.457925:0:95402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304890.457935:0:95402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304890.457941:0:95402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312975fc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304890.706224:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304891.157803:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304891.157827:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785723264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304891.157933:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304891.162209:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785723264 00000100:00100000:3.0:1789304891.162227:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785723264 00000100:00100000:3.0:1789304891.162313:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1789304891.162325:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785723264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304891.162367:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304891.162469:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785723264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (4536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304891.162477:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00080000:1.0:1789304891.162542:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304891.162600:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785723264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304891.240276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304891.240492:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765649024 00000100:00100000:0.0:1789304891.240502:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765649024 00000100:00100000:0.0:1789304891.240580:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1676 00000100:00100000:0.0:1789304891.240590:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765649024:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304891.240681:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765649024:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 92us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304891.240689:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1676 00000100:00080000:1.0:1789304891.240925:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304891.247157:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304891.247193:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304891.247322:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765649152 00000100:00100000:1.0:1789304891.247332:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765649152 00000100:00100000:1.0:1789304891.247407:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1286 00000100:00100000:1.0:1789304891.247417:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765649152:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304891.247490:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765649152:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304891.247497:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1286 00000100:00100000:0.0:1789304891.247779:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765648896 00000100:00100000:0.0:1789304891.247784:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765648896 00000100:00100000:0.0:1789304891.247823:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1318 00000100:00100000:0.0:1789304891.247830:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765648896:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304891.247868:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765648896:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304891.247875:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1318 00000100:00080000:3.0:1789304891.248706:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304891.731915:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304892.050218:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304892.050226:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304892.050230:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304892.050276:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304892.050288:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304892.050298:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304892.050324:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03688a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785723392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304892.050391:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304892.050443:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c06287840 going to sleep for 11 seconds 00000100:00100000:0.0:1789304892.050528:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785723392 00000100:00100000:0.0:1789304892.050537:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785723392 00000100:00100000:0.0:1789304892.050601:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1789304892.050610:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785723392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304892.050622:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304892.050637:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb600/0xefc0bb723129760a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297603 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304892.050661:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb600/0xefc0bb723129760a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297603 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304892.050673:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb600/0xefc0bb723129760a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297603 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304892.050683:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:0.0:1789304892.050723:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785723392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304892.050730:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1789304892.051006:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03688a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785723392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304892.051023:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304892.051032:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304892.051053:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304892.051057:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304892.051065:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304892.179300:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304892.179329:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785723520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304892.179406:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304892.179500:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785723520 00000100:00100000:0.0:1789304892.179509:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785723520 00000100:00100000:0.0:1789304892.179580:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00080000:1.0:1789304892.179694:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304892.179805:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785723520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304892.179846:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304892.179927:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785723520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304892.180000:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785723520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304892.188917:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00010000:00010000:2.0:1789304892.755640:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304893.716163:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785723776:0@lo:400:kworker.0 00000100:00100000:1.0:1789304893.716250:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304893.716313:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785724288:0@lo:400:kworker.0 00000100:00100000:1.0:1789304893.716343:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304893.716372:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789304893.716379:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785723648:0@lo:400:kworker.0 00000100:00100000:1.0:1789304893.716408:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304893.716435:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785724160:0@lo:400:kworker.0 00000100:00100000:1.0:1789304893.716457:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304893.716486:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785723904:0@lo:400:kworker.0 00000100:00100000:1.0:1789304893.716511:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304893.717036:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785724288 00000100:00100000:0.0:1789304893.717047:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785724288 00000100:00100000:0.0:1789304893.717121:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785723904 00000100:00100000:0.0:1789304893.717124:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785723904 00000100:00100000:0.0:1789304893.717143:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1789304893.717151:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785724288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304893.717273:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304893.717281:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785724032:0@lo:400:kworker.0 00000100:00100000:3.0:1789304893.717362:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785723776 00000100:00100000:3.0:1789304893.717367:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785723776 00000100:00100000:3.0:1789304893.717396:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785724160 00000100:00100000:3.0:1789304893.717399:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785724160 00000100:00100000:3.0:1789304893.717420:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00000100:00100000:3.0:1789304893.717427:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785723776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304893.722183:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785724288:12345-0@lo:400:kworker.0 Request processed in 5021us (5827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304893.722200:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1789304893.722238:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1789304893.722252:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785723904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304893.722308:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785723904:12345-0@lo:400:kworker.0 Request processed in 62us (5795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304893.722315:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00080000:0.0:1789304893.722345:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304893.722350:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304893.722396:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785724288:0@lo:400:kworker.0 00000100:00100000:0.0:1789304893.722979:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785723648 00000100:00100000:0.0:1789304893.722988:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785723648 00000100:00100000:0.0:1789304893.723028:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1789304893.723035:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785723648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304893.723080:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785723648:12345-0@lo:400:kworker.0 Request processed in 46us (6671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304893.723085:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1789304893.723148:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785723648:0@lo:400:kworker.0 00000100:00100000:0.0:1789304893.723545:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00000100:00100000:0.0:1789304893.723556:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785724160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304893.723601:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785724160:12345-0@lo:400:kworker.0 Request processed in 47us (7142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304893.723607:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00100000:0.0:1789304893.723833:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ecf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785724160:0@lo:400:kworker.0 00000100:00100000:1.0:1789304893.723956:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304893.724006:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785723904:0@lo:400:kworker.0 00000100:00100000:1.0:1789304893.724030:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785724032 00000100:00100000:1.0:1789304893.724035:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785724032 00000100:00100000:1.0:1789304893.724072:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:1.0:1789304893.724079:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785724032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304893.724137:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785724032:12345-0@lo:400:kworker.0 Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304893.724143:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00080000:1.0:1789304893.724157:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304893.724174:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785724032:0@lo:400:kworker.0 00000100:00100000:3.0:1789304893.724407:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785723776:12345-0@lo:400:kworker.0 Request processed in 6980us (8156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304893.724416:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00000100:00100000:0.0:1789304893.724818:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785723776:0@lo:400:kworker.0 00010000:00010000:0.0:1789304893.779473:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304893.908744:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304893.909039:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765649280 00000100:00100000:1.0:1789304893.909051:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765649280 00000100:00100000:1.0:1789304893.909188:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1092 00000100:00100000:1.0:1789304893.909201:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765649280:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304893.909304:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765649280:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 106us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304893.909312:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1092 00000100:00080000:0.0:1789304893.909565:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304893.913911:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304893.914126:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765649408 00000100:00100000:2.0:1789304893.914137:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765649408 00000100:00100000:2.0:1789304893.914211:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 593 00000100:00100000:2.0:1789304893.914221:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765649408:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304893.914633:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765649408:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 412us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304893.914642:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 593 00000100:00080000:0.0:1789304893.914708:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304893.922566:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304893.922677:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765649536 00000100:00100000:0.0:1789304893.922688:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765649536 00000100:00100000:0.0:1789304893.922748:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 594 00000100:00100000:0.0:1789304893.922832:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876219765649536:12345-192.168.202.29@tcp:8:lfs.60003 00010000:00080000:0.0:1789304893.922880:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 2343 last 0 00000020:00000080:0.0:1789304893.922925:0:17212:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231297611 00002000:00100000:0.0:1789304893.922938:0:17212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c3f699800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789304893.922979:0:17212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789304893.924367:0:17212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789304893.924409:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2b011e2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789304893.924489:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765649536:12345-192.168.202.29@tcp:8:lfs.60003 Request processed in 1659us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304893.924499:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 594 00000100:00100000:1.0:1789304893.937699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304893.937972:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765649664 00000100:00100000:2.0:1789304893.937986:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765649664 00000100:00100000:2.0:1789304893.938596:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 595 00000100:00100000:2.0:1789304893.938607:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:55716:x1876219765649664:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:0.0:1789304893.939107:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304893.939735:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:55716:x1876219765649664:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1124us (2039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304893.939746:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 595 00000100:00100000:0.0:1789304893.942509:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304893.942617:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765649792 00000100:00100000:3.0:1789304893.942629:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765649792 00000100:00100000:3.0:1789304893.942728:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1093 00000100:00100000:3.0:1789304893.942739:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765649792:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304893.943515:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765649792:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 774us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304893.943524:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1093 00000100:00100000:3.0:1789304893.950693:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304893.952397:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765649920 00000100:00100000:0.0:1789304893.952412:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765649920 00000100:00100000:0.0:1789304893.952525:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1094 00000100:00100000:0.0:1789304893.952545:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765649920:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304893.952654:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765649920:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 120us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304893.952661:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1094 00000100:00100000:1.0:1789304893.956704:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304893.956799:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765650048 00000100:00100000:0.0:1789304893.956811:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765650048 00000100:00100000:0.0:1789304893.956937:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 596 00000100:00100000:0.0:1789304893.956948:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765650048:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304893.957598:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765650048:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 650us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304893.957607:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 596 00000100:00100000:2.0:1789304893.960259:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304893.961375:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765650176 00000100:00100000:1.0:1789304893.961390:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765650176 00000100:00100000:1.0:1789304893.961460:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 597 00000100:00100000:1.0:1789304893.961470:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55716:x1876219765650176:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304893.961854:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55716:x1876219765650176:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 384us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304893.961863:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 597 00000100:00100000:1.0:1789304893.964402:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304893.964497:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765650304 00000100:00100000:2.0:1789304893.964506:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765650304 00000100:00100000:2.0:1789304893.964599:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1095 00000100:00100000:2.0:1789304893.964609:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765650304:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304893.965324:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:55716:x1876219765650304:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 714us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304893.965334:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1095 00000100:00100000:1.0:1789304894.034490:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304894.035215:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765650432 00000100:00100000:3.0:1789304894.035227:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765650432 00000100:00100000:3.0:1789304894.035334:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1096 00000100:00100000:3.0:1789304894.035345:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:55720:x1876219765650432:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:3.0:1789304894.035365:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304894.035389:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007f5 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.035461:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129761f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.035476:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129761f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.035490:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129761f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.035503:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297626 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.035509:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.035515:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036041:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129762d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036052:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129762d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036059:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129762d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304894.036082:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789304894.036086:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304894.036135:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129762d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036148:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129761f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036154:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129761f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036161:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129761f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036167:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304894.036171:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129761f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036179:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129761f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036190:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304894.036194:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304894.036198:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129761f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036204:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb723129761f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036217:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036223:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297626 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036228:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036233:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304894.036237:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036243:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297626 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036251:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304894.036253:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304894.036256:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297626 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036262:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297626 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036292:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007f5 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036314:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129762d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007f5 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.036322:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:3.0:1789304894.036324:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304894.036326:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304894.036403:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:55720:x1876219765650432:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1060us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304894.036411:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1096 00000100:00100000:2.0:1789304894.039520:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304894.039684:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765650688 00000100:00100000:0.0:1789304894.039755:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765650688 00000100:00100000:0.0:1789304894.039835:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1097 00000100:00100000:0.0:1789304894.039846:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55720:x1876219765650688:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304894.039878:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304894.039900:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297634 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861007fc expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.040236:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129763b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.040253:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129763b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.040265:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129763b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.040281:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.040289:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.040294:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789304894.041424:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789304894.043132:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043152:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043163:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043217:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129763b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043225:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129763b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043231:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129763b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043237:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304894.043241:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129763b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043249:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129763b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043265:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:0.0:1789304894.043268:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304894.043272:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129763b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043278:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb723129763b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304894.043293:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f88b05e reply state 000000002f08ba44 transno 4294967716 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304894.043303:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789304894.043341:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297634 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007fc expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043356:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007fc expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304894.043363:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:0.0:1789304894.043365:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304894.043368:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa400, rc 0) 00000100:00100000:0.0:1789304894.045010:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:55720:x1876219765650688:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 5156us (5489us total) trans 4294967716 rc 0/0 00000100:00100000:0.0:1789304894.045023:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1097 00010000:00010000:3.0:1789304894.048557:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.048575:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.048582:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.048588:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304894.048593:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.048600:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.048616:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c0558de00) 00010000:00010000:3.0:1789304894.048619:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304894.048624:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304894.048630:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297642 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304894.054161:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304894.054362:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765650816 00000100:00100000:1.0:1789304894.054373:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765650816 00000100:00100000:1.0:1789304894.054438:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 598 00000100:00100000:1.0:1789304894.054449:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55720:x1876219765650816:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:1.0:1789304894.054468:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304894.054488:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eda49b96/0xefc0bb7231297657 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100803 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789304894.054510:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789304894.054528:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=2343s v=(0 0) 00010000:00010000:1.0:1789304894.054532:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789304894.054538:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eda49b96/0xefc0bb7231297657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100803 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304894.054551:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eda49b96/0xefc0bb7231297657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100803 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304894.054560:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370e00, rc 0) 00000100:00100000:1.0:1789304894.054608:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:55720:x1876219765650816:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 162us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304894.054614:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 598 00000100:00100000:0.0:1789304894.074746:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304894.074858:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765650944 00000100:00100000:1.0:1789304894.074876:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765650944 00002000:00100000:1.0:1789304894.074932:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->1048575) req@ffff9e2c06237800 x1876219765650944/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:205/0 lens 488/0 e 0 to 0 dl 1789304905 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304894.074944:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c06237800 with x1876219765650944 ext(0->1048575) 00002000:00010000:1.0:1789304894.074950:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c06237800 00000100:00100000:1.0:1789304894.074986:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 27 00000100:00100000:1.0:1789304894.074997:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765650944:12345-192.168.202.29@tcp:4:dd.60003 00000001:00100000:0.0:1789304894.141273:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00080000:3.0:1789304894.189472:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967364 is committed 00000100:00100000:1.0:1789304894.189661:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765650944:12345-192.168.202.29@tcp:4:dd.60003 Request processed in 114660us (114919us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789304894.189674:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 27 00002000:00100000:1.0:1789304894.189688:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->1048575) req@ffff9e2c06237800 x1876219765650944/t4294967364(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:205/0 lens 488/448 e 0 to 0 dl 1789304905 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789304894.189698:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c06237800 with x1876219765650944 ext(0->1048575) 00002000:00010000:1.0:1789304894.189704:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c06237800 00000100:00100000:0.0:1789304894.192817:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304894.193185:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765651072 00000100:00100000:2.0:1789304894.193196:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765651072 00000100:00100000:2.0:1789304894.193370:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1098 00000100:00100000:2.0:1789304894.193380:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:55720:x1876219765651072:12345-192.168.202.29@tcp:44:dd.60003 00000001:00080000:1.0:1789304894.226391:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967716 is committed 00000100:00100000:2.0:1789304894.226587:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:55720:x1876219765651072:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 33202us (33778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304894.226599:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1098 00000100:00100000:2.0:1789304894.228876:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304894.229174:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765651200 00000100:00100000:0.0:1789304894.229184:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765651200 00000100:00100000:0.0:1789304894.229239:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 599 00000100:00100000:0.0:1789304894.229249:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765651200:12345-192.168.202.29@tcp:16:dd.60003 00000100:00100000:0.0:1789304894.229452:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765651200:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 203us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304894.229460:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 599 00000100:00100000:0.0:1789304894.232847:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304894.233414:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765651456 00000100:00100000:3.0:1789304894.233427:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765651456 00000100:00100000:2.0:1789304894.233661:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 111 00000100:00100000:2.0:1789304894.233675:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:55720:x1876219765651456:12345-192.168.202.29@tcp:35:dd.60003 00000100:00100000:2.0:1789304894.234292:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:55720:x1876219765651456:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 620us (1455us total) trans 4294967717 rc 0/0 00000100:00100000:2.0:1789304894.234299:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 111 00010000:00010000:3.0:1789304894.802450:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304895.623614:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967717 is committed 00010000:00010000:3.0:1789304895.827265:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304896.286517:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785724416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304896.286637:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304896.286685:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785724416 00000100:00100000:2.0:1789304896.286694:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785724416 00000100:00100000:2.0:1789304896.286900:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1789304896.286911:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785724416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304896.286950:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00080000:0.0:1789304896.287057:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304896.289519:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785724416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2601us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304896.289525:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785724416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304896.289534:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1789304896.359832:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304896.359888:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304896.359915:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304896.360023:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765651712 00000100:00100000:2.0:1789304896.360034:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765651712 00000100:00100000:2.0:1789304896.360123:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1680 00000100:00100000:2.0:1789304896.360134:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765651712:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304896.360211:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765651712:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 78us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304896.360218:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1680 00000100:00100000:2.0:1789304896.360239:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765651840 00000100:00100000:2.0:1789304896.360243:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765651840 00000100:00100000:2.0:1789304896.360275:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1289 00000100:00100000:2.0:1789304896.360282:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765651840:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304896.360307:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765651840:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304896.360314:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1289 00000100:00080000:0.0:1789304896.360467:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304896.360473:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304896.360559:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765651584 00000100:00100000:1.0:1789304896.360564:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765651584 00000100:00100000:1.0:1789304896.360612:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1321 00000100:00100000:1.0:1789304896.360620:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765651584:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304896.360719:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765651584:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 99us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304896.360726:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1321 00000100:00100000:2.0:1789304896.364594:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304896.366206:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765651968 00000100:00100000:1.0:1789304896.366219:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765651968 00000100:00100000:1.0:1789304896.366287:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1290 00000100:00100000:1.0:1789304896.366297:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765651968:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304896.366375:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765651968:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304896.366385:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1290 00000100:00080000:1.0:1789304896.366407:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789304896.649603:0:95648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2346327509560ns, next at 2325718646637ns, rc = 0 00000004:00080000:0.0:1789304896.649873:0:95648:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2346327781222ns, next at 2300874268904ns, rc = 0 00000004:00080000:1.0:1789304896.657190:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 97 committed 00000004:00080000:1.0:1789304896.657223:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 90 committed 00010000:00010000:0.0:1789304896.850370:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304897.298875:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785724544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304897.299024:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304897.299134:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785724544 00000100:00100000:2.0:1789304897.299143:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785724544 00000100:00100000:2.0:1789304897.299211:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1789304897.299219:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785724544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304897.299265:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789304897.299386:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304897.308477:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785724544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9249us (9443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304897.308491:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:1.0:1789304897.316233:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785724544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304897.875821:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304898.286150:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304898.286758:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765652096 00000100:00100000:3.0:1789304898.286993:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765652096 00000100:00100000:3.0:1789304898.287083:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1099 00000100:00100000:3.0:1789304898.287114:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:55913:x1876219765652096:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304898.287222:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:55913:x1876219765652096:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 110us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304898.287229:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1099 00000100:00080000:2.0:1789304898.287622:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304898.291372:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304898.292128:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765652224 00000100:00100000:2.0:1789304898.292140:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765652224 00000100:00080000:3.0:1789304898.292184:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304898.292202:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 600 00000100:00100000:2.0:1789304898.292213:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:55913:x1876219765652224:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304898.292571:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:55913:x1876219765652224:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 359us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304898.292580:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 600 00000100:00100000:2.0:1789304898.300534:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304898.300797:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765652352 00000100:00100000:0.0:1789304898.300808:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765652352 00000100:00100000:0.0:1789304898.300880:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 601 00000100:00100000:0.0:1789304898.300891:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:55913:x1876219765652352:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304898.301223:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:55913:x1876219765652352:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 335us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304898.301228:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 601 00000100:00080000:3.0:1789304898.302405:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304898.310542:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304898.314193:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765652480 00000100:00100000:2.0:1789304898.314210:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765652480 00000100:00100000:2.0:1789304898.314308:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1100 00000100:00100000:2.0:1789304898.314318:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:55913:x1876219765652480:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304898.314777:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:55913:x1876219765652480:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 459us (4240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304898.314786:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1100 00000100:00100000:3.0:1789304898.320162:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304898.320197:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765652608 00000100:00100000:2.0:1789304898.320208:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765652608 00000100:00100000:2.0:1789304898.321485:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1101 00000100:00100000:2.0:1789304898.321500:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:55913:x1876219765652608:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304898.321685:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:55913:x1876219765652608:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 188us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304898.321693:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1101 00000100:00100000:1.0:1789304898.327764:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304898.327952:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765652736 00000100:00100000:2.0:1789304898.327964:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765652736 00000100:00100000:2.0:1789304898.328049:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 602 00000100:00100000:2.0:1789304898.328058:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:55913:x1876219765652736:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304898.328477:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:55913:x1876219765652736:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 418us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304898.328486:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 602 00000100:00100000:0.0:1789304898.331153:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304898.335968:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765652864 00000100:00100000:1.0:1789304898.335981:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765652864 00000100:00100000:1.0:1789304898.336084:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 603 00000100:00100000:1.0:1789304898.336111:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55913:x1876219765652864:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789304898.336662:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:55913:x1876219765652864:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 568us (5517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304898.336670:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 603 00000100:00100000:3.0:1789304898.346016:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304898.346178:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765652992 00000100:00100000:1.0:1789304898.346189:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765652992 00000100:00100000:1.0:1789304898.346239:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1102 00000100:00100000:1.0:1789304898.346250:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:55913:x1876219765652992:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304898.346802:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:55913:x1876219765652992:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 552us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304898.346811:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1102 00000100:00100000:2.0:1789304898.402178:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304898.402334:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765653248 00000100:00100000:1.0:1789304898.402345:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765653248 00000100:00100000:1.0:1789304898.402395:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1103 00000100:00100000:1.0:1789304898.402406:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:55917:x1876219765653248:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:1.0:1789304898.402461:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304898.402541:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007fc expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304898.402561:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:1.0:1789304898.402573:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304898.402608:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb723129765e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304898.402624:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb723129765e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304898.402633:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb723129765e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304898.402648:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304898.402655:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304898.402662:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304898.403218:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129766c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304898.403228:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129766c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304898.403235:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129766c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789304898.405377:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].34, 64 off10368 00000004:00080000:0.0:1789304898.405393:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2348083301781ns, next at 2349083297925ns, rc = 0 00010000:00010000:0.0:1789304898.405506:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405525:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405538:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405547:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405553:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405559:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405635:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789304898.405666:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129766c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405672:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129766c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405679:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129766c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405684:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304898.405689:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129766c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405697:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129766c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405709:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:0.0:1789304898.405712:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789304898.405717:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129766c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405723:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129766c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405745:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb723129765e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405751:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb723129765e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405756:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb723129765e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405761:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370c00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304898.405763:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb723129765e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405850:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb723129765e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405859:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:0.0:1789304898.405862:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304898.405866:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb723129765e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304898.405998:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370c00/0xefc0bb723129765e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304898.406017:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b86fdb06 reply state 00000000e59b0a90 transno 4294967718 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304898.406026:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304898.411295:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:55917:x1876219765653248:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 3749us (3996us total) trans 4294967718 rc 0/0 00000100:00100000:0.0:1789304898.411311:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1103 00010000:00010000:3.0:1789304898.412382:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304898.412393:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304898.412404:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304898.412408:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304898.412419:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304898.412437:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9e2c14add000) 00010000:00010000:3.0:1789304898.412440:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304898.412446:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304898.412453:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297673 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304898.412474:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304898.412476:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304898.412478:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304898.415519:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304898.415539:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304898.415547:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304898.415554:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304898.415560:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304898.415568:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304898.415583:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff9e2c14add100) 00010000:00010000:2.0:1789304898.415587:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304898.415591:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304898.415598:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297665 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304898.837442:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785724672:0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.837537:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304898.837589:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785725184:0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.837616:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304898.837678:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785724672 00000100:00100000:0.0:1789304898.837687:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785724672 00000100:00100000:0.0:1789304898.837732:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1789304898.837741:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785724672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.837791:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785724672:12345-0@lo:400:kworker.0 Request processed in 51us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304898.837798:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1789304898.837842:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785725184 00000100:00100000:0.0:1789304898.837846:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785725184 00000100:00100000:0.0:1789304898.837886:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1789304898.837892:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785725184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.837922:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785725184:12345-0@lo:400:kworker.0 Request processed in 31us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304898.837928:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1789304898.837968:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785724672:0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.837980:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785725184:0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.838019:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785724928:0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.838045:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304898.838064:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304898.838071:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785725056:0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.838122:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304898.838148:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785724928 00000100:00100000:0.0:1789304898.838152:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785724928 00000100:00100000:0.0:1789304898.838177:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1789304898.838182:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785724928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.838231:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785724928:12345-0@lo:400:kworker.0 Request processed in 48us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304898.838236:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1789304898.838266:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785724928:0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.838307:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785725056 00000100:00100000:0.0:1789304898.838310:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785725056 00000100:00100000:0.0:1789304898.838330:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1789304898.838348:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785725056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.838380:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785725056:12345-0@lo:400:kworker.0 Request processed in 33us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304898.838386:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1789304898.838411:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785725056:0@lo:400:kworker.0 00000100:00100000:1.0:1789304898.838584:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785724800:0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.839013:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304898.839045:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785725312:0@lo:400:kworker.0 00000100:00100000:0.0:1789304898.839066:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304898.839208:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785725312 00000100:00100000:1.0:1789304898.839213:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785725312 00000100:00100000:1.0:1789304898.839250:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1789304898.839258:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785725312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304898.839301:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785725312:12345-0@lo:400:kworker.0 Request processed in 44us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304898.839307:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1789304898.839350:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785725312:0@lo:400:kworker.0 00000100:00100000:2.0:1789304898.839527:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785724800 00000100:00100000:2.0:1789304898.839532:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785724800 00000100:00100000:2.0:1789304898.839569:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:2.0:1789304898.839576:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785724800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304898.839612:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785724800:12345-0@lo:400:kworker.0 Request processed in 37us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304898.839618:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00000100:00100000:1.0:1789304898.839764:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785724800:0@lo:400:kworker.0 00000100:00080000:2.0:1789304898.840147:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304898.840152:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304898.898242:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304899.922297:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304900.843137:0:95793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2350521043759ns, next at 2325718646637ns, rc = 0 00000004:00080000:1.0:1789304900.843324:0:95793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2350521232773ns, next at 2349083297925ns, rc = 0 00000004:00080000:0.0:1789304900.900837:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 99 committed 00000004:00080000:0.0:1789304900.900887:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 91 committed 00000001:00080000:0.0:1789304900.900913:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967718 is committed 00000004:00080000:0.0:1789304900.900933:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 98 committed 00000100:00100000:1.0:1789304900.903848:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304900.903883:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785725440:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789304900.903964:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304900.904074:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785725440 00000100:00100000:3.0:1789304900.904083:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785725440 00000100:00100000:3.0:1789304900.904166:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1789304900.904175:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785725440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789304900.904202:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00000100:00080000:1.0:1789304900.904211:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789304900.904230:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304900.904254:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eda49b96/0xefc0bb7231297657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100803 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304900.904262:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1789304900.904266:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304900.904270:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304900.904300:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eda49b96/0xefc0bb7231297657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100803 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304900.904314:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eda49b96/0xefc0bb7231297657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100803 expref: 5 pid: 17212 timeout: 2450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304900.904325:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785725568:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304900.904393:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd7240 going to sleep for 11 seconds 00000100:00100000:1.0:1789304900.906664:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304900.906739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765653376 00000100:00100000:0.0:1789304900.906748:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765653376 00010000:00010000:0.0:1789304900.906811:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eda49b96/0xefc0bb7231297657 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100803 expref: 6 pid: 17212 timeout: 2450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304900.906991:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785725568:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304900.907015:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304900.907365:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 435 00000100:00100000:0.0:1789304900.907377:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765653376:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789304900.907397:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304900.907404:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eda49b96/0xefc0bb7231297657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100803 expref: 6 pid: 17212 timeout: 2450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304900.907419:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eda49b96/0xefc0bb7231297657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100803 expref: 6 pid: 17212 timeout: 2450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304900.907448:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eda49b96/0xefc0bb7231297657 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100803 expref: 6 pid: 17212 timeout: 2450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304900.907468:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304900.907472:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789304900.907479:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304900.907493:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304900.907518:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304900.907570:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765653376:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 196us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304900.907577:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 435 00010000:00010000:3.0:1789304900.907629:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789304900.908406:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789304900.909112:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304900.909126:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304900.909133:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304900.909165:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304900.911028:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304900.911044:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304900.911057:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304900.911062:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304900.911074:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304900.911123:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304900.911131:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f6ac720/0xefc0bb723129767a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304900.911171:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304900.911173:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304900.911175:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304900.911376:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785725440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7198us (7408us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789304900.911386:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000004:00080000:1.0:1789304900.911408:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b011f6a00/2, rc 0, transno 4294967365 00000100:00100000:1.0:1789304900.911421:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785725440:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789304900.946180:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304901.398735:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304901.398758:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785725696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304901.398838:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304901.398907:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785725696 00000100:00100000:3.0:1789304901.398917:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785725696 00000100:00100000:3.0:1789304901.398966:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1789304901.398975:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785725696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304901.399015:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789304901.399069:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785725696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304901.399076:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1789304901.399156:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785725696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304901.479807:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304901.479859:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304901.479884:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304901.479902:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304901.479925:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765653888 00000100:00100000:1.0:1789304901.479934:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765653888 00000100:00100000:1.0:1789304901.479979:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765653760 00000100:00100000:1.0:1789304901.479982:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765653760 00000100:00100000:1.0:1789304901.480016:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1293 00000100:00100000:1.0:1789304901.480025:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765653888:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304901.480128:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765653888:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304901.480137:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1293 00000100:00100000:1.0:1789304901.480157:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1294 00000100:00100000:1.0:1789304901.480165:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765653760:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304901.480194:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765653760:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304901.480201:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1294 00000100:00100000:1.0:1789304901.480219:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765653504 00000100:00100000:1.0:1789304901.480223:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765653504 00000100:00100000:1.0:1789304901.480246:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1323 00000100:00100000:1.0:1789304901.480251:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765653504:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304901.480273:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765653504:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304901.480279:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1323 00000100:00080000:1.0:1789304901.480308:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304901.480758:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765653632 00000100:00100000:3.0:1789304901.480764:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765653632 00000100:00100000:3.0:1789304901.480828:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1684 00000100:00100000:3.0:1789304901.480837:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765653632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304901.480894:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765653632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 59us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304901.480901:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1684 00000100:00080000:1.0:1789304901.481188:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789304901.970381:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304902.418486:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304902.418510:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785725824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304902.418581:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304902.418722:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785725824 00000100:00100000:2.0:1789304902.418730:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785725824 00000100:00100000:2.0:1789304902.418822:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1789304902.418843:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785725824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304902.418879:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304902.418934:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785725824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304902.418941:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1789304902.418991:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785725824:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304902.419162:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304902.995630:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304903.502807:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967365 is committed 00000100:00100000:1.0:1789304903.955365:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785726336:0@lo:400:kworker.0 00000100:00100000:1.0:1789304903.955438:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304903.955503:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789304903.955510:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785725952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304903.955539:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304903.955562:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785726464:0@lo:400:kworker.0 00000100:00100000:1.0:1789304903.955583:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304903.955614:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785726336 00000100:00100000:1.0:1789304903.955621:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785726336 00000100:00100000:1.0:1789304903.955671:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785726464 00000100:00100000:1.0:1789304903.955675:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785726464 00000100:00100000:1.0:1789304903.955696:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:1.0:1789304903.955705:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785726336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304903.955754:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785726336:12345-0@lo:400:kworker.0 Request processed in 50us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304903.955762:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:1.0:1789304903.955789:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:1.0:1789304903.955796:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785726464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304903.955943:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785726080:0@lo:400:kworker.0 00000100:00100000:3.0:1789304903.955974:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304903.956000:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785726592:0@lo:400:kworker.0 00000100:00100000:3.0:1789304903.956020:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304903.956040:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789304903.956045:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785726208:0@lo:400:kworker.0 00000100:00100000:3.0:1789304903.956066:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304903.956114:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785726080 00000100:00100000:3.0:1789304903.956119:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785726080 00000100:00100000:3.0:1789304903.956141:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:3.0:1789304903.956148:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785726080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304903.956185:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785726080:12345-0@lo:400:kworker.0 Request processed in 37us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304903.956192:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00100000:3.0:1789304903.956214:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785726592 00000100:00100000:3.0:1789304903.956218:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785726592 00000100:00100000:3.0:1789304903.956242:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785726208 00000100:00100000:3.0:1789304903.956245:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785726208 00000100:00100000:3.0:1789304903.956263:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1789304903.956268:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785726592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304903.956298:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785726592:12345-0@lo:400:kworker.0 Request processed in 30us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304903.956304:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1789304903.956315:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1789304903.956322:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785726208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304903.956350:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785726208:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304903.956356:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1789304903.956403:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785726208:0@lo:400:kworker.0 00000100:00100000:3.0:1789304903.956414:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785726080:0@lo:400:kworker.0 00000100:00100000:3.0:1789304903.956422:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:3.0:1789304903.956426:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b011f6a00, transno 4294967365 00000100:00100000:3.0:1789304903.956436:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785726592:0@lo:400:kworker.0 00000100:00100000:1.0:1789304903.956843:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785726464:12345-0@lo:400:kworker.0 Request processed in 31us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304903.956853:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00100000:1.0:1789304903.956878:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785725952 00000100:00100000:1.0:1789304903.956883:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785725952 00000100:00100000:1.0:1789304903.956921:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1789304903.956928:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785725952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304903.956967:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785725952:12345-0@lo:400:kworker.0 Request processed in 39us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304903.956973:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00080000:1.0:1789304903.957001:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304903.957006:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304903.957027:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785725952:0@lo:400:kworker.0 00000100:00100000:1.0:1789304903.957038:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785726464:0@lo:400:kworker.0 00000100:00100000:1.0:1789304903.957048:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785726336:0@lo:400:kworker.0 00010000:00010000:0.0:1789304904.018218:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304905.047145:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304906.067705:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304906.514412:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785726720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304906.514487:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304906.514661:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785726720 00000100:00100000:3.0:1789304906.514670:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785726720 00000100:00100000:3.0:1789304906.514733:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1789304906.514742:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785726720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304906.514785:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304906.514844:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785726720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304906.514850:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00080000:1.0:1789304906.514912:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304906.515050:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785726720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304906.594648:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304906.594703:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304906.594737:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304906.594818:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765654272 00000100:00100000:3.0:1789304906.594829:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765654272 00000100:00100000:0.0:1789304906.594886:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765654016 00000100:00100000:0.0:1789304906.594892:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765654016 00000100:00100000:3.0:1789304906.594917:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1297 00000100:00100000:3.0:1789304906.594931:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765654272:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304906.594937:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1325 00000100:00100000:0.0:1789304906.594964:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765654016:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:2.0:1789304906.595044:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304906.595266:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765654272:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 338us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304906.595274:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1297 00000100:00100000:3.0:1789304906.599056:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765654144 00000100:00100000:3.0:1789304906.599073:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765654144 00000100:00100000:3.0:1789304906.599172:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1688 00000100:00100000:3.0:1789304906.599183:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765654144:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304906.603664:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765654016:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 8703us (9015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304906.603679:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1325 00000100:00080000:0.0:1789304906.603772:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304906.613182:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304906.614277:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765654144:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 15086us (19529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304906.614291:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1688 00000100:00100000:2.0:1789304906.622167:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765654400 00000100:00100000:2.0:1789304906.622187:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765654400 00000100:00100000:0.0:1789304906.629907:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1298 00000100:00100000:0.0:1789304906.629922:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765654400:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304906.630060:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765654400:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 141us (16889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304906.630068:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1298 00000100:00080000:2.0:1789304906.630161:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789304907.090297:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304907.540497:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789304907.540523:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785726848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304907.540604:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304907.540784:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785726848 00000100:00100000:3.0:1789304907.540793:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785726848 00000100:00100000:3.0:1789304907.540863:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:3.0:1789304907.540873:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785726848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304907.540907:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304907.540961:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785726848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304907.540968:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00080000:2.0:1789304907.541029:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304907.541077:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785726848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304908.114793:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304909.074475:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785727232:0@lo:400:kworker.0 00000100:00100000:2.0:1789304909.074553:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304909.074612:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789304909.074618:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785727104:0@lo:400:kworker.0 00000100:00100000:2.0:1789304909.074642:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304909.074657:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785727616:0@lo:400:kworker.0 00000100:00100000:2.0:1789304909.074675:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304909.074702:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785727232 00000100:00100000:2.0:1789304909.074710:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785727232 00000100:00100000:2.0:1789304909.074918:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785727616 00000100:00100000:2.0:1789304909.074996:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785727616 00000100:00100000:2.0:1789304909.075029:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:2.0:1789304909.075037:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785727232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304909.075117:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785727232:12345-0@lo:400:kworker.0 Request processed in 81us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304909.075124:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:2.0:1789304909.075141:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:2.0:1789304909.075147:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785727616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304909.075174:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785727616:12345-0@lo:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304909.075180:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00080000:2.0:1789304909.075196:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789304909.075200:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304909.075230:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785727616:0@lo:400:kworker.0 00000100:00100000:2.0:1789304909.075240:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785727232:0@lo:400:kworker.0 00000100:00100000:1.0:1789304909.075327:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785727104 00000100:00100000:1.0:1789304909.075332:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785727104 00000100:00100000:1.0:1789304909.075370:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:1.0:1789304909.075377:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785727104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304909.075419:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785727104:12345-0@lo:400:kworker.0 Request processed in 42us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304909.075425:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:1.0:1789304909.075448:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785727360:0@lo:400:kworker.0 00000100:00100000:1.0:1789304909.075478:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304909.075516:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789304909.075522:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785726976:0@lo:400:kworker.0 00000100:00100000:1.0:1789304909.075550:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304909.075571:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785727488:0@lo:400:kworker.0 00000100:00100000:1.0:1789304909.075589:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304909.075615:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785727360 00000100:00100000:1.0:1789304909.075618:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785727360 00000100:00100000:1.0:1789304909.075641:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785727488 00000100:00100000:1.0:1789304909.075644:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785727488 00000100:00100000:1.0:1789304909.075662:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:1.0:1789304909.075668:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785727360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304909.075698:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785727360:12345-0@lo:400:kworker.0 Request processed in 31us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304909.075704:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00100000:1.0:1789304909.075716:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:1.0:1789304909.075721:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785727488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304909.075762:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785727488:12345-0@lo:400:kworker.0 Request processed in 41us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304909.075767:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00100000:1.0:1789304909.076061:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785727488:0@lo:400:kworker.0 00000100:00100000:1.0:1789304909.076070:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785727360:0@lo:400:kworker.0 00000100:00100000:1.0:1789304909.076124:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785727104:0@lo:400:kworker.0 00000100:00080000:2.0:1789304909.076279:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304909.076320:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785726976 00000100:00100000:2.0:1789304909.076325:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785726976 00000100:00100000:2.0:1789304909.076414:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:2.0:1789304909.076423:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785726976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304909.076476:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785726976:12345-0@lo:400:kworker.0 Request processed in 54us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304909.076489:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1789304909.076648:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785726976:0@lo:400:kworker.0 00010000:00010000:1.0:1789304909.138318:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304910.163062:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304911.186363:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304911.635050:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304911.635076:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785727744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304911.635185:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304911.635404:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785727744 00000100:00100000:3.0:1789304911.635413:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785727744 00000100:00100000:3.0:1789304911.635486:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:3.0:1789304911.635496:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785727744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304911.635533:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304911.635583:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785727744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304911.635590:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00080000:0.0:1789304911.635735:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304911.635773:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785727744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304911.714888:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304911.715119:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765654528 00000100:00100000:0.0:1789304911.715130:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765654528 00000100:00100000:0.0:1789304911.715192:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1327 00000100:00100000:0.0:1789304911.715202:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765654528:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304911.715286:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765654528:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 84us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304911.715295:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1327 00000100:00100000:1.0:1789304911.722978:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304911.723034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304911.723078:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304911.723257:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765654912 00000100:00100000:0.0:1789304911.723269:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765654912 00000100:00100000:0.0:1789304911.723343:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765654784 00000100:00100000:0.0:1789304911.723347:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765654784 00000100:00100000:0.0:1789304911.723378:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1301 00000100:00100000:0.0:1789304911.723396:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765654912:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304911.723487:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765654912:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304911.723496:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1301 00000100:00100000:0.0:1789304911.723515:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1302 00000100:00100000:0.0:1789304911.723521:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765654784:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304911.723545:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765654784:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304911.723551:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1302 00000100:00080000:1.0:1789304911.724659:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304911.724668:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304911.725820:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765654656 00000100:00100000:2.0:1789304911.725834:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765654656 00000100:00100000:2.0:1789304911.725945:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1692 00000100:00100000:2.0:1789304911.725956:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765654656:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304911.726042:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765654656:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304911.726050:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1692 00000100:00080000:1.0:1789304911.726173:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304912.214439:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304912.658482:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785727872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304912.658558:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304912.660601:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785727872 00000100:00100000:0.0:1789304912.660617:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785727872 00000100:00100000:0.0:1789304912.660727:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1789304912.660740:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785727872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304912.660782:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789304912.660895:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304912.665705:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785727872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4949us (7127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304912.665722:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1789304912.667756:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785727872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789304913.234323:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304914.194560:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785728384:0@lo:400:kworker.0 00000100:00100000:1.0:1789304914.194623:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304914.194702:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789304914.194708:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785728000:0@lo:400:kworker.0 00000100:00100000:1.0:1789304914.194735:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304914.194754:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785728512:0@lo:400:kworker.0 00000100:00100000:1.0:1789304914.194778:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304914.194804:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785728256:0@lo:400:kworker.0 00000100:00100000:1.0:1789304914.194828:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304914.194847:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789304914.194852:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785728128:0@lo:400:kworker.0 00000100:00100000:1.0:1789304914.194872:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304914.194886:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785728640:0@lo:400:kworker.0 00000100:00100000:1.0:1789304914.194904:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304914.194930:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785728384 00000100:00100000:1.0:1789304914.194938:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785728384 00000100:00100000:1.0:1789304914.194994:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785728512 00000100:00100000:1.0:1789304914.194997:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785728512 00000100:00100000:1.0:1789304914.195013:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785728128 00000100:00100000:1.0:1789304914.195016:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785728128 00000100:00100000:1.0:1789304914.195030:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693 00000100:00100000:1.0:1789304914.195039:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785728384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304914.195071:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785728000 00000100:00100000:2.0:1789304914.195076:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785728000 00000100:00100000:1.0:1789304914.195122:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785728384:12345-0@lo:400:kworker.0 Request processed in 82us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304914.195124:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1789304914.195133:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785728000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304914.195137:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693 00000100:00100000:1.0:1789304914.195162:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694 00000100:00100000:2.0:1789304914.195171:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785728000:12345-0@lo:400:kworker.0 Request processed in 38us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304914.195173:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785728512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304914.195186:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1789304914.195218:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785728512:12345-0@lo:400:kworker.0 Request processed in 49us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304914.195225:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1695 00000100:00100000:2.0:1789304914.195232:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785728128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304914.195260:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785728128:12345-0@lo:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304914.195639:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694 00000100:00100000:1.0:1789304914.195775:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785728000:0@lo:400:kworker.0 00000100:00100000:1.0:1789304914.195790:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785728512:0@lo:400:kworker.0 00000100:00100000:1.0:1789304914.195798:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785728384:0@lo:400:kworker.0 00000100:00080000:1.0:1789304914.195851:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304914.195869:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04017480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785728128:0@lo:400:kworker.0 00000100:00100000:0.0:1789304914.196548:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785728256 00000100:00100000:0.0:1789304914.196556:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785728256 00000100:00100000:0.0:1789304914.196593:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785728640 00000100:00100000:0.0:1789304914.196596:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785728640 00000100:00100000:0.0:1789304914.196615:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1789304914.196622:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785728256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304914.196693:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785728256:12345-0@lo:400:kworker.0 Request processed in 71us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304914.196700:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1789304914.196715:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:0.0:1789304914.196721:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785728640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304914.196747:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785728640:12345-0@lo:400:kworker.0 Request processed in 27us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304914.196753:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00080000:0.0:1789304914.196790:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304914.196793:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304914.196817:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785728640:0@lo:400:kworker.0 00000100:00100000:0.0:1789304914.196828:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785728256:0@lo:400:kworker.0 00000100:00100000:2.0:1789304914.198204:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1695 00010000:00010000:3.0:1789304914.258470:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304914.385278:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304914.386835:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765655040 00000100:00100000:3.0:1789304914.386849:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765655040 00000100:00100000:3.0:1789304914.386929:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1104 00000100:00100000:3.0:1789304914.386939:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:56094:x1876219765655040:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304914.387038:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:56094:x1876219765655040:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 100us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304914.387046:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1104 00000100:00080000:1.0:1789304914.387125:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304914.394402:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304914.394438:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765655168 00000100:00100000:1.0:1789304914.394447:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765655168 00000100:00100000:1.0:1789304914.394512:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 605 00000100:00100000:1.0:1789304914.394523:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:56094:x1876219765655168:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:2.0:1789304914.394528:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304914.395200:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:56094:x1876219765655168:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 678us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304914.395210:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 605 00000100:00100000:2.0:1789304914.410747:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304914.410979:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765655296 00000100:00100000:0.0:1789304914.410990:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765655296 00000100:00100000:0.0:1789304914.411054:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 606 00000100:00100000:0.0:1789304914.411066:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:56094:x1876219765655296:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304914.411415:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:56094:x1876219765655296:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 352us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304914.411423:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 606 00000100:00080000:2.0:1789304914.411684:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304914.429048:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304914.432286:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765655424 00000100:00100000:1.0:1789304914.432303:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765655424 00000100:00100000:1.0:1789304914.432378:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1105 00000100:00100000:1.0:1789304914.432391:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:56094:x1876219765655424:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304914.432885:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:56094:x1876219765655424:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 496us (3845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304914.432893:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1105 00000100:00100000:1.0:1789304914.456505:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304914.460962:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765655552 00000100:00100000:2.0:1789304914.460982:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765655552 00000100:00100000:2.0:1789304914.461074:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1106 00000100:00100000:2.0:1789304914.461086:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:56094:x1876219765655552:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304914.461218:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:56094:x1876219765655552:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 135us (4725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304914.461226:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1106 00000100:00100000:2.0:1789304914.465979:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304914.466037:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765655680 00000100:00100000:3.0:1789304914.466048:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765655680 00000100:00100000:3.0:1789304914.466423:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 607 00000100:00100000:3.0:1789304914.466438:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:56094:x1876219765655680:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304914.466883:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:56094:x1876219765655680:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 448us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304914.466892:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 607 00000100:00100000:2.0:1789304914.472706:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304914.472862:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765655808 00000100:00100000:3.0:1789304914.472875:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765655808 00000100:00100000:3.0:1789304914.472943:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 608 00000100:00100000:3.0:1789304914.472953:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:56094:x1876219765655808:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304914.474638:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:56094:x1876219765655808:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1679us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304914.474650:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 608 00000100:00100000:3.0:1789304914.478546:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304914.478614:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765655936 00000100:00100000:0.0:1789304914.478626:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765655936 00000100:00100000:0.0:1789304914.478757:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1107 00000100:00100000:0.0:1789304914.478777:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:56094:x1876219765655936:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789304914.479294:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:56094:x1876219765655936:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 519us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304914.479303:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1107 00000100:00100000:2.0:1789304914.537439:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304914.537660:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765656064 00000100:00100000:3.0:1789304914.537681:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765656064 00000100:00100000:3.0:1789304914.538610:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1108 00000100:00100000:3.0:1789304914.538626:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:56095:x1876219765656064:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304914.538649:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304914.538683:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610080a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304914.538767:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297688 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304914.538784:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304914.538799:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304914.538839:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789304914.538843:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304914.538866:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304914.538893:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610080a expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304914.538922:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610080a expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304914.538932:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:3.0:1789304914.538936:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304914.538940:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f800, rc 0) 00000100:00100000:3.0:1789304914.539014:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:56095:x1876219765656064:12345-192.168.202.29@tcp:101:rm.0 Request processed in 392us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304914.539021:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1108 00000100:00100000:3.0:1789304914.552690:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304914.552995:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765656320 00000100:00100000:1.0:1789304914.553011:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765656320 00000100:00100000:1.0:1789304914.553110:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1109 00000100:00100000:1.0:1789304914.553122:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:56095:x1876219765656320:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789304914.553145:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304914.553169:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129768f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100811 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304914.553294:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00010000:1.0:1789304914.553565:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129768f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100811 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304914.553581:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:1.0:1789304914.553584:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789304914.553589:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb723129768f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100811 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304914.553612:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371600, rc 0) 00000100:00100000:1.0:1789304914.553695:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:56095:x1876219765656320:12345-192.168.202.29@tcp:101:rm.0 Request processed in 575us (1025us total) trans 4294967719 rc 301/301 00000100:00100000:1.0:1789304914.553703:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1109 00000100:00100000:2.0:1789304914.559778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304914.567234:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765656448 00000100:00100000:3.0:1789304914.567248:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765656448 00000100:00100000:3.0:1789304914.569504:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 112 00000100:00100000:3.0:1789304914.569519:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:56095:x1876219765656448:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:3.0:1789304914.577346:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:56095:x1876219765656448:12345-192.168.202.29@tcp:37:rm.0 Request processed in 7817us (17566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304914.577360:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 112 00000100:00100000:1.0:1789304914.586918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304914.586963:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765656704 00000100:00100000:1.0:1789304914.586974:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765656704 00000100:00100000:1.0:1789304914.587029:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 113 00000100:00100000:1.0:1789304914.587039:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:56095:x1876219765656704:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:1.0:1789304914.587368:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:56095:x1876219765656704:12345-192.168.202.29@tcp:35:rm.0 Request processed in 329us (472us total) trans 4294967720 rc 0/0 00000100:00100000:1.0:1789304914.587376:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 113 00000100:00100000:3.0:1789304914.595757:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304914.596030:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765656960 00000100:00100000:0.0:1789304914.596041:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765656960 00000100:00100000:0.0:1789304914.596107:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1110 00000100:00100000:0.0:1789304914.596118:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:56095:x1876219765656960:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:0.0:1789304914.596176:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789304914.596203:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297688 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610080a expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596225:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129762d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861007f5 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596235:0:7654:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie efc0bb7231297283) 00010000:00010000:0.0:1789304914.596239:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:0.0:1789304914.596250:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304914.596275:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129769d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596289:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129769d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596299:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129769d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596364:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312976a4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596372:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312976a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596379:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312976a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596721:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312976ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596731:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312976ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596738:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312976ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596774:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312976ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596782:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312976ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596790:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312976ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596796:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304914.596801:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312976ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596808:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312976ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596817:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789304914.596820:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789304914.596824:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312976ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596831:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312976ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596848:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129769d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596854:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129769d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596860:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129769d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596865:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304914.596868:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129769d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596877:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129769d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596885:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:0.0:1789304914.596887:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304914.596890:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129769d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596896:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129769d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.596906:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312976a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.597444:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312976a4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.597452:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312976a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.597457:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304914.597460:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312976a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.597467:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312976a4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.597477:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9e2c0558d700) 00010000:00010000:0.0:1789304914.597479:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304914.597482:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312976a4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304914.597493:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb72312976a4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304914.597608:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:56095:x1876219765656960:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1487us (1857us total) trans 0 rc -13/-13 00000100:00100000:0.0:1789304914.597619:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1110 00010000:00010000:1.0:1789304915.283168:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304916.008363:0:95966:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff35b757f0 20000000:00000080:0.0:1789304916.008383:0:95966:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c37030400 uarg=0000000000000000 00010000:00010000:0.0:1789304916.011512:0:95966:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304916.011534:0:95966:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304916.011572:0:95966:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304916.011591:0:95966:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304916.011608:0:95966:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb600/0xefc0bb723129760a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297603 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304916.011616:0:95966:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304916.011653:0:95966:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb600/0xefc0bb723129760a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297603 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304916.011683:0:95966:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afb600/0xefc0bb723129760a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297603 expref: 18 pid: 5845 timeout: 2515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304916.011698:0:95966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95966:1876219785728768:0@lo:104: 00000100:00100000:0.0:1789304916.011837:0:95966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304916.011946:0:95966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789304916.012058:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785728768 00000100:00100000:1.0:1789304916.012066:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785728768 00000100:00100000:1.0:1789304916.012300:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789304916.012311:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:95966:x1876219785728768:12345-0@lo:104: 00010000:00010000:1.0:1789304916.012324:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012394:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304916.012400:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:95966:x1876219785728768:12345-0@lo:104: Request processed in 92us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304916.012406:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00010000:00010000:1.0:1789304916.012427:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304916.012433:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012440:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304916.012444:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012453:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304916.012460:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304916.012465:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304916.012496:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012502:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304916.012521:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012527:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231297603 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129760a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012542:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304916.012543:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304916.012545:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304916.012565:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785728896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304916.012594:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304916.012634:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785728896 00000100:00100000:1.0:1789304916.012639:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785728896 00010000:00010000:1.0:1789304916.012670:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb600/0xefc0bb723129760a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297603 expref: 19 pid: 5845 timeout: 2515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304916.012697:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1789304916.012705:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785728896:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304916.012821:0:95966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95966:1876219785728768:0@lo:104: 00010000:00010000:3.0:1789304916.012840:0:95966:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012877:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304916.012884:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb600/0xefc0bb723129760a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297603 expref: 19 pid: 5845 timeout: 2515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012894:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb600/0xefc0bb723129760a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297603 expref: 19 pid: 5845 timeout: 2515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012908:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb600/0xefc0bb723129760a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297603 expref: 19 pid: 5845 timeout: 2515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012921:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012929:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012942:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012949:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012956:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012964:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012971:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304916.012986:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.012993:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.013012:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.013021:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304916.013054:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785728896:12345-0@lo:103:ldlm_bl.0 Request processed in 350us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304916.013060:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1789304916.013087:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785728896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304916.013172:0:95966:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304916.013180:0:95966:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304916.013186:0:95966:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afae00/0xefc0bb72312976b2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95966 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789304916.282537:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967720 is committed 00010000:00010000:3.0:1789304916.306284:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304916.747575:0:96017:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff9d8b0cf0 20000000:00000080:1.0:1789304916.747595:0:96017:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854c800 uarg=0000000000000000 00010000:00010000:1.0:1789304916.748411:0:96017:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304916.748427:0:96017:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304916.748446:0:96017:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304916.748469:0:96017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.748486:0:96017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.748498:0:96017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.748511:0:96017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.748520:0:96017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.748528:0:96017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.748534:0:96017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371a00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304916.748538:0:96017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.748546:0:96017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.748558:0:96017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.748567:0:96017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304916.748573:0:96017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312976b9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304916.759637:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304916.759673:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785729024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304916.759752:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304916.759923:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785729024 00000100:00100000:2.0:1789304916.759932:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785729024 00000100:00100000:2.0:1789304916.759999:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1789304916.760009:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785729024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789304916.760053:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304916.760128:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785729024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304916.760135:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00080000:0.0:1789304916.760204:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304916.760244:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785729024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304916.833299:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304916.833343:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304916.833370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304916.833396:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304916.833428:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765657216 00000100:00100000:3.0:1789304916.833438:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765657216 00000100:00100000:3.0:1789304916.833499:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1696 00000100:00100000:3.0:1789304916.833509:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765657216:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304916.833583:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765657216:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304916.833591:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1696 00000100:00100000:3.0:1789304916.833613:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765657344 00000100:00100000:3.0:1789304916.833617:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765657344 00000100:00100000:3.0:1789304916.833637:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765657472 00000100:00100000:3.0:1789304916.833640:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765657472 00000100:00100000:3.0:1789304916.833678:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1305 00000100:00100000:3.0:1789304916.833686:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765657344:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304916.833725:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765657344:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304916.833731:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1305 00000100:00100000:3.0:1789304916.833743:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1306 00000100:00100000:3.0:1789304916.833750:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765657472:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304916.833772:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765657472:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304916.833778:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1306 00000100:00080000:3.0:1789304916.833793:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304916.833797:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304916.833800:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304916.833879:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765657088 00000100:00100000:2.0:1789304916.833884:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765657088 00000100:00100000:2.0:1789304916.833927:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1329 00000100:00100000:2.0:1789304916.833934:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765657088:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304916.833961:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765657088:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304916.833968:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1329 10000000:01000000:1.0:1789304917.202887:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304917.202897:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304917.202902:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304917.202951:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304917.202967:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304917.202979:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304917.203006:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785729152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304917.203074:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304917.203152:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789304917.204876:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785729152 00000100:00100000:0.0:1789304917.204889:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785729152 00000100:00100000:0.0:1789304917.204946:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1789304917.204956:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785729152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304917.204973:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304917.204993:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312976c7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312976c0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.205021:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312976c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312976c0 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.205033:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312976c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312976c0 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.205042:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa200, rc 0) 00000100:00100000:0.0:1789304917.205138:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785729152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (2062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304917.205145:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1789304917.205260:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785729152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304917.205282:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304917.205291:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304917.205313:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304917.205319:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304917.205327:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304917.330584:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304917.619794:0:96065:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff67016e70 20000000:00000080:0.0:1789304917.619813:0:96065:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c371f1400 uarg=0000000000000000 00010000:00010000:0.0:1789304917.620043:0:96065:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304917.620058:0:96065:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304917.620079:0:96065:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304917.620134:0:96065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.620153:0:96065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312976c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312976c0 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.620162:0:96065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.620203:0:96065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312976c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312976c0 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.620217:0:96065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312976c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312976c0 expref: 18 pid: 5845 timeout: 2517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304917.620232:0:96065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96065:1876219785729280:0@lo:104: 00000100:00100000:0.0:1789304917.620837:0:96065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304917.620932:0:96065:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd7540 going to sleep for 11 seconds 00000100:00100000:2.0:1789304917.621847:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785729280 00000100:00100000:2.0:1789304917.621858:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785729280 00000100:00100000:2.0:1789304917.621963:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789304917.621972:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:96065:x1876219785729280:12345-0@lo:104: 00010000:00010000:2.0:1789304917.621987:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304917.622066:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304917.622071:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:96065:x1876219785729280:12345-0@lo:104: Request processed in 102us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304917.622077:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00010000:00010000:3.0:1789304917.622129:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304917.622136:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304917.622145:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304917.622149:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304917.622157:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304917.622164:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304917.622170:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:0.0:1789304917.622183:0:96065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96065:1876219785729280:0@lo:104: 00010000:00010000:0.0:1789304917.622203:0:96065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304917.622204:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304917.622211:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304917.622228:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304917.622232:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785729408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304917.622239:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb72312976c0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312976c7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304917.622268:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789304917.622271:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304917.622273:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304917.622275:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304917.622307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785729408 00000100:00100000:0.0:1789304917.622311:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785729408 00010000:00010000:0.0:1789304917.622329:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312976c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312976c0 expref: 19 pid: 5845 timeout: 2517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304917.622362:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789304917.622370:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c200d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785729408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304917.622380:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304917.622385:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312976c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312976c0 expref: 19 pid: 5845 timeout: 2517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622395:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312976c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312976c0 expref: 19 pid: 5845 timeout: 2517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622408:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa200/0xefc0bb72312976c7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312976c0 expref: 19 pid: 5845 timeout: 2517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622421:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622429:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622443:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622450:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622457:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622462:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622468:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304917.622473:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622480:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622494:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622503:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304917.622529:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c200d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785729408:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304917.622535:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789304917.622581:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785729408:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304917.622595:0:96065:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622602:0:96065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304917.622607:0:96065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb400/0xefc0bb72312976ce lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304917.780303:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785729536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304917.780375:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304917.780451:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785729536 00000100:00100000:1.0:1789304917.780459:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785729536 00000100:00100000:1.0:1789304917.780516:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:1.0:1789304917.780525:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785729536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304917.780561:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304917.780608:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785729536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304917.780614:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00080000:1.0:1789304917.780634:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304917.780687:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785729536:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304918.354615:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304919.320799:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785729664:0@lo:400:kworker.0 00000100:00100000:0.0:1789304919.320830:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785729920:0@lo:400:kworker.0 00000100:00100000:3.0:1789304919.321671:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785729792:0@lo:400:kworker.0 00000100:00100000:0.0:1789304919.321739:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304919.322453:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304919.322771:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785730176:0@lo:400:kworker.0 00000100:00100000:2.0:1789304919.322830:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304919.322856:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789304919.322862:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785730048:0@lo:400:kworker.0 00000100:00100000:2.0:1789304919.322885:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304919.322920:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785729664 00000100:00100000:2.0:1789304919.322928:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785729664 00000100:00100000:2.0:1789304919.322972:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1789304919.322981:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785729664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304919.323033:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785729664:12345-0@lo:400:kworker.0 Request processed in 53us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304919.323040:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1789304919.323076:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785730176 00000100:00100000:2.0:1789304919.323079:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785730176 00000100:00100000:2.0:1789304919.323136:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785730048 00000100:00100000:2.0:1789304919.323140:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785730048 00000100:00100000:2.0:1789304919.323164:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1697 00000100:00100000:2.0:1789304919.323171:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785730176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304919.323200:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785730176:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304919.323206:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1697 00000100:00100000:2.0:1789304919.323218:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698 00000100:00100000:2.0:1789304919.323224:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785730048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304919.323252:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785730048:12345-0@lo:400:kworker.0 Request processed in 29us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304919.323258:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698 00000100:00080000:2.0:1789304919.323277:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304919.323314:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785730048:0@lo:400:kworker.0 00000100:00100000:2.0:1789304919.323326:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785730176:0@lo:400:kworker.0 00000100:00100000:2.0:1789304919.323335:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785729664:0@lo:400:kworker.0 00000100:00100000:2.0:1789304919.324914:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785729920 00000100:00100000:2.0:1789304919.324929:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785729920 00000100:00100000:2.0:1789304919.325010:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1789304919.325020:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785729920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304919.325142:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785729920:12345-0@lo:400:kworker.0 Request processed in 124us (3403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304919.325150:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00080000:2.0:1789304919.325174:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304919.325208:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785729920:0@lo:400:kworker.0 10000000:01000000:1.0:1789304919.332876:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304919.332883:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304919.332888:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304919.332933:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304919.332946:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304919.332957:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304919.333357:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785730432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304919.333434:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304919.333470:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789304919.333491:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785730432 00000100:00100000:2.0:1789304919.333506:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785730432 00000100:00100000:2.0:1789304919.333566:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1789304919.333576:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785730432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304919.333591:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304919.333606:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312976dc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312976d5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304919.333640:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312976dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312976d5 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304919.333651:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312976dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312976d5 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304919.333660:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecce00, rc 0) 00000100:00100000:2.0:1789304919.333725:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785730432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304919.333732:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1789304919.333853:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785730432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304919.333868:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304919.333876:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304919.333897:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304919.333902:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304919.333909:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304919.334019:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304919.334061:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785730304:0@lo:400:kworker.0 00000100:00100000:1.0:1789304919.334231:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785729792 00000100:00100000:1.0:1789304919.334237:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785729792 00000100:00100000:1.0:1789304919.334267:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:1.0:1789304919.334274:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785729792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304919.334310:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785729792:12345-0@lo:400:kworker.0 Request processed in 36us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304919.334316:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000100:00100000:3.0:1789304919.334437:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304919.334485:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785729792:0@lo:400:kworker.0 00000100:00100000:1.0:1789304919.334580:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785730304 00000100:00100000:1.0:1789304919.334585:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785730304 00000100:00080000:2.0:1789304919.334608:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304919.334621:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:1.0:1789304919.334639:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785730304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304919.334674:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785730304:12345-0@lo:400:kworker.0 Request processed in 46us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304919.334680:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1789304919.334734:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785730304:0@lo:400:kworker.0 00010000:00010000:3.0:1789304919.378321:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304920.402320:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304921.318994:0:96260:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffccb8ae4a0 20000000:00000080:0.0:1789304921.319012:0:96260:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e79800 uarg=0000000000000000 00010000:00010000:0.0:1789304921.321335:0:96260:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304921.321354:0:96260:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304921.321373:0:96260:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304921.321392:0:96260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304921.321408:0:96260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312976dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312976d5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304921.321415:0:96260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304921.321457:0:96260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312976dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312976d5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304921.321471:0:96260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312976dc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312976d5 expref: 18 pid: 5846 timeout: 2520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304921.321484:0:96260:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96260:1876219785730560:0@lo:104: 00000100:00100000:0.0:1789304921.321546:0:96260:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304921.321647:0:96260:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38835d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789304921.328825:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785730560 00000100:00100000:2.0:1789304921.328842:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785730560 00000100:00100000:2.0:1789304921.329017:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789304921.329028:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:96260:x1876219785730560:12345-0@lo:104: 00010000:00010000:2.0:1789304921.329047:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304921.329792:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304921.329801:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:96260:x1876219785730560:12345-0@lo:104: Request processed in 775us (8254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304921.329810:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00010000:00010000:3.0:1789304921.329889:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304921.329897:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304921.329905:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370c00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304921.329909:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304921.329918:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304921.329924:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304921.329930:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304921.329974:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304921.329980:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304921.330010:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304921.330018:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312976dc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304921.330043:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304921.330045:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304921.330046:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304921.330053:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304921.330066:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785730688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304921.330152:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304921.330307:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785730688 00000100:00100000:1.0:1789304921.330314:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785730688 00010000:00010000:1.0:1789304921.330341:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312976dc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312976d5 expref: 19 pid: 5846 timeout: 2520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304921.330372:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1789304921.330379:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785730688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304921.330390:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304921.330395:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312976dc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312976d5 expref: 19 pid: 5846 timeout: 2520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330407:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312976dc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312976d5 expref: 19 pid: 5846 timeout: 2520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330423:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330432:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330447:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330454:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330461:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330468:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330474:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304921.330477:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330485:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330494:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304921.330503:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304921.330538:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785730688:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304921.330545:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1789304921.330580:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785730688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304921.335141:0:96260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312976dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312976d5 expref: 18 pid: 5846 timeout: 2520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304921.335163:0:96260:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96260:1876219785730560:0@lo:104: 00010000:00010000:0.0:1789304921.335189:0:96260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304921.335200:0:96260:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304921.335207:0:96260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304921.335217:0:96260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976e3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304921.427661:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304921.879832:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785730816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304921.879895:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304921.880601:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785730816 00000100:00100000:1.0:1789304921.880621:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785730816 00000100:00100000:1.0:1789304921.880695:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:1.0:1789304921.880704:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785730816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304921.880737:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304921.880801:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785730816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304921.880808:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1789304921.880886:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785730816:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304921.880925:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304921.954790:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304921.954836:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304921.954888:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304921.954923:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304921.954998:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765657600 00000100:00100000:1.0:1789304921.955009:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765657600 00000100:00100000:1.0:1789304921.955060:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1333 00000100:00100000:1.0:1789304921.955067:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765657600:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304921.955155:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765657984 00000100:00100000:1.0:1789304921.955156:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765657600:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304921.955163:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765657984 00000100:00100000:1.0:1789304921.955166:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1333 00000100:00100000:1.0:1789304921.955196:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765657856 00000100:00100000:1.0:1789304921.955199:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765657856 00000100:00100000:0.0:1789304921.955227:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1309 00000100:00100000:0.0:1789304921.955243:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765657984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304921.955269:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765657728 00000100:00100000:2.0:1789304921.955273:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765657728 00000100:00100000:0.0:1789304921.955279:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765657984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 43us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304921.958387:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1700 00000100:00100000:2.0:1789304921.958407:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765657728:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304921.958474:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765657728:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (3696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304921.958481:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1700 00000100:00100000:1.0:1789304921.958940:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1310 00000100:00100000:1.0:1789304921.958951:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765657856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304921.958976:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765657856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (4054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304921.958980:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1310 00000100:00080000:1.0:1789304921.959154:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304921.959160:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304921.959163:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304921.960713:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1309 00010000:00010000:3.0:1789304922.452173:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304922.899286:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785730944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304922.899359:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304922.899479:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785730944 00000100:00100000:1.0:1789304922.899488:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785730944 00000100:00100000:1.0:1789304922.899550:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:1.0:1789304922.899559:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785730944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304922.899605:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789304922.899729:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304922.899841:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785730944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 282us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304922.899850:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1789304922.899935:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785730944:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1789304923.219190:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304923.219199:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304923.219204:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304923.219260:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304923.219273:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304923.219284:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304923.219315:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785731072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304923.219390:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304923.219462:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388c8180 going to sleep for 11 seconds 00000100:00100000:2.0:1789304923.219538:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785731072 00000100:00100000:2.0:1789304923.219546:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785731072 00000100:00100000:2.0:1789304923.219608:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1789304923.219617:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785731072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304923.219630:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304923.219645:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312976f1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312976ea expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304923.219680:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312976f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312976ea expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304923.219697:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312976f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312976ea expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304923.219705:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40eccc00, rc 0) 00000100:00100000:2.0:1789304923.219755:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785731072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304923.219761:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1789304923.219858:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785731072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304923.219874:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304923.219883:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304923.219902:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304923.219907:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304923.219914:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304923.477290:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304924.435768:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785731456:0@lo:400:kworker.0 00000100:00100000:0.0:1789304924.435841:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304924.435956:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785731328:0@lo:400:kworker.0 00000100:00100000:2.0:1789304924.435991:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304924.436038:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785731840:0@lo:400:kworker.0 00000100:00100000:2.0:1789304924.436061:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304924.436085:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789304924.436112:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785731200:0@lo:400:kworker.0 00000100:00100000:2.0:1789304924.436139:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304924.436160:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785731712:0@lo:400:kworker.0 00000100:00100000:2.0:1789304924.436183:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304924.436212:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785731328 00000100:00100000:2.0:1789304924.436220:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785731328 00000100:00100000:2.0:1789304924.436274:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785731712 00000100:00100000:2.0:1789304924.436277:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785731712 00000100:00100000:2.0:1789304924.436308:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1701 00000100:00100000:2.0:1789304924.436316:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785731328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304924.436365:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785731328:12345-0@lo:400:kworker.0 Request processed in 49us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304924.436373:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1701 00000100:00100000:2.0:1789304924.436388:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702 00000100:00100000:2.0:1789304924.436394:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785731712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304924.436419:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785731712:12345-0@lo:400:kworker.0 Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304924.436425:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702 00000100:00100000:2.0:1789304924.436443:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785731456 00000100:00100000:2.0:1789304924.436447:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785731456 00000100:00100000:2.0:1789304924.436470:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785731840 00000100:00100000:2.0:1789304924.436473:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785731840 00000100:00100000:2.0:1789304924.436490:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1789304924.436496:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785731456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304924.436524:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785731456:12345-0@lo:400:kworker.0 Request processed in 28us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304924.436530:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1789304924.436541:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1789304924.436546:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785731840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304924.436571:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785731840:12345-0@lo:400:kworker.0 Request processed in 25us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304924.436576:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1789304924.436637:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785731712:0@lo:400:kworker.0 00000100:00100000:2.0:1789304924.436648:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785731328:0@lo:400:kworker.0 00000100:00100000:2.0:1789304924.436655:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0408aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785731840:0@lo:400:kworker.0 00000100:00100000:0.0:1789304924.439590:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785731456:0@lo:400:kworker.0 00000100:00100000:0.0:1789304924.439618:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304924.439628:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785731584:0@lo:400:kworker.0 00000100:00100000:0.0:1789304924.439686:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304924.440126:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785731200 00000100:00100000:3.0:1789304924.440134:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785731200 00000100:00100000:3.0:1789304924.440188:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1789304924.440197:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785731200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304924.440269:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785731200:12345-0@lo:400:kworker.0 Request processed in 74us (4129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304924.440277:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00080000:3.0:1789304924.440307:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304924.440312:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304924.440315:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304924.440334:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785731200:0@lo:400:kworker.0 00000100:00100000:3.0:1789304924.440367:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785731584 00000100:00100000:3.0:1789304924.440371:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785731584 00000100:00100000:3.0:1789304924.440407:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1703 00000100:00100000:3.0:1789304924.440413:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785731584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304924.440451:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0408aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785731584:12345-0@lo:400:kworker.0 Request processed in 38us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304924.440457:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1703 00000100:00080000:3.0:1789304924.440474:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304924.440491:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785731584:0@lo:400:kworker.0 00010000:00010000:1.0:1789304924.499414:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304925.522484:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304926.549212:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304926.994416:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785731968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304926.994494:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304926.994895:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785731968 00000100:00100000:0.0:1789304926.994906:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785731968 00000100:00100000:0.0:1789304926.994980:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1789304926.994991:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785731968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304926.995041:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304926.995115:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785731968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304926.995123:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1789304926.995172:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04016300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785731968:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304926.997482:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304927.079049:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304927.079143:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304927.079251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765658112 00000100:00100000:2.0:1789304927.079262:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765658112 00000100:00100000:2.0:1789304927.079321:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1336 00000100:00100000:2.0:1789304927.079332:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765658112:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304927.079414:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765658112:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304927.079422:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1336 00000100:00100000:3.0:1789304927.079547:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765658240 00000100:00100000:3.0:1789304927.079552:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765658240 00000100:00100000:3.0:1789304927.079615:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1704 00000100:00100000:3.0:1789304927.079623:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765658240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304927.079654:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765658240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304927.079660:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1704 00000100:00080000:2.0:1789304927.079807:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304927.086562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304927.086603:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304927.086705:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765658368 00000100:00100000:3.0:1789304927.086716:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765658368 00000100:00100000:3.0:1789304927.086792:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765658496 00000100:00100000:3.0:1789304927.086795:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765658496 00000100:00100000:3.0:1789304927.086823:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1313 00000100:00100000:3.0:1789304927.086835:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765658368:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304927.086905:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765658368:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304927.086913:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1313 00000100:00100000:3.0:1789304927.086929:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1314 00000100:00100000:3.0:1789304927.086935:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765658496:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304927.086960:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765658496:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304927.086966:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1314 00000100:00080000:0.0:1789304927.087124:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304927.087128:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789304927.571227:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304928.018241:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304928.018259:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785732096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304928.018331:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304928.018470:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785732096 00000100:00100000:3.0:1789304928.018479:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785732096 00000100:00100000:3.0:1789304928.018537:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1789304928.018544:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785732096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304928.018587:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304928.018636:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785732096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304928.018641:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00080000:0.0:1789304928.019656:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304928.019703:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785732096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789304928.597958:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789304929.467796:0:96606:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 22: test nodemap mapped_trusted_admin fileops ========================================================== 09:08:48 (1789304928) 00000100:00100000:3.0:1789304929.559897:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785732224:0@lo:400:kworker.0 00000100:00100000:3.0:1789304929.559990:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304929.560274:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785732224 00000100:00100000:0.0:1789304929.560283:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785732224 00000100:00100000:0.0:1789304929.560324:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1789304929.560331:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785732224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.562519:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785732224:12345-0@lo:400:kworker.0 Request processed in 2176us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304929.562547:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1789304929.562614:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785732608:0@lo:400:kworker.0 00000100:00100000:1.0:1789304929.562675:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304929.562709:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304929.562716:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785732480:0@lo:400:kworker.0 00000100:00100000:1.0:1789304929.562744:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304929.562786:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785732608 00000100:00100000:1.0:1789304929.562794:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785732608 00000100:00100000:1.0:1789304929.562843:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705 00000100:00100000:1.0:1789304929.562853:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785732608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.562855:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785732480 00000100:00100000:0.0:1789304929.562862:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785732480 00000100:00100000:0.0:1789304929.562901:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1789304929.562907:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785732608:12345-0@lo:400:kworker.0 Request processed in 56us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304929.562913:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785732480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304929.562920:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705 00000100:00100000:1.0:1789304929.562966:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785732608:0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.562967:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785732480:12345-0@lo:400:kworker.0 Request processed in 58us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304929.562979:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1789304929.562999:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785732480:0@lo:400:kworker.0 00000100:00080000:0.0:1789304929.563001:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304929.563158:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785732352:0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.563188:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304929.563211:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785732864:0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.563234:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304929.563255:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304929.563260:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785732736:0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.563281:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304929.563302:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785732864 00000100:00100000:0.0:1789304929.563306:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785732864 00000100:00100000:0.0:1789304929.563334:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:0.0:1789304929.563339:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785732864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.563442:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785732864:12345-0@lo:400:kworker.0 Request processed in 102us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304929.563449:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:0.0:1789304929.563467:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785732352 00000100:00100000:0.0:1789304929.563471:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785732352 00000100:00100000:0.0:1789304929.563489:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785732736 00000100:00100000:0.0:1789304929.563491:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785732736 00000100:00100000:0.0:1789304929.563508:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:0.0:1789304929.563514:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785732352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.563553:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785732352:12345-0@lo:400:kworker.0 Request processed in 39us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304929.563559:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00100000:0.0:1789304929.563569:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1707 00000100:00100000:0.0:1789304929.563575:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785732736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.563730:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785732736:12345-0@lo:400:kworker.0 Request processed in 155us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304929.563736:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1707 00000100:00080000:0.0:1789304929.563748:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789304929.563751:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304929.563768:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785732736:0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.563775:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785732352:0@lo:400:kworker.0 00000100:00100000:0.0:1789304929.563782:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785732864:0@lo:400:kworker.0 00000100:00100000:3.0:1789304929.565143:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785732224:0@lo:400:kworker.0 00010000:00010000:3.0:1789304929.620671:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:3.0:1789304930.436366:0:96654:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:3.0:1789304930.447888:0:96654:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:1.0:1789304930.643084:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304931.229645:0:96702:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc9ba0a4e0 20000000:00000080:0.0:1789304931.229665:0:96702:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c05396400 uarg=0000000000000000 10000000:01000000:0.0:1789304931.231538:0:96702:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304931.231561:0:96702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304931.231581:0:96702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312976f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312976ea expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304931.231589:0:96702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304931.231627:0:96702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312976f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312976ea expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304931.231641:0:96702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312976f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312976ea expref: 18 pid: 5846 timeout: 2480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304931.231660:0:96702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96702:1876219785732992:0@lo:104: 00000100:00100000:0.0:1789304931.231723:0:96702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304931.231832:0:96702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304931.234663:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785732992 00000100:00100000:1.0:1789304931.234679:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785732992 00000100:00100000:1.0:1789304931.235734:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789304931.235751:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:96702:x1876219785732992:12345-0@lo:104: 00010000:00010000:1.0:1789304931.235771:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304931.235879:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304931.235885:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:96702:x1876219785732992:12345-0@lo:104: Request processed in 141us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304931.235892:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00010000:3.0:1789304931.235938:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304931.235946:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.235959:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370c00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304931.235963:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.235971:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304931.235977:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304931.235983:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304931.236032:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236039:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304931.236071:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236078:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41370c00/0xefc0bb72312976ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312976f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236120:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304931.236122:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304931.236124:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304931.236145:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785733120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304931.236184:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304931.236240:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785733120 00000100:00100000:3.0:1789304931.236245:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785733120 00010000:00010000:3.0:1789304931.236268:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312976f1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312976ea expref: 19 pid: 5846 timeout: 2480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304931.236291:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1789304931.236297:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785733120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304931.236307:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304931.236312:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312976f1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312976ea expref: 19 pid: 5846 timeout: 2480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236322:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312976f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312976ea expref: 19 pid: 5846 timeout: 2480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236338:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236347:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236361:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236368:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236374:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236381:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236386:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304931.236390:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236398:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236406:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304931.236414:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304931.236443:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785733120:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304931.236450:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1789304931.236488:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785733120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304931.236699:0:96702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40eccc00/0xefc0bb72312976f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312976ea expref: 18 pid: 5846 timeout: 2480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304931.236711:0:96702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96702:1876219785732992:0@lo:104: 00010000:00010000:0.0:1789304931.236725:0:96702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304931.236733:0:96702:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304931.236740:0:96702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304931.236746:0:96702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb72312976f8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304931.666265:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304931.975728:0:96751:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb0d76620 20000000:00000080:3.0:1789304931.975747:0:96751:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c05395c00 uarg=0000000000000000 10000000:01000000:2.0:1789304931.976803:0:96751:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304931.976824:0:96751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304931.976836:0:96751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304931.976844:0:96751:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304931.976848:0:96751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304931.976854:0:96751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304931.976861:0:96751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304931.976867:0:96751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304931.976872:0:96751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304931.976879:0:96751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304931.976891:0:96751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304931.976899:0:96751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304931.976907:0:96751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb72312976ff lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304932.114286:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785733248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304932.114351:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304932.114424:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785733248 00000100:00100000:0.0:1789304932.114431:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785733248 00000100:00100000:0.0:1789304932.114478:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:0.0:1789304932.114485:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785733248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304932.114531:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304932.114573:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785733248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304932.114580:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00080000:0.0:1789304932.114600:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304932.114633:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785733248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304932.199048:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304932.199084:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304932.199250:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304932.199276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304932.199306:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765658752 00000100:00100000:3.0:1789304932.199316:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765658752 00000100:00100000:3.0:1789304932.199379:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1708 00000100:00100000:3.0:1789304932.199390:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765658752:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304932.199465:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765658752:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304932.199472:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1708 00000100:00100000:3.0:1789304932.199501:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765659008 00000100:00100000:3.0:1789304932.199505:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765659008 00000100:00100000:3.0:1789304932.199547:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765658880 00000100:00100000:3.0:1789304932.199550:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765658880 00000100:00100000:3.0:1789304932.199579:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1317 00000100:00100000:3.0:1789304932.199586:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765659008:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304932.199614:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765659008:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304932.199621:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1317 00000100:00100000:3.0:1789304932.199681:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1318 00000100:00100000:3.0:1789304932.199688:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765658880:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304932.199712:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765658880:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304932.199718:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1318 00000100:00100000:3.0:1789304932.199737:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765658624 00000100:00100000:3.0:1789304932.199740:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765658624 00000100:00100000:3.0:1789304932.199766:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1338 00000100:00100000:3.0:1789304932.199773:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765658624:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304932.199798:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765658624:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304932.199804:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1338 00000100:00080000:3.0:1789304932.199833:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304932.199837:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304932.199840:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304932.695287:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789304932.758043:0:96799:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0abd1f40 20000000:00000080:3.0:1789304932.758059:0:96799:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c05395c00 uarg=0000000000000000 10000000:01000000:3.0:1789304932.758409:0:96799:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304932.758433:0:96799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.758450:0:96799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.758461:0:96799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.758467:0:96799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.758474:0:96799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.758481:0:96799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.758486:0:96799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304932.758490:0:96799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.758497:0:96799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.758905:0:96799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.758913:0:96799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.758919:0:96799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297706 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304932.891325:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304932.891331:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304932.891334:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304932.891377:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.891389:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.891409:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304932.891433:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785733376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304932.891513:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304932.891560:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c056c8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789304932.891679:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785733376 00000100:00100000:3.0:1789304932.891687:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785733376 00000100:00100000:3.0:1789304932.891732:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1789304932.891741:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785733376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304932.891755:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304932.891768:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231297714 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129770d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.891791:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231297714 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129770d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.891801:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231297714 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129770d expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.891815:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fe00, rc 0) 00000100:00100000:3.0:1789304932.891854:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785733376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304932.891861:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1789304932.892026:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785733376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304932.892041:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.892050:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304932.892068:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304932.892073:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304932.892080:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304933.138618:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785733504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304933.139309:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304933.139442:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785733504 00000100:00100000:2.0:1789304933.139452:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785733504 00000100:00100000:2.0:1789304933.139523:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1789304933.139533:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785733504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304933.139574:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304933.139626:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785733504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304933.139634:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1789304933.139679:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785733504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304933.140065:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789304933.481032:0:96847:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd0b38eb0 20000000:00000080:1.0:1789304933.481054:0:96847:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c371f3c00 uarg=0000000000000000 10000000:01000000:1.0:1789304933.481311:0:96847:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304933.481400:0:96847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304933.481418:0:96847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231297714 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129770d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304933.481426:0:96847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304933.481464:0:96847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231297714 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129770d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304933.481479:0:96847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231297714 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129770d expref: 18 pid: 5845 timeout: 2483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304933.481503:0:96847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96847:1876219785733632:0@lo:104: 00000100:00100000:1.0:1789304933.481635:0:96847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304933.481805:0:96847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304933.481853:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785733632 00000100:00100000:2.0:1789304933.481862:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785733632 00000100:00100000:2.0:1789304933.481961:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789304933.481971:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:96847:x1876219785733632:12345-0@lo:104: 00010000:00010000:2.0:1789304933.481985:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304933.482050:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304933.482057:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:96847:x1876219785733632:12345-0@lo:104: Request processed in 88us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304933.482064:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789304933.482150:0:96847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96847:1876219785733632:0@lo:104: 00010000:00010000:1.0:1789304933.482167:0:96847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304933.482228:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304933.482236:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304933.482242:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304933.482247:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304933.482256:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304933.482264:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304933.482270:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304933.482308:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304933.482314:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304933.482346:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304933.482354:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129770d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297714 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304933.482371:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304933.482373:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304933.482374:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304933.482674:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785733760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304933.482709:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304933.482850:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785733760 00000100:00100000:0.0:1789304933.482855:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785733760 00010000:00010000:0.0:1789304933.482879:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231297714 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129770d expref: 19 pid: 5845 timeout: 2483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304933.482940:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1789304933.482950:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785733760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304933.482962:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304933.482967:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231297714 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129770d expref: 19 pid: 5845 timeout: 2483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.482978:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231297714 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129770d expref: 19 pid: 5845 timeout: 2483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.482993:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb7231297714 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129770d expref: 19 pid: 5845 timeout: 2483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.483009:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.483017:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.483031:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.483043:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.483051:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.483057:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.483062:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304933.483066:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.483074:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.483114:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304933.483123:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304933.483154:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785733760:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304933.483160:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00010000:2.0:1789304933.483224:0:96847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304933.483232:0:96847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304933.483238:0:96847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371e00/0xefc0bb723129771b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304933.486709:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785733760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789304933.714551:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789304934.376893:0:96895:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6d8dcbc0 20000000:00000080:0.0:1789304934.376909:0:96895:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f7dbc00 uarg=0000000000000000 10000000:01000000:0.0:1789304934.377289:0:96895:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304934.377313:0:96895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.377335:0:96895:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.377347:0:96895:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.377354:0:96895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.377361:0:96895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.377368:0:96895:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.377375:0:96895:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304934.377379:0:96895:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.377387:0:96895:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.377400:0:96895:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.377407:0:96895:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.377413:0:96895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afaa00/0xefc0bb7231297722 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96895 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304934.674370:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785734016:0@lo:400:kworker.0 00000100:00100000:2.0:1789304934.674378:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785734144:0@lo:400:kworker.0 00000100:00100000:3.0:1789304934.674450:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785733888:0@lo:400:kworker.0 00000100:00100000:0.0:1789304934.675139:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785734272:0@lo:400:kworker.0 00000100:00100000:1.0:1789304934.677538:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304934.677587:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304934.677588:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304934.677616:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785734528:0@lo:400:kworker.0 00000100:00100000:3.0:1789304934.677650:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785734400:0@lo:400:kworker.0 00000100:00100000:1.0:1789304934.677659:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304934.677664:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785734016 00000100:00100000:0.0:1789304934.677672:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785734016 00000100:00100000:1.0:1789304934.677693:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785734272 00000100:00100000:1.0:1789304934.677696:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785734272 00000100:00100000:3.0:1789304934.677703:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304934.677729:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785734400 00000100:00100000:0.0:1789304934.677733:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785734400 00000100:00100000:1.0:1789304934.677734:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:1.0:1789304934.677742:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785734016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304934.677753:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785733888 00000100:00100000:3.0:1789304934.677759:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785733888 00000100:00100000:3.0:1789304934.677794:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1789304934.677804:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785733888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304934.677808:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785734016:12345-0@lo:400:kworker.0 Request processed in 65us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304934.677817:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00100000:1.0:1789304934.677841:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:3.0:1789304934.677856:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785733888:12345-0@lo:400:kworker.0 Request processed in 49us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304934.677856:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785734272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304934.677868:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1789304934.677899:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785734272:12345-0@lo:400:kworker.0 Request processed in 50us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304934.677902:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785734528 00000100:00100000:1.0:1789304934.677907:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00000100:00100000:3.0:1789304934.677908:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785734528 00000100:00080000:1.0:1789304934.677929:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304934.677935:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304934.677942:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1711 00000100:00100000:0.0:1789304934.677951:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785734400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304934.677956:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1789304934.677966:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785734016:0@lo:400:kworker.0 00000100:00100000:3.0:1789304934.677968:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785734528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304934.677985:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785734400:12345-0@lo:400:kworker.0 Request processed in 36us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304934.677992:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1711 00000100:00100000:0.0:1789304934.678022:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785734272:0@lo:400:kworker.0 00000100:00100000:3.0:1789304934.678034:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785734528:12345-0@lo:400:kworker.0 Request processed in 69us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304934.678041:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1789304934.678059:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785734528:0@lo:400:kworker.0 00000100:00100000:3.0:1789304934.678117:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785733888:0@lo:400:kworker.0 00000100:00100000:3.0:1789304934.678129:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785734400:0@lo:400:kworker.0 00000100:00100000:2.0:1789304934.683046:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304934.683119:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785734144 00000100:00100000:3.0:1789304934.683130:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785734144 00000100:00100000:3.0:1789304934.683185:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1789304934.683195:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785734144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304934.683273:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785734144:12345-0@lo:400:kworker.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304934.683280:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1789304934.683465:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785734144:0@lo:400:kworker.0 00010000:00010000:2.0:1789304934.741432:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304934.931542:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304934.931552:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304934.931557:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304934.931663:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304934.931676:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304934.931692:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304934.931715:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785734656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304934.931777:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304934.932479:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c038533c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304934.933581:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785734656 00000100:00100000:0.0:1789304934.933594:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785734656 00000100:00100000:0.0:1789304934.933652:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1789304934.933661:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785734656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304934.933676:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304934.933694:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231297730 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297729 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.933718:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231297730 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297729 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.933729:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231297730 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297729 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.933738:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afac00, rc 0) 00000100:00100000:0.0:1789304934.933805:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785734656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304934.933812:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1789304934.933866:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785734656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304934.933882:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.933891:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789304934.933910:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789304934.933916:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304934.933924:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789304935.261758:0:96943:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6508ff90 20000000:00000080:3.0:1789304935.261778:0:96943:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c38ecf000 uarg=0000000000000000 10000000:01000000:3.0:1789304935.262069:0:96943:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304935.262321:0:96943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304935.262343:0:96943:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231297730 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297729 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304935.262351:0:96943:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304935.262530:0:96943:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231297730 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297729 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304935.262544:0:96943:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231297730 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297729 expref: 18 pid: 5847 timeout: 2484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304935.262558:0:96943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96943:1876219785734784:0@lo:104: 00000100:00100000:3.0:1789304935.262621:0:96943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304935.262725:0:96943:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03853b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789304935.262769:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785734784 00000100:00100000:1.0:1789304935.262777:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785734784 00000100:00100000:1.0:1789304935.262938:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789304935.262948:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:96943:x1876219785734784:12345-0@lo:104: 00010000:00010000:1.0:1789304935.262962:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304935.263070:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304935.263077:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:96943:x1876219785734784:12345-0@lo:104: Request processed in 131us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304935.263084:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00010000:00010000:2.0:1789304935.263273:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304935.263281:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263289:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304935.263293:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263312:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304935.263321:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304935.263326:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304935.263369:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263378:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304935.263400:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263406:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e800/0xefc0bb7231297729 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297730 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263423:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304935.263424:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304935.263426:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304935.263457:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785734912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789304935.263502:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304935.263537:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785734912 00000100:00100000:2.0:1789304935.263541:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785734912 00010000:00010000:2.0:1789304935.263562:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231297730 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297729 expref: 19 pid: 5847 timeout: 2484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304935.263584:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1789304935.263590:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785734912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304935.263600:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304935.263604:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231297730 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297729 expref: 19 pid: 5847 timeout: 2484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263613:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231297730 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297729 expref: 19 pid: 5847 timeout: 2484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263631:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263644:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263659:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263666:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263673:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263679:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263685:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304935.263690:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263698:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263707:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304935.263716:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304935.263744:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785734912:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304935.263750:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1789304935.263797:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785734912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304935.264155:0:96943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afac00/0xefc0bb7231297730 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297729 expref: 18 pid: 5847 timeout: 2484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304935.264172:0:96943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96943:1876219785734784:0@lo:104: 00010000:00010000:3.0:1789304935.264187:0:96943:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304935.264196:0:96943:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304935.264203:0:96943:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304935.264210:0:96943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297737 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304935.762621:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304936.530629:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304936.530638:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304936.530643:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304936.530694:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304936.530706:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304936.530718:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304936.530749:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785735040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304936.530821:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304936.530889:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c387c4600 going to sleep for 11 seconds 00000100:00100000:3.0:1789304936.531283:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785735040 00000100:00100000:3.0:1789304936.531298:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785735040 00000100:00100000:3.0:1789304936.531351:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:3.0:1789304936.531360:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785735040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304936.531384:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304936.531398:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231297745 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129773e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304936.531421:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231297745 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129773e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304936.531432:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231297745 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129773e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304936.531440:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f400, rc 0) 00000100:00100000:3.0:1789304936.531514:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785735040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304936.531532:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1789304936.531773:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785735040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304936.531789:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304936.531798:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304936.531816:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304936.531820:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304936.531828:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304936.786231:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304937.236614:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785735168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304937.236695:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304937.236772:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785735168 00000100:00100000:0.0:1789304937.236781:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785735168 00000100:00100000:0.0:1789304937.236842:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:0.0:1789304937.236852:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785735168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304937.236888:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304937.236948:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785735168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304937.236954:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00080000:0.0:1789304937.236976:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304937.237036:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785735168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304937.313166:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304937.313203:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304937.313230:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765659136 00000100:00100000:3.0:1789304937.313239:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765659136 00000100:00100000:3.0:1789304937.313288:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1343 00000100:00100000:3.0:1789304937.313299:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765659136:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304937.313369:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765659136:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304937.313376:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1343 00000100:00100000:3.0:1789304937.313410:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765659264 00000100:00100000:3.0:1789304937.313414:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765659264 00000100:00100000:3.0:1789304937.313447:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1712 00000100:00100000:3.0:1789304937.313453:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765659264:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304937.313492:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765659264:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304937.313498:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1712 00000100:00080000:3.0:1789304937.313608:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304937.328037:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304937.328156:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765659392 00000100:00100000:3.0:1789304937.328169:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765659392 00000100:00100000:2.0:1789304937.328170:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304937.328194:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765659520 00000100:00100000:2.0:1789304937.328198:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765659520 00000100:00100000:2.0:1789304937.328238:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 609 00000100:00100000:2.0:1789304937.328248:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765659520:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:2.0:1789304937.328287:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231297611 00000100:00080000:2.0:1789304937.328298:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2b011e2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789304937.328342:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967365 00000100:00100000:2.0:1789304937.328810:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765659520:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 563us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304937.328818:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 609 00000100:00100000:2.0:1789304937.328836:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 610 00000100:00100000:2.0:1789304937.328844:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765659392:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:2.0:1789304937.328858:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb723129730f 00000100:00080000:2.0:1789304937.328865:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2c20272800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789304937.328901:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967365 00000100:00100000:2.0:1789304937.329036:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765659392:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 193us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304937.329043:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 610 00010000:00010000:0.0:1789304937.329087:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789304937.335413:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304937.335423:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304937.341240:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304937.810197:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304937.908900:0:97094:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7475c630 20000000:00000080:1.0:1789304937.908918:0:97094:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c388d7800 uarg=0000000000000000 10000000:01000000:1.0:1789304937.909714:0:97094:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304937.909737:0:97094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304937.909754:0:97094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231297745 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129773e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304937.909763:0:97094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304937.909803:0:97094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231297745 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129773e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304937.909819:0:97094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231297745 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129773e expref: 18 pid: 5845 timeout: 2487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304937.909834:0:97094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97094:1876219785735296:0@lo:104: 00000100:00100000:1.0:1789304937.909900:0:97094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304937.910002:0:97094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13fd79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789304937.910055:0:52683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789304937.910069:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785735296 00000100:00100000:2.0:1789304937.910077:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785735296 00000100:00100000:0.0:1789304937.914008:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789304937.914030:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:97094:x1876219785735296:12345-0@lo:104: 00010000:00010000:0.0:1789304937.914049:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304937.914197:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304937.914205:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:97094:x1876219785735296:12345-0@lo:104: Request processed in 185us (4305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304937.914212:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00010000:00010000:3.0:1789304937.914300:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304937.914308:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914316:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789304937.914321:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914331:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789304937.914338:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304937.914344:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789304937.914402:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914408:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789304937.914430:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914438:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb723129773e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297745 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914466:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304937.914469:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304937.914471:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304937.914494:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785735424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789304937.914547:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304937.914606:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785735424 00000100:00100000:3.0:1789304937.914614:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785735424 00010000:00010000:3.0:1789304937.914638:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231297745 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129773e expref: 19 pid: 5845 timeout: 2487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304937.914664:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1789304937.914672:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785735424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304937.914683:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304937.914689:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231297745 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129773e expref: 19 pid: 5845 timeout: 2487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914701:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231297745 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129773e expref: 19 pid: 5845 timeout: 2487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914721:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914731:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914748:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914755:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914762:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914768:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914774:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304937.914778:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914787:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914795:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304937.914804:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304937.914837:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785735424:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304937.914844:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1789304937.914885:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785735424:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304937.915363:0:97094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f400/0xefc0bb7231297745 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129773e expref: 18 pid: 5845 timeout: 2487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304937.915378:0:97094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97094:1876219785735296:0@lo:104: 00010000:00010000:1.0:1789304937.915396:0:97094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304937.915404:0:97094:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304937.915412:0:97094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304937.915423:0:97094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370600/0xefc0bb723129774c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304938.260692:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304938.264688:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785735552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304938.264770:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304938.268605:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785735552 00000100:00100000:0.0:1789304938.268621:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785735552 00000100:00100000:0.0:1789304938.268707:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1789304938.268720:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785735552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304938.268763:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304938.268849:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785735552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (4078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304938.268857:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1789304938.268912:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785735552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304938.269941:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789304938.811194:0:97142:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdce82d560 20000000:00000080:2.0:1789304938.811215:0:97142:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f7c0000 uarg=0000000000000000 10000000:01000000:2.0:1789304938.811682:0:97142:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304938.811704:0:97142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304938.811721:0:97142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304938.811731:0:97142:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304938.811738:0:97142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304938.811744:0:97142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304938.811752:0:97142:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304938.811757:0:97142:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304938.811761:0:97142:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304938.811769:0:97142:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304938.811781:0:97142:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304938.811788:0:97142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304938.811794:0:97142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd800/0xefc0bb7231297753 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304938.837343:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789304939.341492:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:2.0:1789304939.341663:0:6723:0:(genops.c:885:class_export_put()) final put ffff9e2c20271000/99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00100000:3.0:1789304939.352470:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789304939.352480:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2c3f699800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:1.0:1789304939.352714:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c20271000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0000 00000020:00000080:1.0:1789304939.352766:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c20272800 for lustre-OST0000 00000020:00000080:1.0:1789304939.354448:0:94485:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c3f699800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:1.0:1789304939.354512:0:94485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b011e2000 for lustre-OST0001 10000000:01000000:3.0:1789304939.474291:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304939.474300:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304939.474306:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304939.474362:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304939.474376:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304939.474388:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304939.474416:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785735680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304939.474528:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304939.474606:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c079789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789304939.474803:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785735680 00000100:00100000:0.0:1789304939.474821:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785735680 00000100:00100000:0.0:1789304939.474881:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1789304939.474889:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785735680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789304939.474902:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304939.474916:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297761 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129775a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304939.474940:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129775a expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304939.474951:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129775a expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304939.474960:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbc00, rc 0) 00000100:00100000:0.0:1789304939.474997:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785735680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304939.475003:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1789304939.476282:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785735680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304939.476304:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304939.476315:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304939.476338:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304939.476344:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304939.476351:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304939.796728:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785735936:0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.796807:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304939.796869:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789304939.796876:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785735808:0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.796905:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304939.796926:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785736320:0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.796947:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304939.796974:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785736192:0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.796996:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304939.797015:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304939.797021:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785736064:0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.797042:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304939.797072:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785735936 00000100:00100000:1.0:1789304939.797080:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785735936 00000100:00100000:1.0:1789304939.797151:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785736320 00000100:00100000:1.0:1789304939.797155:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785736320 00000100:00100000:1.0:1789304939.797183:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1789304939.797191:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785735936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.797247:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785735936:12345-0@lo:400:kworker.0 Request processed in 56us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304939.797253:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1789304939.797268:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:1.0:1789304939.797274:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785736320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.797300:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785736320:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304939.797305:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:1.0:1789304939.797321:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785735808 00000100:00100000:1.0:1789304939.797324:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785735808 00000100:00100000:1.0:1789304939.797346:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785736192 00000100:00100000:1.0:1789304939.797349:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785736192 00000100:00100000:1.0:1789304939.797364:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785736064 00000100:00100000:1.0:1789304939.797367:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785736064 00000100:00100000:1.0:1789304939.797380:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713 00000100:00100000:1.0:1789304939.797385:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785735808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.797414:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785735808:12345-0@lo:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304939.797419:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713 00000100:00100000:1.0:1789304939.797430:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714 00000100:00100000:1.0:1789304939.797450:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785736192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.797501:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785736192:12345-0@lo:400:kworker.0 Request processed in 65us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304939.797510:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714 00000100:00100000:1.0:1789304939.797521:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715 00000100:00100000:1.0:1789304939.797526:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785736064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.797553:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785736064:12345-0@lo:400:kworker.0 Request processed in 27us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304939.797558:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715 00000100:00080000:1.0:1789304939.797579:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789304939.797584:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304939.797619:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785736064:0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.797628:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785736192:0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.797653:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785735808:0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.797661:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785736320:0@lo:400:kworker.0 00000100:00100000:1.0:1789304939.797669:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785735936:0@lo:400:kworker.0 00010000:00010000:1.0:1789304939.858783:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304940.882918:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304941.906672:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304942.355448:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785736448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304942.355521:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304942.355667:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785736448 00000100:00100000:3.0:1789304942.355676:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785736448 00000100:00100000:3.0:1789304942.355737:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:3.0:1789304942.355746:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785736448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789304942.355782:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789304942.355855:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304942.356643:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785736448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 894us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304942.356653:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1789304942.356910:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785736448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304942.434770:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304942.438326:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304942.438392:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765659648 00000100:00100000:3.0:1789304942.438402:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765659648 00000100:00100000:3.0:1789304942.438473:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1345 00000100:00100000:3.0:1789304942.438484:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765659648:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304942.438556:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765659648:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 74us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304942.438563:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1345 00000100:00100000:0.0:1789304942.442890:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765659776 00000100:00100000:0.0:1789304942.442907:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765659776 00000100:00100000:1.0:1789304942.446576:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1716 00000100:00100000:1.0:1789304942.446591:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765659776:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:2.0:1789304942.446762:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304942.447818:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765659776:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1225us (13051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304942.447832:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1716 00000020:00000080:0.0:1789304942.870834:0:97340:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc11ac2270 20000000:00000080:0.0:1789304942.870852:0:97340:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c388d5c00 uarg=0000000000000000 00010000:00010000:0.0:1789304942.872085:0:97340:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789304942.872671:0:97340:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789304942.872689:0:97340:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789304942.872719:0:97340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304942.872736:0:97340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297761 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129775a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304942.872745:0:97340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304942.872785:0:97340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129775a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304942.872800:0:97340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297761 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129775a expref: 18 pid: 5847 timeout: 2492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304942.872814:0:97340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97340:1876219785736576:0@lo:104: 00000100:00100000:0.0:1789304942.872882:0:97340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304942.872923:0:97340:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304942.873490:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785736576 00000100:00100000:1.0:1789304942.873500:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785736576 00000100:00100000:1.0:1789304942.873566:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789304942.873576:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:97340:x1876219785736576:12345-0@lo:104: 00010000:00010000:1.0:1789304942.873591:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.873658:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789304942.873665:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:97340:x1876219785736576:12345-0@lo:104: Request processed in 91us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304942.873671:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00010000:1.0:1789304942.873693:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789304942.873802:0:97340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97340:1876219785736576:0@lo:104: 00010000:00010000:0.0:1789304942.873826:0:97340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.873875:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.873883:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304942.873887:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.873896:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304942.873903:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304942.873908:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304942.873948:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.873955:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304942.873977:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.873984:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129775a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297761 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874002:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304942.874004:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304942.874006:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304942.874017:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785736704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304942.874049:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304942.874142:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785736704 00000100:00100000:1.0:1789304942.874147:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785736704 00010000:00010000:1.0:1789304942.874166:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297761 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129775a expref: 19 pid: 5847 timeout: 2492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304942.874507:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789304942.874515:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785736704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304942.874527:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304942.874532:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297761 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129775a expref: 19 pid: 5847 timeout: 2492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874543:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129775a expref: 19 pid: 5847 timeout: 2492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874556:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb7231297761 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129775a expref: 19 pid: 5847 timeout: 2492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874569:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874583:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874598:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874604:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874621:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874628:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874633:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304942.874637:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874644:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874662:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304942.874671:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304942.874842:0:97340:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304942.874851:0:97340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304942.874857:0:97340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa800/0xefc0bb7231297768 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304942.875475:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785736704:12345-0@lo:103:ldlm_bl.0 Request processed in 959us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304942.875483:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789304942.875531:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785736704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304942.932551:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304943.380079:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785736832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304943.380372:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304943.380435:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785736832 00000100:00100000:0.0:1789304943.380445:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785736832 00000100:00100000:0.0:1789304943.380519:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1789304943.380528:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785736832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304943.380561:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304943.380620:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785736832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304943.380627:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1789304943.381151:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785736832:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304943.385111:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304943.956438:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789304944.210963:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789304944.210972:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789304944.210976:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789304944.211024:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304944.211035:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304944.211047:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304944.211079:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785736960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789304944.211187:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304944.211244:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789304944.212654:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785736960 00000100:00100000:1.0:1789304944.212669:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785736960 00000100:00100000:1.0:1789304944.212787:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1789304944.212798:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785736960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304944.212817:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304944.212839:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371800/0xefc0bb7231297776 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129776f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304944.212866:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371800/0xefc0bb7231297776 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129776f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304944.212878:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371800/0xefc0bb7231297776 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129776f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304944.212889:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371800, rc 0) 00000100:00100000:1.0:1789304944.212964:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785736960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304944.212971:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:3.0:1789304944.213150:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785736960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304944.213171:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304944.213181:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789304944.213201:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789304944.213206:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304944.213213:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304944.916955:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785737088:0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917034:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304944.917134:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785737600:0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917164:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304944.917190:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789304944.917195:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785737216:0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917214:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304944.917230:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785737728:0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917248:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304944.917278:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785737344:0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917374:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304944.917406:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304944.917412:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3702ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785737472:0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917435:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304944.917467:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785737088 00000100:00100000:0.0:1789304944.917476:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785737088 00000100:00100000:0.0:1789304944.917523:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1789304944.917532:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785737088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917582:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785737088:12345-0@lo:400:kworker.0 Request processed in 51us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304944.917589:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1789304944.917620:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785737600 00000100:00100000:0.0:1789304944.917625:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785737600 00000100:00100000:0.0:1789304944.917654:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785737216 00000100:00100000:0.0:1789304944.917657:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785737216 00000100:00100000:0.0:1789304944.917672:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785737472 00000100:00100000:0.0:1789304944.917674:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785737472 00000100:00100000:0.0:1789304944.917691:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717 00000100:00100000:0.0:1789304944.917697:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785737600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917732:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785737600:12345-0@lo:400:kworker.0 Request processed in 34us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304944.917738:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717 00000100:00100000:0.0:1789304944.917750:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:0.0:1789304944.917756:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785737216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917784:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785737216:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304944.917790:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00100000:0.0:1789304944.917802:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1719 00000100:00100000:0.0:1789304944.917808:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785737472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917842:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785737472:12345-0@lo:400:kworker.0 Request processed in 35us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304944.917848:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1719 00000100:00100000:0.0:1789304944.917868:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785737728 00000100:00100000:0.0:1789304944.917871:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785737728 00000100:00100000:0.0:1789304944.917896:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1789304944.917903:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785737728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.917932:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785737728:12345-0@lo:400:kworker.0 Request processed in 31us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304944.917942:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1789304944.917951:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785737344 00000100:00100000:0.0:1789304944.917954:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785737344 00000100:00100000:0.0:1789304944.917974:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1789304944.917979:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785737344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.918009:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785737344:12345-0@lo:400:kworker.0 Request processed in 30us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304944.918014:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1789304944.918056:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785737216:0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.918067:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785737728:0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.918075:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785737088:0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.918085:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785737600:0@lo:400:kworker.0 00000100:00080000:0.0:1789304944.918140:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304944.918145:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304944.918165:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3702ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785737472:0@lo:400:kworker.0 00000100:00100000:0.0:1789304944.918175:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785737344:0@lo:400:kworker.0 00010000:00010000:1.0:1789304944.979847:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304946.002949:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789304946.883932:0:97537:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0440e510 20000000:00000080:1.0:1789304946.883952:0:97537:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b01fb3800 uarg=0000000000000000 00010000:00010000:1.0:1789304946.884212:0:97537:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789304946.884228:0:97537:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789304946.884249:0:97537:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304946.884269:0:97537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304946.884290:0:97537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41371800/0xefc0bb7231297776 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129776f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304946.884298:0:97537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304946.884332:0:97537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41371800/0xefc0bb7231297776 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129776f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304946.884345:0:97537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c41371800/0xefc0bb7231297776 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129776f expref: 18 pid: 5846 timeout: 2496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304946.884358:0:97537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97537:1876219785737856:0@lo:104: 00000100:00100000:1.0:1789304946.886145:0:97537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304946.886210:0:97537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c07936b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789304946.886378:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785737856 00000100:00100000:2.0:1789304946.886388:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785737856 00000100:00100000:2.0:1789304946.886454:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789304946.886464:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:97537:x1876219785737856:12345-0@lo:104: 00010000:00010000:2.0:1789304946.886482:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.886538:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789304946.886544:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:97537:x1876219785737856:12345-0@lo:104: Request processed in 83us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304946.886551:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00010000:2.0:1789304946.886575:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304946.886581:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.886588:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789304946.886592:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.886604:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789304946.886611:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304946.886616:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789304946.886648:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.886653:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789304946.886671:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.886690:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb723129776f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297776 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.886705:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304946.886706:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304946.886708:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304946.887167:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785737984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789304946.887211:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304946.887344:0:97537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97537:1876219785737856:0@lo:104: 00010000:00010000:1.0:1789304946.887366:0:97537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304946.887440:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785737984 00000100:00100000:2.0:1789304946.887446:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785737984 00010000:00010000:2.0:1789304946.887466:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41371800/0xefc0bb7231297776 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129776f expref: 19 pid: 5846 timeout: 2496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304946.887493:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1789304946.887500:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c200da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785737984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304946.887511:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304946.887516:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41371800/0xefc0bb7231297776 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129776f expref: 19 pid: 5846 timeout: 2496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887527:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41371800/0xefc0bb7231297776 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129776f expref: 19 pid: 5846 timeout: 2496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887541:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371800/0xefc0bb7231297776 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129776f expref: 19 pid: 5846 timeout: 2496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887553:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887562:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887575:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887581:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887587:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887593:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887597:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370c00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304946.887601:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887607:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887628:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304946.887637:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304946.887667:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c200da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785737984:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304946.887673:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00010000:00010000:1.0:1789304946.887860:0:97537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304946.887868:0:97537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304946.887874:0:97537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370c00/0xefc0bb723129777d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304946.890383:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785737984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789304947.029679:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304947.474323:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304947.474344:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785738112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304947.474418:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304947.474480:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785738112 00000100:00100000:0.0:1789304947.474487:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785738112 00000100:00100000:0.0:1789304947.474538:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1789304947.474546:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785738112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304947.474579:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304947.474623:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785738112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304947.474630:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00080000:0.0:1789304947.474651:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304947.474685:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785738112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304947.553396:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304947.553450:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304947.553582:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765659904 00000100:00100000:1.0:1789304947.553592:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765659904 00000100:00100000:1.0:1789304947.553653:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1348 00000100:00100000:1.0:1789304947.553663:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765659904:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304947.553743:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765659904:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304947.553752:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1348 00000100:00100000:0.0:1789304947.553840:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765660032 00000100:00100000:0.0:1789304947.553845:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765660032 00000100:00100000:0.0:1789304947.553896:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1720 00000100:00100000:0.0:1789304947.553904:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765660032:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304947.553937:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765660032:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 34us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304947.553943:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1720 00000100:00080000:1.0:1789304947.554007:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1789304947.732923:0:97588:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa002b910 20000000:00000080:3.0:1789304947.732942:0:97588:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e77000 uarg=0000000000000000 00010000:00010000:3.0:1789304947.735892:0:97588:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789304947.735914:0:97588:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789304947.735929:0:97588:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304947.735952:0:97588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304947.735967:0:97588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304947.735983:0:97588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304947.735991:0:97588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304947.735997:0:97588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304947.736004:0:97588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304947.736010:0:97588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304947.736014:0:97588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304947.736023:0:97588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304947.736037:0:97588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304947.736044:0:97588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304947.736050:0:97588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231297784 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304948.050448:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789304948.439414:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789304948.439422:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789304948.439427:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789304948.439476:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304948.439489:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304948.439501:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304948.439531:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785738240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789304948.439608:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304948.440119:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c083ecd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789304948.442030:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785738240 00000100:00100000:1.0:1789304948.442045:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785738240 00000100:00100000:1.0:1789304948.442229:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1789304948.442241:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785738240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304948.442260:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304948.442282:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297792 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129778b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304948.442309:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297792 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129778b expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304948.442321:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297792 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129778b expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304948.442330:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370000, rc 0) 00000100:00100000:1.0:1789304948.442429:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785738240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304948.442435:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1789304948.442541:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785738240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789304948.442561:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304948.442571:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789304948.442595:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789304948.442601:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304948.442609:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304948.500227:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789304948.500252:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785738368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304948.500314:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304948.500375:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785738368 00000100:00100000:3.0:1789304948.500384:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785738368 00000100:00100000:3.0:1789304948.500567:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:3.0:1789304948.500577:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785738368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789304948.500613:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789304948.500657:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785738368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304948.500664:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00080000:3.0:1789304948.500686:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304948.500721:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785738368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304949.074900:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304950.034373:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785738880:0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.034464:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304950.034535:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789304950.034542:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785738496:0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.034578:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304950.034604:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785739008:0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.034626:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304950.034652:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785738624:0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.034675:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304950.034691:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785739136:0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.034712:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304950.034728:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304950.034732:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785738752:0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.034749:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304950.034776:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785738880 00000100:00100000:0.0:1789304950.034784:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785738880 00000100:00100000:0.0:1789304950.034848:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785739008 00000100:00100000:0.0:1789304950.034852:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785739008 00000100:00100000:0.0:1789304950.034870:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785738624 00000100:00100000:0.0:1789304950.034873:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785738624 00000100:00100000:0.0:1789304950.034886:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1721 00000100:00100000:0.0:1789304950.034893:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785738880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.034948:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785738880:12345-0@lo:400:kworker.0 Request processed in 54us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304950.034956:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1721 00000100:00100000:0.0:1789304950.034973:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722 00000100:00100000:0.0:1789304950.034979:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785739008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.035005:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785739008:12345-0@lo:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304950.035012:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722 00000100:00100000:0.0:1789304950.035023:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1723 00000100:00100000:0.0:1789304950.035029:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785738624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.035058:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785738624:12345-0@lo:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304950.035067:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1723 00000100:00100000:0.0:1789304950.035126:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785739136 00000100:00100000:0.0:1789304950.035130:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785739136 00000100:00100000:0.0:1789304950.035156:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785738752 00000100:00100000:0.0:1789304950.035158:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785738752 00000100:00100000:0.0:1789304950.035177:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1789304950.035183:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785739136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.035215:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785739136:12345-0@lo:400:kworker.0 Request processed in 32us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304950.035222:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1789304950.035233:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1789304950.035238:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785738752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.035262:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785738752:12345-0@lo:400:kworker.0 Request processed in 24us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304950.035268:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1789304950.035329:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785738752:0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.035355:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785738624:0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.035366:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785739136:0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.035400:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785739008:0@lo:400:kworker.0 00000100:00100000:0.0:1789304950.035410:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785738880:0@lo:400:kworker.0 00000100:00080000:3.0:1789304950.035755:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304950.035760:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304950.035763:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304950.036372:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785738496 00000100:00100000:3.0:1789304950.036380:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785738496 00000100:00100000:3.0:1789304950.036457:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1789304950.036467:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785738496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304950.036539:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785738496:12345-0@lo:400:kworker.0 Request processed in 74us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304950.036545:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1789304950.041751:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785738496:0@lo:400:kworker.0 00010000:00010000:2.0:1789304950.099327:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304951.124491:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304952.151539:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304952.594306:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785739264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304952.594388:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304952.594475:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785739264 00000100:00100000:0.0:1789304952.594482:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785739264 00000100:00100000:0.0:1789304952.594551:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1789304952.594560:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785739264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304952.594707:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304952.594754:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785739264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 195us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304952.594761:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00080000:0.0:1789304952.594781:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304952.594808:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785739264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304952.683591:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304952.683639:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304952.683671:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765660288 00000100:00100000:2.0:1789304952.683681:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765660288 00000100:00100000:2.0:1789304952.683752:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1724 00000100:00100000:2.0:1789304952.683763:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765660288:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304952.683850:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765660288:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304952.683858:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1724 00000100:00100000:2.0:1789304952.683883:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765660160 00000100:00100000:2.0:1789304952.683887:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765660160 00000100:00100000:2.0:1789304952.683912:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1351 00000100:00100000:2.0:1789304952.683919:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765660160:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304952.683947:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765660160:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304952.683953:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1351 00000100:00080000:2.0:1789304952.683979:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304953.171548:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789304953.195591:0:97882:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd71172c40 20000000:00000080:2.0:1789304953.195610:0:97882:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c41255000 uarg=0000000000000000 10000000:01000000:2.0:1789304953.195661:0:97882:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789304953.195689:0:97882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304953.195786:0:97882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297792 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129778b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304953.195796:0:97882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304953.195846:0:97882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297792 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129778b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304953.195863:0:97882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297792 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129778b expref: 18 pid: 5845 timeout: 2502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304953.195880:0:97882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b1bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97882:1876219785739392:0@lo:104: 00000100:00100000:2.0:1789304953.195960:0:97882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304953.196306:0:97882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c11bafa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789304953.196393:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785739392 00000100:00100000:0.0:1789304953.196404:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785739392 00000100:00100000:0.0:1789304953.196499:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789304953.196511:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:97882:x1876219785739392:12345-0@lo:104: 00010000:00010000:0.0:1789304953.196527:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304953.196598:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304953.196604:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:97882:x1876219785739392:12345-0@lo:104: Request processed in 97us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304953.196611:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789304953.196682:0:97882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b1bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97882:1876219785739392:0@lo:104: 00010000:00010000:3.0:1789304953.196717:0:97882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.196826:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304953.196833:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.196845:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304953.196849:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.196857:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304953.196863:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304953.196868:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304953.196906:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.196912:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304953.196935:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.196941:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fa00/0xefc0bb723129778b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297792 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.196957:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304953.196959:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304953.196960:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304953.196967:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789304953.196977:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785739520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304953.197017:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304953.197057:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785739520 00000100:00100000:1.0:1789304953.197061:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785739520 00010000:00010000:1.0:1789304953.197081:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297792 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129778b expref: 19 pid: 5845 timeout: 2502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304953.197129:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1789304953.197136:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785739520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304953.197147:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304953.197151:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297792 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129778b expref: 19 pid: 5845 timeout: 2502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197161:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297792 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129778b expref: 19 pid: 5845 timeout: 2502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197174:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297792 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129778b expref: 19 pid: 5845 timeout: 2502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197186:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197194:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197209:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197217:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197223:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197229:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197236:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304953.197240:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197247:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197257:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304953.197266:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304953.197294:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785739520:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304953.197300:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1789304953.197342:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785739520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304953.197471:0:97882:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304953.197480:0:97882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304953.197486:0:97882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231297799 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304953.625010:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785739648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304953.625118:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304953.625399:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785739648 00000100:00100000:0.0:1789304953.625407:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785739648 00000100:00100000:0.0:1789304953.625505:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1789304953.625514:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785739648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304953.625549:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304953.625591:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785739648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304953.625597:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1789304953.625632:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785739648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304953.626026:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789304954.082047:0:97930:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6916a420 20000000:00000080:1.0:1789304954.082066:0:97930:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b01fb0800 uarg=0000000000000000 10000000:01000000:1.0:1789304954.082141:0:97930:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789304954.082165:0:97930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.082185:0:97930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.082196:0:97930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.082204:0:97930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.082212:0:97930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.082220:0:97930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.082227:0:97930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304954.082231:0:97930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.082239:0:97930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.082251:0:97930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.082259:0:97930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.082266:0:97930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370a00/0xefc0bb72312977a0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304954.198998:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789304954.387271:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789304954.387279:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789304954.387285:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789304954.387344:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304954.387368:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304954.387380:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304954.387407:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785739776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789304954.387497:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304954.387550:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388359c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789304954.387836:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785739776 00000100:00100000:3.0:1789304954.387846:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785739776 00000100:00100000:3.0:1789304954.387906:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1789304954.387916:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785739776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304954.387930:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304954.387946:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312977ae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312977a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304954.387976:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312977ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312977a7 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304954.387988:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312977ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312977a7 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304954.387999:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ec00, rc 0) 00000100:00100000:3.0:1789304954.388080:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785739776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304954.388087:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1789304954.388166:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785739776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304954.388183:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.388191:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304954.388215:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304954.388220:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304954.388228:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304955.155018:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785740160:0@lo:400:kworker.0 00000100:00100000:0.0:1789304955.155107:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304955.155166:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304955.155172:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785740288:0@lo:400:kworker.0 00000100:00100000:0.0:1789304955.155197:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304955.155232:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785740160 00000100:00100000:0.0:1789304955.155240:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785740160 00000100:00100000:0.0:1789304955.155302:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785740288 00000100:00100000:0.0:1789304955.155305:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785740288 00000100:00100000:0.0:1789304955.155333:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725 00000100:00100000:3.0:1789304955.155421:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785740032:0@lo:400:kworker.0 00000100:00100000:3.0:1789304955.155452:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304955.155481:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789304955.155486:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785739904:0@lo:400:kworker.0 00000100:00100000:3.0:1789304955.155506:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304955.155519:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785740416:0@lo:400:kworker.0 00000100:00100000:3.0:1789304955.155558:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304955.155586:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785740032 00000100:00100000:3.0:1789304955.155589:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785740032 00000100:00100000:3.0:1789304955.155614:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785740416 00000100:00100000:3.0:1789304955.155616:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785740416 00000100:00100000:3.0:1789304955.155631:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1789304955.155638:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785740032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304955.155685:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785740032:12345-0@lo:400:kworker.0 Request processed in 48us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304955.155692:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1789304955.155708:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1789304955.155714:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785740416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304955.155736:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785740416:12345-0@lo:400:kworker.0 Request processed in 24us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304955.155742:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1789304955.155757:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785739904 00000100:00100000:3.0:1789304955.155760:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785739904 00000100:00100000:3.0:1789304955.155773:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:3.0:1789304955.155779:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785740288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304955.155808:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785740288:12345-0@lo:400:kworker.0 Request processed in 30us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304955.155814:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00000100:00100000:3.0:1789304955.155824:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:3.0:1789304955.155829:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785739904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304955.155848:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785739904:12345-0@lo:400:kworker.0 Request processed in 20us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304955.155853:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00100000:3.0:1789304955.155894:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785739904:0@lo:400:kworker.0 00000100:00100000:3.0:1789304955.155902:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785740416:0@lo:400:kworker.0 00000100:00100000:3.0:1789304955.155909:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785740032:0@lo:400:kworker.0 00000100:00100000:3.0:1789304955.155933:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785740288:0@lo:400:kworker.0 00000100:00080000:1.0:1789304955.156006:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304955.156010:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789304955.156013:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304955.156045:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785740160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304955.156085:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785740160:12345-0@lo:400:kworker.0 Request processed in 745us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304955.156117:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725 00000100:00100000:3.0:1789304955.156665:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785740160:0@lo:400:kworker.0 00010000:00010000:2.0:1789304955.221486:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304956.242299:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304957.129196:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304957.131695:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765660416 00000100:00100000:3.0:1789304957.131714:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765660416 00000100:00100000:3.0:1789304957.131812:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1111 00000100:00100000:3.0:1789304957.131824:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:57325:x1876219765660416:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304957.131846:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304957.131873:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312977b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100818 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.131951:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312977bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.131970:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312977bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.131988:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312977bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304957.132030:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789304957.132035:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304957.132066:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312977bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.132123:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb72312977b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100818 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.132137:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312977bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100818 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.132143:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304957.132145:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304957.132157:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f200, rc 0) 00000100:00100000:3.0:1789304957.132210:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:57325:x1876219765660416:12345-192.168.202.29@tcp:101:rm.0 Request processed in 390us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304957.132216:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1111 00000100:00080000:1.0:1789304957.132905:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304957.142154:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304957.142684:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765660544 00000100:00100000:0.0:1789304957.142696:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765660544 00000100:00100000:0.0:1789304957.142765:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1112 00000100:00100000:0.0:1789304957.142777:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:57325:x1876219765660544:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304957.142799:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304957.142822:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312977c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610081f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.142885:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312977ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.142901:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312977ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.142916:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312977ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.142983:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312977d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.142991:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312977d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.142999:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312977d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145439:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312977ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145455:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312977ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145461:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312977ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145465:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304957.145469:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312977ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145479:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312977ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145494:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:0.0:1789304957.145496:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304957.145501:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312977ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145505:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb72312977ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145516:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312977d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145520:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312977d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145524:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312977d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145527:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304957.145528:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312977d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145531:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312977d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145535:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c0558d700) 00010000:00010000:0.0:1789304957.145537:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304957.145539:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312977d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.145549:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb72312977d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.146502:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312977c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610081f expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.146518:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:0.0:1789304957.146521:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304957.146524:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb72312977c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610081f expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304957.146534:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbc00, rc 0) 00000100:00100000:1.0:1789304957.147435:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:57325:x1876219765660544:12345-192.168.202.29@tcp:101:rm.0 Request processed in 4648us (5335us total) trans 0 rc 301/301 00000100:00100000:1.0:1789304957.147449:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1112 00000100:00100000:3.0:1789304957.234471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304957.234522:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304957.234612:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765660672 00000100:00100000:2.0:1789304957.234625:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765660672 00000100:00100000:2.0:1789304957.234685:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765660928 00000100:00100000:2.0:1789304957.234688:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765660928 00000100:00100000:2.0:1789304957.234722:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1113 00000100:00100000:2.0:1789304957.234732:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765660672:12345-192.168.202.29@tcp:41:mkdir.0 00000004:00000024:2.0:1789304957.234788:0:7654:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1789304957.234862:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765660672:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 131us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304957.234869:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1113 00000100:00100000:2.0:1789304957.234888:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1114 00000100:00100000:2.0:1789304957.234895:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:57329:x1876219765660928:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:2.0:1789304957.234933:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304957.234959:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb72312977bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100818 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304957.234981:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:2.0:1789304957.234993:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304957.235953:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312977d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304957.235973:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312977d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304957.235985:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312977d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304957.235998:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304957.236005:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304957.236013:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304957.237859:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00010000:3.0:1789304957.237878:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312977d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.237889:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312977d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.237897:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312977d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.237903:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304957.237908:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312977d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.237916:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312977d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.237930:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:3.0:1789304957.237933:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304957.237938:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312977d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.237945:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb72312977d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304957.237965:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d1cdc43 reply state 0000000010204357 transno 4294967721 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304957.237980:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304957.238082:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:57329:x1876219765660928:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 3182us (3554us total) trans 4294967721 rc 0/0 00000100:00100000:3.0:1789304957.238115:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1114 00010000:00010000:1.0:1789304957.241086:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.241285:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.241297:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.241304:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304957.241309:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.241332:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.241351:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c421d2b00) 00010000:00010000:1.0:1789304957.241354:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304957.241359:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.241366:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb72312977df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304957.266415:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304957.299052:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304957.299132:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765661056 00000100:00100000:0.0:1789304957.299144:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765661056 00000100:00100000:1.0:1789304957.299420:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1115 00000100:00100000:1.0:1789304957.299432:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:57333:x1876219765661056:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:1.0:1789304957.299460:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304957.299484:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312977e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100826 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.299549:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312977ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.299564:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312977ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.299576:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312977ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304957.299616:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789304957.299620:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304957.299647:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312977ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.299673:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370600/0xefc0bb72312977e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100826 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.299693:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312977ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100826 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.299700:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:1.0:1789304957.299704:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304957.299707:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371200, rc 0) 00000100:00100000:1.0:1789304957.299781:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:57333:x1876219765661056:12345-192.168.202.29@tcp:101:chown.0 Request processed in 352us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304957.299788:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1115 00000100:00100000:3.0:1789304957.303453:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304957.303606:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765661184 00000100:00100000:1.0:1789304957.303617:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765661184 00000100:00100000:1.0:1789304957.303679:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1116 00000100:00100000:1.0:1789304957.303689:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:57333:x1876219765661184:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:1.0:1789304957.303709:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304957.303729:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312977f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610082d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.303866:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312977fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.303882:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312977fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.303898:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312977fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.303912:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297802 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.303918:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.303925:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304027:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304036:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304043:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304957.304073:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:1.0:1789304957.304076:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304957.304124:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304136:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312977fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304144:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312977fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304155:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312977fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304160:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304957.304164:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312977fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304171:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312977fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304182:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:1.0:1789304957.304186:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304957.304190:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312977fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304197:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb72312977fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304209:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304215:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297802 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304220:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304226:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371c00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304957.304229:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304239:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297802 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304246:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c14adda00) 00010000:00010000:1.0:1789304957.304248:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304957.304250:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297802 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304256:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297802 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304293:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb72312977f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610082d expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304307:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610082d expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.304315:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:1.0:1789304957.304318:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304957.304320:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371800, rc 0) 00000100:00100000:1.0:1789304957.304375:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:57333:x1876219765661184:12345-192.168.202.29@tcp:101:chown.0 Request processed in 687us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304957.304381:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1116 00000100:00100000:2.0:1789304957.307536:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304957.307610:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765661440 00000100:00100000:3.0:1789304957.307620:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765661440 00000100:00100000:3.0:1789304957.307674:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1117 00000100:00100000:3.0:1789304957.307682:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:57333:x1876219765661440:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:3.0:1789304957.307730:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304957.307765:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610082d expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.307784:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c14add500) 00010000:00010000:3.0:1789304957.307796:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304957.307822:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.307835:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304957.307844:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304957.308057:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d68649b reply state 00000000d105b43b transno 4294967722 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304957.308067:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304957.308075:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000100:00100000:2.0:1789304957.309808:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:57333:x1876219765661440:12345-192.168.202.29@tcp:36:chown.0 Request processed in 2116us (2278us total) trans 4294967722 rc 0/0 00000100:00100000:2.0:1789304957.309820:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1117 00010000:00010000:1.0:1789304957.312847:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.312871:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.312884:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.312890:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304957.312896:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.312904:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.312924:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:1.0:1789304957.312928:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304957.312933:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304957.312940:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297810 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304957.717340:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304957.717366:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785740544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304957.717438:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304957.717527:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785740544 00000100:00100000:1.0:1789304957.717536:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785740544 00000100:00100000:1.0:1789304957.717599:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1789304957.717610:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785740544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304957.717653:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304957.717703:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785740544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304957.717710:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00080000:1.0:1789304957.717733:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304957.717772:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785740544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304957.793353:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304957.793395:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304957.795032:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765661568 00000100:00100000:0.0:1789304957.795051:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765661568 00000100:00100000:0.0:1789304957.795135:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1353 00000100:00100000:1.0:1789304957.795211:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765661696 00000100:00100000:1.0:1789304957.795217:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765661696 00000100:00100000:1.0:1789304957.795254:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1728 00000100:00100000:1.0:1789304957.795265:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765661696:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304957.795372:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765661696:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 108us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304957.795380:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1728 00000100:00100000:0.0:1789304957.795582:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765661568:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304957.795614:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765661568:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 36us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304957.810463:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1353 00000020:00000080:3.0:1789304958.091850:0:98126:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfd030340 20000000:00000080:3.0:1789304958.091869:0:98126:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c420db800 uarg=0000000000000000 10000000:01000000:3.0:1789304958.091918:0:98126:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304958.091940:0:98126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.091959:0:98126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312977ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312977a7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.091968:0:98126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.092411:0:98126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312977ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312977a7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.092428:0:98126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312977ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312977a7 expref: 18 pid: 5847 timeout: 2507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304958.092444:0:98126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd41c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98126:1876219785740672:0@lo:104: 00000100:00100000:3.0:1789304958.092518:0:98126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304958.092620:0:98126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3874ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789304958.092668:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785740672 00000100:00100000:0.0:1789304958.092677:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785740672 00000100:00100000:0.0:1789304958.092785:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789304958.092795:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:98126:x1876219785740672:12345-0@lo:104: 00010000:00010000:0.0:1789304958.092812:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304958.092891:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789304958.092898:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:98126:x1876219785740672:12345-0@lo:104: Request processed in 105us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304958.092905:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789304958.092974:0:98126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd41c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98126:1876219785740672:0@lo:104: 00010000:00010000:3.0:1789304958.093013:0:98126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093073:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304958.093081:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093124:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789304958.093129:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093144:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789304958.093152:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304958.093159:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789304958.093193:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093200:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789304958.093224:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093232:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40eccc00/0xefc0bb72312977a7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312977ae expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093248:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304958.093249:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304958.093251:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304958.093283:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785740800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789304958.093342:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304958.093386:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785740800 00000100:00100000:1.0:1789304958.093390:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785740800 00010000:00010000:1.0:1789304958.093411:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312977ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312977a7 expref: 19 pid: 5847 timeout: 2507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304958.093434:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1789304958.093441:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785740800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789304958.093451:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304958.093456:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312977ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312977a7 expref: 19 pid: 5847 timeout: 2507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093466:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312977ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312977a7 expref: 19 pid: 5847 timeout: 2507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093480:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312977ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312977a7 expref: 19 pid: 5847 timeout: 2507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093495:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093508:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093522:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093529:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093535:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093541:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093546:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304958.093551:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093559:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093570:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.093578:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304958.093608:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785740800:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304958.093614:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1789304958.093644:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785740800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789304958.093733:0:98126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.093746:0:98126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.093753:0:98126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297817 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304958.291387:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304958.738446:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304958.738473:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785740928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304958.738547:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304958.738725:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785740928 00000100:00100000:0.0:1789304958.738734:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785740928 00000100:00100000:0.0:1789304958.738806:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1789304958.738817:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785740928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304958.738861:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304958.738913:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785740928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304958.738921:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1789304958.738972:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785740928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789304958.739195:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789304958.870413:0:98174:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd41739160 20000000:00000080:3.0:1789304958.870433:0:98174:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c420db800 uarg=0000000000000000 10000000:01000000:3.0:1789304958.870479:0:98174:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789304958.870502:0:98174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.870519:0:98174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.870530:0:98174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.870536:0:98174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.870544:0:98174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.870550:0:98174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.870556:0:98174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304958.870561:0:98174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.870574:0:98174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.870588:0:98174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.870596:0:98174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304958.870602:0:98174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129781e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304959.314436:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789304959.571632:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789304959.571642:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789304959.571648:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789304959.571700:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304959.571713:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304959.571726:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304959.571755:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785741056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789304959.571841:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304959.571907:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0b409480 going to sleep for 11 seconds 00000100:00100000:3.0:1789304959.571977:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785741056 00000100:00100000:3.0:1789304959.571987:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785741056 00000100:00100000:3.0:1789304959.572086:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1789304959.572126:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785741056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789304959.572141:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304959.572157:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129782c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297825 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304959.572184:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129782c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297825 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304959.572198:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129782c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297825 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304959.572208:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fe00, rc 0) 00000100:00100000:3.0:1789304959.572267:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785741056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304959.572276:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1789304959.572804:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785741056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789304959.572821:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304959.572831:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789304959.572852:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789304959.572858:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304959.572865:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304960.274700:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304960.274767:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789304960.274789:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785741312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304960.274861:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304960.275288:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785741184:0@lo:400:kworker.0 00000100:00100000:3.0:1789304960.275390:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304960.275565:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785741312 00000100:00100000:3.0:1789304960.275574:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785741312 00000100:00100000:3.0:1789304960.275631:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1789304960.275640:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785741312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304960.275699:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785741312:12345-0@lo:400:kworker.0 Request processed in 60us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304960.275707:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00080000:3.0:1789304960.275729:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304960.275763:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785741312:0@lo:400:kworker.0 00000100:00100000:1.0:1789304960.275824:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785741184 00000100:00100000:1.0:1789304960.275828:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785741184 00000100:00100000:1.0:1789304960.275866:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1729 00000100:00100000:1.0:1789304960.275874:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785741184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304960.275911:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785741184:12345-0@lo:400:kworker.0 Request processed in 38us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304960.275918:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1729 00000100:00100000:3.0:1789304960.275996:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785741184:0@lo:400:kworker.0 00000100:00100000:0.0:1789304960.277178:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785741440:0@lo:400:kworker.0 00000100:00100000:1.0:1789304960.277204:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785741696:0@lo:400:kworker.0 00000100:00100000:1.0:1789304960.277230:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304960.277230:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304960.277291:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785741568:0@lo:400:kworker.0 00000100:00100000:0.0:1789304960.279108:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785741440 00000100:00100000:0.0:1789304960.279123:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785741440 00000100:00100000:0.0:1789304960.279183:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730 00000100:00100000:0.0:1789304960.279192:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785741440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304960.279288:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785741440:12345-0@lo:400:kworker.0 Request processed in 97us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304960.279296:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730 00000100:00100000:0.0:1789304960.279433:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785741440:0@lo:400:kworker.0 00000100:00100000:3.0:1789304960.279689:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304960.279781:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785741696 00000100:00100000:3.0:1789304960.279786:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785741696 00000100:00100000:3.0:1789304960.279819:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:3.0:1789304960.279827:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785741696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304960.279871:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785741696:12345-0@lo:400:kworker.0 Request processed in 45us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304960.279877:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00080000:3.0:1789304960.279899:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304960.279903:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304960.279930:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785741696:0@lo:400:kworker.0 00000100:00100000:0.0:1789304960.294967:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785741568 00000100:00100000:0.0:1789304960.294985:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785741568 00000100:00100000:0.0:1789304960.295077:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1731 00000100:00100000:0.0:1789304960.295105:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785741568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304960.295198:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785741568:12345-0@lo:400:kworker.0 Request processed in 112us (15509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304960.295205:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1731 00000100:00100000:1.0:1789304960.295241:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785741568:0@lo:400:kworker.0 00000100:00080000:3.0:1789304960.295319:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304960.351454:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304961.363811:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304961.951438:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304961.951529:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765661824 00000100:00100000:0.0:1789304961.951539:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765661824 00000100:00100000:0.0:1789304961.951619:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:0.0:1789304961.951629:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:5593:x1876219765661824:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789304961.951643:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304961.951667:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb72312977ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100826 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304961.951685:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:0.0:1789304961.951696:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304961.951743:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:5593:x1876219765661824:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 116us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304961.951750:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00080000:3.0:1789304961.951892:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789304962.388730:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304962.415715:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967722 is committed 00000100:00100000:3.0:1789304962.696029:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304962.696146:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765661952 00000100:00100000:3.0:1789304962.696170:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765661952 00000100:00100000:3.0:1789304962.696233:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1118 00000100:00100000:3.0:1789304962.696244:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:57438:x1876219765661952:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789304962.696265:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304962.696414:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100834 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.696480:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129783a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.696494:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129783a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.696509:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129783a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304962.696551:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789304962.696555:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304962.696579:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129783a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.696607:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100834 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.696629:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129783a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100834 expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.696638:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304962.696641:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789304962.696646:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ee00, rc 0) 00000100:00100000:3.0:1789304962.696711:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:57438:x1876219765661952:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 469us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304962.696719:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1118 00000100:00100000:3.0:1789304962.699961:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304962.700035:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765662080 00000100:00100000:2.0:1789304962.700045:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765662080 00000100:00100000:2.0:1789304962.700119:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1119 00000100:00100000:2.0:1789304962.700129:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:57438:x1876219765662080:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304962.700149:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304962.700170:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610083b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700244:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297848 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700258:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297848 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700269:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297848 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700567:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129784f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700575:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129784f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700582:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129784f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700887:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297856 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700897:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700905:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304962.700938:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:2.0:1789304962.700942:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304962.700963:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297856 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700976:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297848 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700983:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297848 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700989:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297848 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.700999:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304962.701004:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297848 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701011:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297848 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701023:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:2.0:1789304962.701026:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304962.701031:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701037:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701047:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129784f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701054:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129784f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701060:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129784f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701065:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304962.701068:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129784f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701074:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129784f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701085:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304962.701198:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304962.701202:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129784f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701209:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb723129784f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701256:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610083b expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701639:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297856 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610083b expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.701648:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:2.0:1789304962.701651:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304962.701653:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecca00, rc 0) 00000100:00100000:2.0:1789304962.701773:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:57438:x1876219765662080:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 1644us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304962.701781:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1119 00000100:00100000:3.0:1789304962.708382:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304962.708926:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765662336 00000100:00100000:0.0:1789304962.708938:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765662336 00000100:00100000:0.0:1789304962.708991:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1120 00000100:00100000:0.0:1789304962.709001:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:57438:x1876219765662336:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304962.709049:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304962.709075:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297856 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610083b expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.709116:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c421d2e00) 00010000:00010000:0.0:1789304962.709129:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304962.709165:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.709178:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.709189:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789304962.743709:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967723 is committed 00000004:00010000:0.0:1789304962.743754:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d310bffc reply state 000000005368fb49 transno 4294967723 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304962.743768:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304962.743782:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00080000:0.0:1789304962.743884:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789304962.743904:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:57438:x1876219765662336:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 34900us (35529us total) trans 4294967723 rc 0/0 00000100:00100000:0.0:1789304962.743912:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1120 00010000:00010000:0.0:1789304962.743948:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.743957:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.743965:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.743975:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304962.743980:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.743988:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.744004:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:0.0:1789304962.744007:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789304962.744012:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.744019:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb723129785d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304962.823931:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304962.824138:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765662464 00000100:00100000:1.0:1789304962.824150:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765662464 00000100:00100000:1.0:1789304962.824228:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1121 00000100:00100000:1.0:1789304962.824239:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:57442:x1876219765662464:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789304962.824263:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304962.824291:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297864 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100842 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824350:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129786b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824368:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129786b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824379:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129786b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824394:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297872 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824401:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824408:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824723:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824730:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824736:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304962.824764:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:1.0:1789304962.824766:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304962.824785:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824794:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129786b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824801:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129786b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824806:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129786b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824810:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304962.824813:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129786b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824818:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129786b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824826:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:1.0:1789304962.824829:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304962.824832:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129786b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824837:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371a00/0xefc0bb723129786b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824842:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297872 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824846:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297872 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824849:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297872 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824852:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304962.824855:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297872 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824858:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297872 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824862:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c14adde00) 00010000:00010000:1.0:1789304962.824863:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304962.824864:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297872 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824867:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297872 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824885:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100842 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824893:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100842 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304962.824897:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:1.0:1789304962.824898:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789304962.824900:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371600, rc 0) 00000100:00100000:1.0:1789304962.824961:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:57442:x1876219765662464:12345-192.168.202.29@tcp:101:touch.0 Request processed in 724us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304962.824968:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1121 00000100:00100000:3.0:1789304962.830853:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304962.831049:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765662720 00000100:00100000:2.0:1789304962.831060:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765662720 00000100:00100000:2.0:1789304962.831139:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1122 00000100:00100000:2.0:1789304962.831148:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:57442:x1876219765662720:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789304962.831169:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304962.831190:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297880 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100849 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.831683:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.831700:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.831711:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.831725:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.831732:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.831738:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304962.835997:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785741824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304962.836071:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304962.836180:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785741824 00000100:00100000:1.0:1789304962.836189:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785741824 00000100:00100000:1.0:1789304962.836881:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1789304962.836897:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785741824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304962.836944:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304962.837011:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785741824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304962.837018:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00080000:1.0:1789304962.837043:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304962.837412:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785741824:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1789304962.844995:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23:0x0], index 0: 0 00010000:00010000:3.0:1789304962.847726:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847750:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847762:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847806:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847817:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297887 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847824:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847830:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304962.847835:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847842:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297887 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847855:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:3.0:1789304962.847858:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304962.847864:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297887 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847870:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297887 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304962.847881:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a975c11e reply state 00000000a5c58ccf transno 4294967724 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304962.847890:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304962.847937:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297880 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100849 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847953:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100849 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.847966:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:3.0:1789304962.847969:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304962.847971:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f800, rc 0) 00000100:00100000:3.0:1789304962.848043:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:57442:x1876219765662720:12345-192.168.202.29@tcp:101:touch.0 Request processed in 16895us (17198us total) trans 4294967724 rc 0/0 00000100:00100000:3.0:1789304962.848052:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1122 00010000:00010000:2.0:1789304962.853851:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.853869:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.853878:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.853884:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304962.853890:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.853903:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.853921:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789304962.853924:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304962.853929:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.853936:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb723129788e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304962.858412:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304962.860562:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765662976 00000100:00100000:0.0:1789304962.860580:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765662976 00000100:00100000:0.0:1789304962.860713:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1123 00000100:00100000:0.0:1789304962.860722:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:57442:x1876219765662976:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:0.0:1789304962.860778:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304962.860807:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100849 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.860823:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9e2c2ea19800) 00010000:00010000:0.0:1789304962.860833:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304962.860873:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.860884:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304962.860893:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304962.861035:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ff35863 reply state 000000007956646a transno 4294967725 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304962.861044:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304962.861911:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:57442:x1876219765662976:12345-192.168.202.29@tcp:36:touch.0 Request processed in 542us (2858us total) trans 4294967725 rc 0/0 00000100:00100000:0.0:1789304962.861925:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1123 00010000:00010000:2.0:1789304962.863564:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.863577:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.863583:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.863588:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304962.863591:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.863596:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.863608:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:2.0:1789304962.863610:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304962.863614:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304962.863622:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb72312978a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304962.868688:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304962.868772:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765663104 00000100:00100000:3.0:1789304962.868785:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765663104 00000100:00100000:3.0:1789304962.868853:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1124 00000100:00100000:3.0:1789304962.868864:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:57442:x1876219765663104:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304962.868893:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304962.868933:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312978aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100850 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.869007:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312978aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100850 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.869024:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312978aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100850 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304962.869046:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304962.869049:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789304962.869053:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789304962.869147:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:57442:x1876219765663104:12345-192.168.202.29@tcp:101:touch.0 Request processed in 283us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304962.869157:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1124 00000100:00100000:1.0:1789304962.878302:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304962.878399:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765663232 00000100:00100000:3.0:1789304962.878410:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765663232 00000100:00100000:3.0:1789304962.878460:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 611 00000100:00100000:3.0:1789304962.878469:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876219765663232:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:3.0:1789304962.878511:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 2412 last 0 00000020:00000080:3.0:1789304962.878545:0:6693:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb72312978b1 00002000:00100000:3.0:1789304962.878557:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c04ebd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789304962.878581:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789304962.878815:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789304962.878845:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2c04ebf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789304962.878928:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765663232:12345-192.168.202.29@tcp:8:touch.0 Request processed in 459us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304962.878936:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 611 00000100:00100000:1.0:1789304962.881277:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304962.881370:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765663360 00000100:00100000:3.0:1789304962.881382:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765663360 00000100:00100000:3.0:1789304962.881487:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 612 00000100:00100000:3.0:1789304962.881499:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765663360:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:1.0:1789304962.882024:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789304962.913272:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304962.915147:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765663488 00000100:00100000:3.0:1789304962.915161:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765663488 00000100:00100000:3.0:1789304962.915234:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1355 00000100:00100000:3.0:1789304962.915245:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765663488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304962.915327:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765663488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304962.915335:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1355 00000001:00080000:1.0:1789304962.940194:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00000001:00100000:1.0:1789304962.940213:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:3.0:1789304962.940406:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:0:x1876219765663360:12345-192.168.202.29@tcp:2:touch.0 Request processed in 58903us (59133us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789304962.940418:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 612 00000100:00100000:3.0:1789304962.942999:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304962.943165:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765663744 00000100:00100000:1.0:1789304962.943177:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765663744 00000100:00100000:1.0:1789304962.943247:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 114 00000100:00100000:1.0:1789304962.943258:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:57442:x1876219765663744:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:1.0:1789304962.943802:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:57442:x1876219765663744:12345-192.168.202.29@tcp:35:touch.0 Request processed in 543us (810us total) trans 4294967726 rc 0/0 00000100:00100000:1.0:1789304962.943809:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 114 00000100:00100000:1.0:1789304963.025533:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304963.029414:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765663872 00000100:00100000:3.0:1789304963.029432:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765663872 00000100:00100000:3.0:1789304963.029601:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1125 00000100:00100000:3.0:1789304963.029613:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:57446:x1876219765663872:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304963.029640:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304963.029664:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312978b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100857 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.029737:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312978bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.029756:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312978bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.029769:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312978bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.029785:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312978c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.029791:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312978c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.029798:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312978c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.029908:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312978cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.029917:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312978cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.029923:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312978cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304963.033645:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 0 00000004:00200000:3.0:1789304963.033656:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304963.033690:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312978cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033711:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312978cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033722:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312978bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033729:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312978bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033736:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312978bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033742:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304963.033747:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312978bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033754:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312978bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033769:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:3.0:1789304963.033772:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304963.033778:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312978bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033784:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312978bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033805:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312978c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033811:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312978c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033816:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312978c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033821:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304963.033824:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312978c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033830:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312978c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033837:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304963.033840:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304963.033843:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312978c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033849:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb72312978c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033898:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312978b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100857 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033913:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312978cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100857 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.033920:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789304963.033922:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304963.033925:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e200, rc 0) 00000100:00100000:3.0:1789304963.034124:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:57446:x1876219765663872:12345-192.168.202.29@tcp:101:rm.0 Request processed in 4513us (8601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304963.034133:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1125 00000100:00080000:1.0:1789304963.035159:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304963.037402:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304963.037545:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765664000 00000100:00100000:0.0:1789304963.037557:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765664000 00000100:00100000:0.0:1789304963.037618:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 613 00000100:00100000:0.0:1789304963.037654:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765664000:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304963.037671:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304963.037690:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e9d9e5e/0xefc0bb72312978d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610085e expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304963.037718:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x6aa6a083, atime: 0x6aa6a083, ctime: 0x6aa6a083, blocks: 0x1 00010000:00010000:0.0:1789304963.037740:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=2412s v=(0 0) 00010000:00010000:0.0:1789304963.037744:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304963.037752:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e9d9e5e/0xefc0bb72312978d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610085e expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.037772:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e9d9e5e/0xefc0bb72312978d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610085e expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.037790:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa200, rc 0) 00000100:00100000:0.0:1789304963.037852:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765664000:12345-192.168.202.29@tcp:101:rm.0 Request processed in 200us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304963.037859:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 613 00000100:00100000:3.0:1789304963.041403:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304963.041496:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765664256 00000100:00100000:0.0:1789304963.041507:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765664256 00000100:00100000:0.0:1789304963.041568:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1126 00000100:00100000:0.0:1789304963.041580:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:57446:x1876219765664256:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:0.0:1789304963.041629:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304963.041659:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb72312978cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100857 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.041681:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb72312978aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100850 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.041692:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:0.0:1789304963.041704:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304963.041728:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.041741:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.041751:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.041768:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.041776:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.041783:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.041881:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312978e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.041889:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312978e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.041910:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312978e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789304963.043238:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].35, 64 off10432 00000004:00080000:0.0:1789304963.043251:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2412721160182ns, next at 2413721157116ns, rc = 0 00010000:00010000:0.0:1789304963.043321:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043335:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043344:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043353:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043360:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043370:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043389:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789304963.043413:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312978e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043420:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312978e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043427:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312978e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043433:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304963.043437:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312978e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043444:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312978e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043456:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:0.0:1789304963.043459:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789304963.043464:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312978e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043470:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb72312978e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043488:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043494:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043500:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043505:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304963.043508:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043514:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043522:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:0.0:1789304963.043524:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304963.043527:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.043533:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304963.043542:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a582bcd4 reply state 00000000dbd8ed6d transno 4294967727 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304963.043551:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304963.043631:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:57446:x1876219765664256:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2051us (2237us total) trans 4294967727 rc 0/0 00000100:00100000:0.0:1789304963.043640:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1126 00010000:00010000:1.0:1789304963.043944:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789304963.043952:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304963.043963:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789304963.043967:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304963.043973:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304963.043983:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:1.0:1789304963.043986:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789304963.043989:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304963.043994:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb72312978f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304963.044009:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304963.044011:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304963.044013:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304963.048512:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.048531:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.048545:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.048552:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304963.048557:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.048564:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.048579:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789304963.048582:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304963.048587:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.048593:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304963.411010:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304963.864598:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785741952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304963.864669:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304963.864775:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785741952 00000100:00100000:2.0:1789304963.864785:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785741952 00000100:00100000:2.0:1789304963.864850:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1789304963.864860:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785741952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304963.864881:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304963.864929:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785741952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304963.864936:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00080000:0.0:1789304963.868444:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304963.868529:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785741952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304963.949462:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304963.949536:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765664384 00000100:00100000:0.0:1789304963.949547:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765664384 00000100:00100000:0.0:1789304963.949612:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1127 00000100:00100000:0.0:1789304963.949623:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:57461:x1876219765664384:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304963.949645:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304963.949664:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100865 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.949730:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.949746:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.949758:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304963.949794:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:0.0:1789304963.949798:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304963.949819:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.949845:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb72312978f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100865 expref: 13 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.949862:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100865 expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304963.949871:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:0.0:1789304963.949874:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304963.949878:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afba00, rc 0) 00000100:00100000:0.0:1789304963.949940:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:57461:x1876219765664384:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 319us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304963.949948:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1127 00000100:00100000:1.0:1789304963.955556:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304963.955618:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765664640 00000100:00100000:3.0:1789304963.955628:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765664640 00000100:00100000:3.0:1789304963.955679:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1128 00000100:00100000:3.0:1789304963.955689:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:57461:x1876219765664640:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304963.955736:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304963.955765:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb72312978fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100865 expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.955785:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100842 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.955800:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:3.0:1789304963.955810:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304963.955835:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.955848:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304963.955857:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789304964.031910:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967727 is committed 00000004:00080000:2.0:1789304964.031927:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 92 committed 00000001:00080000:2.0:1789304964.031958:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967728 is committed 00000100:00100000:2.0:1789304964.032165:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785742080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789304964.032249:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304964.032352:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785742080 00000100:00100000:0.0:1789304964.032363:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785742080 00000100:00100000:0.0:1789304964.032419:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1789304964.032429:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785742080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789304964.032458:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:35 count 1 00010000:00010000:0.0:1789304964.032485:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.032508:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e9d9e5e/0xefc0bb72312978d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610085e expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.032517:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789304964.032521:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304964.032525:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.032553:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e9d9e5e/0xefc0bb72312978d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610085e expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.032567:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e9d9e5e/0xefc0bb72312978d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610085e expref: 5 pid: 6693 timeout: 2513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304964.032579:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f86df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785742208:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304964.032640:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c04c15300 going to sleep for 11 seconds 00000004:00010000:3.0:1789304964.033189:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055873724 reply state 00000000ec369708 transno 4294967728 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304964.033202:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304964.033224:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00080000:3.0:1789304964.033420:0:7654:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304964.033437:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:57461:x1876219765664640:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 77749us (77888us total) trans 4294967728 rc 0/0 00000100:00100000:3.0:1789304964.033445:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1128 00010000:00010000:3.0:1789304964.033476:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.033482:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.033490:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.033496:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304964.033501:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.033508:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.033523:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304964.033526:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304964.033530:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.033535:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297905 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304964.045375:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304964.045641:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765664768 00000100:00100000:3.0:1789304964.045651:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765664768 00010000:00010000:3.0:1789304964.045711:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e9d9e5e/0xefc0bb72312978d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610085e expref: 6 pid: 6693 timeout: 2513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304964.045769:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 447 00000100:00100000:3.0:1789304964.045780:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765664768:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789304964.045794:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304964.045800:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e9d9e5e/0xefc0bb72312978d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610085e expref: 6 pid: 6693 timeout: 2513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.045814:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e9d9e5e/0xefc0bb72312978d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610085e expref: 6 pid: 6693 timeout: 2513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.045847:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304964.045852:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304964.045859:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.045869:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.045888:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789304964.045936:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765664768:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 158us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304964.045943:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 447 00010000:00010000:0.0:1789304964.046173:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e9d9e5e/0xefc0bb72312978d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610085e expref: 5 pid: 6693 timeout: 2513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304964.046190:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f86df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785742208:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789304964.046219:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.046230:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.046238:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.046249:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.046539:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.046562:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789304964.047186:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785742080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14757us (14935us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789304964.047195:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00080000:2.0:1789304964.047363:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304964.047476:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304964.047483:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.047492:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304964.047497:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.047511:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.047527:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.047534:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a93703d/0xefc0bb723129790c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.047559:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304964.047560:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304964.047562:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304964.047732:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c3f86d180/2, rc 0, transno 4294967367 00000100:00100000:0.0:1789304964.047740:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785742080:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789304964.099020:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304964.099116:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765664896 00000100:00100000:3.0:1789304964.099127:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765664896 00000100:00100000:3.0:1789304964.099184:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1129 00000100:00100000:3.0:1789304964.099193:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:57465:x1876219765664896:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304964.099228:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304964.099249:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297913 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610086c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099311:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129791a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099325:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129791a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099335:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129791a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099350:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297921 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099357:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099364:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099668:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297928 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099678:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099686:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304964.099714:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:3.0:1789304964.099718:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304964.099738:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099750:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129791a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099757:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129791a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099763:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129791a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099769:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304964.099773:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129791a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099780:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129791a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099792:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304964.099795:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304964.099801:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129791a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099807:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129791a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099820:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099826:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297921 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099831:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099835:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304964.099838:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099843:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297921 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099850:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304964.099852:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304964.099855:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297921 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099861:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297921 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099892:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297913 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610086c expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099911:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610086c expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.099919:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304964.099921:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304964.099924:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789304964.099994:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:57465:x1876219765664896:12345-192.168.202.29@tcp:101:touch.0 Request processed in 801us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304964.100002:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1129 00000100:00100000:0.0:1789304964.105983:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304964.106371:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765665152 00000100:00100000:3.0:1789304964.106381:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765665152 00000100:00100000:3.0:1789304964.106439:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1130 00000100:00100000:3.0:1789304964.106449:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:57465:x1876219765665152:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:3.0:1789304964.106470:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304964.106491:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb723129792f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100873 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.106753:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297936 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.106769:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297936 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.106781:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297936 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.106796:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.106803:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.106809:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304964.107522:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23:0x0], index 1: 0 00010000:00010000:3.0:1789304964.107789:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297944 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107801:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107810:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107845:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297936 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107852:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297936 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107858:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297936 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107865:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304964.107869:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297936 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107876:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297936 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107892:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789304964.107894:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304964.107899:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297936 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107905:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297936 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304964.107919:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd7da9a7 reply state 00000000df806e38 transno 4294967729 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304964.107928:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304964.107956:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb723129792f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100873 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107972:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100873 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.107979:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:3.0:1789304964.107981:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304964.107983:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789304964.108045:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:57465:x1876219765665152:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1597us (2072us total) trans 4294967729 rc 0/0 00000100:00100000:3.0:1789304964.108053:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1130 00000100:00100000:2.0:1789304964.112711:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304964.112809:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765665408 00000100:00100000:0.0:1789304964.112821:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765665408 00000100:00100000:0.0:1789304964.112882:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1131 00000100:00100000:0.0:1789304964.112893:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:57465:x1876219765665408:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:0.0:1789304964.112953:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304964.112983:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297944 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100873 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.113005:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9e2c2ea19700) 00010000:00010000:0.0:1789304964.113015:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304964.113061:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.113074:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.113085:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304964.113272:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9ad1293 reply state 00000000ec051672 transno 4294967730 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304964.113283:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789304964.113369:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:57465:x1876219765665408:12345-192.168.202.29@tcp:36:touch.0 Request processed in 477us (668us total) trans 4294967730 rc 0/0 00000100:00100000:0.0:1789304964.113376:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1131 00010000:00010000:3.0:1789304964.113647:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.113658:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.113665:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.113672:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304964.113677:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.113684:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.113695:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789304964.113697:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304964.113702:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.113708:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb723129793d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.114466:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.114477:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.114483:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.114488:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304964.114491:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.114502:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.114514:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9e2c0558db00) 00010000:00010000:3.0:1789304964.114517:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304964.114520:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.114525:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297952 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304964.115396:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304964.115487:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765665536 00000100:00100000:0.0:1789304964.115496:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765665536 00000100:00100000:0.0:1789304964.115551:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1132 00000100:00100000:0.0:1789304964.115559:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:57465:x1876219765665536:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789304964.115581:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304964.115599:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297959 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610087a expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.115665:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610087a expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.115680:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610087a expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.115698:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789304964.115702:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789304964.115705:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afaa00, rc 0) 00000100:00100000:0.0:1789304964.115758:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:57465:x1876219765665536:12345-192.168.202.29@tcp:101:touch.0 Request processed in 200us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304964.115765:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1132 00000100:00100000:0.0:1789304964.119768:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304964.119852:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765665664 00000100:00100000:3.0:1789304964.119861:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765665664 00000100:00100000:3.0:1789304964.119909:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 615 00000100:00100000:3.0:1789304964.119918:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1876219765665664:12345-192.168.202.29@tcp:8:touch.0 00010000:00080000:3.0:1789304964.119952:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp t0 exp 0000000000000000 cur 2413 last 0 00000020:00000080:3.0:1789304964.119984:0:6693:0:(genops.c:1384:class_connect()) connect: client 99087288-e673-4cc7-b2df-ca113c20dacd, cookie 0xefc0bb7231297960 00002000:00100000:3.0:1789304964.119996:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 99087288-e673-4cc7-b2df-ca113c20dacd/ffff9e2c20271000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789304964.120006:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789304964.120314:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789304964.120346:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2c20272800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789304964.120417:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765665664:12345-192.168.202.29@tcp:8:touch.0 Request processed in 498us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304964.120425:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 615 00000100:00100000:1.0:1789304964.122508:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304964.122586:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765665792 00000100:00100000:0.0:1789304964.122596:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765665792 00000100:00100000:0.0:1789304964.122669:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 616 00000100:00100000:0.0:1789304964.122679:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:0:x1876219765665792:12345-192.168.202.29@tcp:2:touch.0 00000100:00080000:2.0:1789304964.123023:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789304964.177659:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967366 is committed 00000001:00100000:3.0:1789304964.177682:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000100:00100000:2.0:1789304964.177785:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:0:x1876219765665792:12345-192.168.202.29@tcp:2:touch.0 Request processed in 55102us (55279us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789304964.177797:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 616 00000100:00100000:2.0:1789304964.188356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304964.188825:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765666048 00000100:00100000:3.0:1789304964.188838:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765666048 00000100:00100000:3.0:1789304964.188906:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 115 00000100:00100000:3.0:1789304964.188918:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:57465:x1876219765666048:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:3.0:1789304964.189383:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:57465:x1876219765666048:12345-192.168.202.29@tcp:35:touch.0 Request processed in 467us (1036us total) trans 4294967731 rc 0/0 00000100:00100000:3.0:1789304964.189392:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 115 00000100:00100000:1.0:1789304964.250949:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304964.251693:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765666176 00000100:00100000:0.0:1789304964.251706:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765666176 00000100:00100000:0.0:1789304964.251846:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1133 00000100:00100000:0.0:1789304964.251858:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:57468:x1876219765666176:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789304964.251886:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304964.251908:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100881 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.251989:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129796e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252005:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129796e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252017:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129796e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252034:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252142:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252152:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252328:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129797c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252336:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129797c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252344:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129797c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304964.252380:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5d:0x0]: returning size 0 00000004:00200000:0.0:1789304964.252385:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304964.252409:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129797c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252425:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129797c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252433:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129796e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252439:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129796e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252445:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129796e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252451:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304964.252455:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129796e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252462:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129796e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252473:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:0.0:1789304964.252476:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304964.252481:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129796e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252487:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb723129796e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252500:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252507:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297975 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252513:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252518:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304964.252521:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252527:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252533:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c0558df00) 00010000:00010000:0.0:1789304964.252536:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304964.252538:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297975 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.252544:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.253039:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100881 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.253837:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129797c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100881 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304964.253848:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789304964.253851:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789304964.253854:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa800, rc 0) 00000100:00100000:0.0:1789304964.253939:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:57468:x1876219765666176:12345-192.168.202.29@tcp:101:rm.0 Request processed in 2083us (3001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304964.253952:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1133 00000100:00100000:1.0:1789304964.257573:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304964.257667:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765666304 00000100:00100000:3.0:1789304964.257677:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765666304 00000100:00100000:3.0:1789304964.257731:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 617 00000100:00100000:3.0:1789304964.257741:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765666304:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789304964.257759:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304964.257780:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070d5cc6b/0xefc0bb7231297983 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100888 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789304964.257807:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x6aa6a084, atime: 0x6aa6a084, ctime: 0x6aa6a084, blocks: 0x1 00010000:00010000:3.0:1789304964.257827:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=2413s v=(0 0) 00010000:00010000:3.0:1789304964.257832:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789304964.257843:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070d5cc6b/0xefc0bb7231297983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100888 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.257864:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070d5cc6b/0xefc0bb7231297983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100888 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.257878:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789304964.257974:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765666304:12345-192.168.202.29@tcp:101:rm.0 Request processed in 234us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304964.257985:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 617 00000100:00100000:2.0:1789304964.261608:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304964.261713:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765666560 00000100:00100000:1.0:1789304964.261724:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765666560 00000100:00100000:1.0:1789304964.261783:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1134 00000100:00100000:1.0:1789304964.261795:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:57468:x1876219765666560:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:1.0:1789304964.261853:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304964.261884:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb723129797c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100881 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.261909:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297959 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610087a expref: 11 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.261919:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:1.0:1789304964.261931:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304964.261954:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb723129798a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.261968:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb723129798a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.261979:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb723129798a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.261995:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.262002:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.262009:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.262143:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297998 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.262447:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297998 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.262457:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297998 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789304964.263080:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].35, 64 off10432 00000004:00080000:1.0:1789304964.263387:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2413941294664ns, next at 2414941291270ns, rc = 0 00010000:00010000:1.0:1789304964.263456:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263536:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263549:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263558:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263564:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263570:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263654:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789304964.263678:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297998 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263685:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297998 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263692:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297998 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263698:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304964.263703:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297998 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263710:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297998 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263720:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:1.0:1789304964.263723:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789304964.263727:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297998 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263733:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297998 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263751:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb723129798a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263758:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb723129798a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263763:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb723129798a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263768:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304964.263771:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb723129798a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263777:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb723129798a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263986:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:1.0:1789304964.263988:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304964.263992:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb723129798a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304964.263997:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb723129798a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304964.264008:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000724565d5 reply state 000000000db5d7f6 transno 4294967732 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304964.264017:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789304964.264647:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:57468:x1876219765666560:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2849us (3048us total) trans 4294967732 rc 0/0 00000100:00100000:1.0:1789304964.264657:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1134 00010000:00010000:2.0:1789304964.264725:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304964.264732:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304964.264738:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304964.264742:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304964.264748:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304964.264758:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9e2c14add700) 00010000:00010000:2.0:1789304964.264760:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789304964.264764:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304964.264769:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb723129799f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304964.264786:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304964.264788:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304964.264789:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304964.282072:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.282116:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.282126:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.282133:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304964.282138:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.282577:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.282601:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c14adde00) 00010000:00010000:3.0:1789304964.282605:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304964.282611:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.282618:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297991 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304964.434908:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304965.150526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304965.150723:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765666688 00000100:00100000:0.0:1789304965.150736:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765666688 00000100:00100000:0.0:1789304965.150853:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1135 00000100:00100000:0.0:1789304965.150866:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:57484:x1876219765666688:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789304965.150892:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304965.150914:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312979a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610088f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.150982:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312979ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.150999:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312979ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.151033:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312979ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304965.151070:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:0.0:1789304965.151074:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304965.151132:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312979ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.151159:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb72312979a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610088f expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.151175:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312979ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610088f expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.151189:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:0.0:1789304965.151192:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789304965.151195:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afae00, rc 0) 00000100:00100000:0.0:1789304965.151269:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:57484:x1876219765666688:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 406us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304965.151276:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1135 00000100:00080000:2.0:1789304965.151723:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304965.157379:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304965.157469:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765666944 00000100:00100000:0.0:1789304965.157480:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765666944 00000100:00100000:0.0:1789304965.157550:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1136 00000100:00100000:0.0:1789304965.157561:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:57484:x1876219765666944:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789304965.157625:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789304965.157653:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb72312979ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610088f expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.157674:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297928 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610086c expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.157687:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:0.0:1789304965.157698:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789304965.157723:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.157737:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.157747:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789304965.157990:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000750f001a reply state 0000000047277ba5 transno 4294967733 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304965.157999:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789304965.158009:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000100:00100000:0.0:1789304965.158133:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:57484:x1876219765666944:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 573us (766us total) trans 4294967733 rc 0/0 00000100:00100000:0.0:1789304965.158141:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1136 00010000:00010000:3.0:1789304965.161040:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.161058:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.161071:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.161077:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304965.161083:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.161117:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.161132:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558df00) 00010000:00010000:3.0:1789304965.161135:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304965.161140:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.161147:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb72312979b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304965.273671:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304965.273759:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765667072 00000100:00100000:3.0:1789304965.273770:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765667072 00000100:00100000:3.0:1789304965.273846:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1137 00000100:00100000:3.0:1789304965.273857:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:57496:x1876219765667072:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304965.273963:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:57496:x1876219765667072:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 108us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304965.273971:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1137 00000100:00100000:0.0:1789304965.275680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304965.275806:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765667200 00000100:00100000:1.0:1789304965.275815:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765667200 00000100:00100000:1.0:1789304965.275968:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 618 00000100:00100000:1.0:1789304965.275978:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:57496:x1876219765667200:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789304965.276419:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:57496:x1876219765667200:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 441us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304965.276427:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 618 00000100:00100000:2.0:1789304965.278281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304965.278580:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765667328 00000100:00100000:3.0:1789304965.278601:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765667328 00000100:00100000:3.0:1789304965.278659:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 619 00000100:00100000:3.0:1789304965.278669:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:57496:x1876219765667328:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304965.279033:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:57496:x1876219765667328:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 364us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304965.279040:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 619 00000100:00100000:0.0:1789304965.283585:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304965.283677:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765667456 00000100:00100000:1.0:1789304965.283690:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765667456 00000100:00100000:1.0:1789304965.283744:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1138 00000100:00100000:1.0:1789304965.283753:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:57496:x1876219765667456:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304965.286580:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:57496:x1876219765667456:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 2817us (2993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304965.286594:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1138 00000100:00100000:1.0:1789304965.290313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304965.290425:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765667584 00000100:00100000:3.0:1789304965.290440:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765667584 00000100:00100000:3.0:1789304965.290552:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1139 00000100:00100000:3.0:1789304965.290564:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:57496:x1876219765667584:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304965.290702:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:57496:x1876219765667584:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 140us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304965.290707:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1139 00000100:00100000:1.0:1789304965.292059:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304965.292185:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765667712 00000100:00100000:2.0:1789304965.292194:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765667712 00000100:00100000:2.0:1789304965.292336:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 620 00000100:00100000:2.0:1789304965.292347:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:57496:x1876219765667712:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304965.292727:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:57496:x1876219765667712:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 382us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304965.292735:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 620 00000100:00100000:0.0:1789304965.294238:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304965.294330:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765667840 00000100:00100000:3.0:1789304965.294339:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765667840 00000100:00100000:3.0:1789304965.294381:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 621 00000100:00100000:3.0:1789304965.294390:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:57496:x1876219765667840:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304965.294722:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:57496:x1876219765667840:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 328us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304965.294729:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 621 00000100:00100000:1.0:1789304965.296001:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304965.296065:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765667968 00000100:00100000:0.0:1789304965.296071:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765667968 00000100:00100000:0.0:1789304965.296228:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1140 00000100:00100000:0.0:1789304965.296238:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:57496:x1876219765667968:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304965.296607:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:57496:x1876219765667968:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 369us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304965.296616:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1140 00000100:00100000:1.0:1789304965.326624:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304965.326697:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765668096 00000100:00100000:2.0:1789304965.326707:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765668096 00000100:00100000:2.0:1789304965.326781:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1141 00000100:00100000:2.0:1789304965.326789:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:57500:x1876219765668096:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:2.0:1789304965.326807:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304965.326825:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312979bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100896 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.326877:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312979c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.326889:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312979c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.326898:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312979c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.326907:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312979c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.326912:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312979c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.326916:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312979c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328297:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312979d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328315:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312979d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328325:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312979d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789304965.328356:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:3.0:1789304965.328361:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789304965.328385:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312979d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328400:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312979c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328407:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312979c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328413:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312979c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328419:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304965.328423:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312979c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328431:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312979c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328443:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789304965.328447:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304965.328452:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312979c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328457:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb72312979c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328472:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312979c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328477:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312979c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328487:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312979c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328492:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40eccc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304965.328494:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312979c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328498:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312979c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328504:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c421d2800) 00010000:00010000:3.0:1789304965.328506:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304965.328508:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312979c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328513:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb72312979c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328546:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb72312979bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100896 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328559:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312979d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100896 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.328566:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304965.328569:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789304965.328571:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ea00, rc 0) 00000100:00100000:3.0:1789304965.328646:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:57500:x1876219765668096:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1856us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304965.328658:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1141 00000100:00100000:1.0:1789304965.331014:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304965.331070:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765668352 00000100:00100000:3.0:1789304965.331081:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765668352 00000100:00100000:3.0:1789304965.331172:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1142 00000100:00100000:3.0:1789304965.331181:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:57500:x1876219765668352:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:3.0:1789304965.331215:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304965.331238:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312979d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610089d expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.331361:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312979de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.331374:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312979de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.331384:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312979de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.331398:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.331404:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.331410:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789304965.332004:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24:0x0], index 0: 0 00010000:00010000:2.0:1789304965.332206:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312979ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332219:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312979ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332229:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312979ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332303:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312979de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332309:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312979de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332313:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312979de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332317:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304965.332321:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312979de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332326:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312979de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332337:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:2.0:1789304965.332338:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304965.332342:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312979de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332349:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb72312979de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304965.332360:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059ebdc34 reply state 0000000055b9b171 transno 4294967734 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304965.332366:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304965.332392:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb72312979d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610089d expref: 15 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332402:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312979ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610089d expref: 14 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.332406:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304965.332408:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304965.332409:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789304965.332545:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+15:57500:x1876219765668352:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1364us (1539us total) trans 4294967734 rc 0/0 00000100:00100000:2.0:1789304965.332553:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1142 00010000:00010000:2.0:1789304965.334533:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.334550:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.334558:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.334564:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304965.334570:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.334577:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.334603:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c2ea19100) 00010000:00010000:2.0:1789304965.334606:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304965.334611:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304965.334617:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb72312979e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304965.336691:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304965.336822:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765668480 00000100:00100000:0.0:1789304965.336835:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765668480 00000100:00100000:0.0:1789304965.336905:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 622 00000100:00100000:0.0:1789304965.336917:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:57500:x1876219765668480:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789304965.336941:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304965.336966:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb72312979fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008a4 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789304965.336998:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789304965.337021:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=2415s v=(0 0) 00010000:00010000:0.0:1789304965.337026:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304965.337036:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb72312979fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008a4 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.337054:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb72312979fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008a4 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.337067:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afba00, rc 0) 00000100:00100000:0.0:1789304965.337270:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:57500:x1876219765668480:12345-192.168.202.29@tcp:101:dd.0 Request processed in 355us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304965.337277:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 622 00000100:00100000:0.0:1789304965.348947:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304965.349010:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765668608 00000100:00100000:2.0:1789304965.349020:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765668608 00002000:00100000:2.0:1789304965.349181:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x24:0x0] (0->1048575) req@ffff9e2c0651d180 x1876219765668608/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:276/0 lens 488/0 e 0 to 0 dl 1789304976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304965.349191:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c0651d180 with x1876219765668608 ext(0->1048575) 00002000:00010000:2.0:1789304965.349211:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2c0651d180 00000100:00100000:1.0:1789304965.349283:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 28 00000100:00100000:1.0:1789304965.349295:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765668608:12345-192.168.202.29@tcp:4:dd.0 00000100:00100000:2.0:1789304965.349343:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789304965.349352:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1789304965.360713:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765668608:12345-192.168.202.29@tcp:4:dd.0 Request processed in 11411us (11763us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789304965.360725:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 28 00002000:00100000:2.0:1789304965.360738:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x24:0x0] (0->1048575) req@ffff9e2c0651d180 x1876219765668608/t4294967368(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:276/0 lens 488/448 e 0 to 0 dl 1789304976 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789304965.360745:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c0651d180 with x1876219765668608 ext(0->1048575) 00002000:00010000:2.0:1789304965.360750:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2c0651d180 00000100:00100000:0.0:1789304965.362707:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304965.362778:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765668736 00000100:00100000:1.0:1789304965.362786:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765668736 00000100:00100000:1.0:1789304965.362832:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1143 00000100:00100000:1.0:1789304965.362840:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+14:57500:x1876219765668736:12345-192.168.202.29@tcp:44:dd.0 00000001:00080000:2.0:1789304965.399946:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967733 is committed 00000004:00080000:2.0:1789304965.399970:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 100 committed 00000001:00080000:2.0:1789304965.399991:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967734 is committed 00000100:00100000:2.0:1789304965.400440:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785742336:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789304965.400509:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304965.400626:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785742336 00000100:00100000:0.0:1789304965.400635:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785742336 00000100:00100000:0.0:1789304965.400698:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1789304965.400708:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785742336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789304965.400736:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:35 count 1 00010000:00010000:0.0:1789304965.400761:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.400783:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070d5cc6b/0xefc0bb7231297983 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100888 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.400797:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789304965.400803:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304965.400808:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.400850:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070d5cc6b/0xefc0bb7231297983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100888 expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.400865:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070d5cc6b/0xefc0bb7231297983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100888 expref: 5 pid: 6693 timeout: 2515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304965.400877:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785742464:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789304965.400933:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c371b2480 going to sleep for 11 seconds 00000100:00080000:2.0:1789304965.401338:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304965.401651:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:57500:x1876219765668736:12345-192.168.202.29@tcp:44:dd.0 Request processed in 38806us (38945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304965.401661:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1143 00000100:00100000:2.0:1789304965.401816:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785742720:0@lo:400:kworker.0 00000100:00100000:2.0:1789304965.401867:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304965.401893:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304965.401899:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785742848:0@lo:400:kworker.0 00000100:00100000:2.0:1789304965.401928:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304965.401958:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785742720 00000100:00100000:2.0:1789304965.401964:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785742720 00000100:00100000:2.0:1789304965.401996:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732 00000100:00100000:2.0:1789304965.402002:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785742720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304965.402040:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785742720:12345-0@lo:400:kworker.0 Request processed in 38us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304965.402048:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732 00000100:00100000:2.0:1789304965.402065:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785742848 00000100:00100000:2.0:1789304965.402069:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785742848 00000100:00100000:2.0:1789304965.402119:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1789304965.402125:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785742848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304965.402155:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785742848:12345-0@lo:400:kworker.0 Request processed in 30us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304965.402160:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00080000:2.0:1789304965.402178:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304965.402217:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785742848:0@lo:400:kworker.0 00000100:00100000:2.0:1789304965.402229:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785742720:0@lo:400:kworker.0 00000100:00100000:3.0:1789304965.402426:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785742592:0@lo:400:kworker.0 00000100:00100000:3.0:1789304965.402462:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304965.402502:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785743104:0@lo:400:kworker.0 00000100:00100000:3.0:1789304965.402524:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304965.402541:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304965.402547:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785742976:0@lo:400:kworker.0 00000100:00100000:3.0:1789304965.402568:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304965.402593:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785743104 00000100:00100000:3.0:1789304965.402597:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785743104 00000100:00100000:3.0:1789304965.402624:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785742976 00000100:00100000:3.0:1789304965.402628:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785742976 00000100:00100000:3.0:1789304965.402645:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733 00000100:00100000:3.0:1789304965.402651:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785743104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304965.402685:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785743104:12345-0@lo:400:kworker.0 Request processed in 34us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304965.402691:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733 00000100:00100000:3.0:1789304965.402704:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734 00000100:00100000:3.0:1789304965.402709:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785742976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304965.402735:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785742976:12345-0@lo:400:kworker.0 Request processed in 26us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304965.402741:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734 00000100:00100000:3.0:1789304965.402766:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785742976:0@lo:400:kworker.0 00000100:00100000:3.0:1789304965.402775:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785743104:0@lo:400:kworker.0 00000100:00100000:2.0:1789304965.403424:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785742592 00000100:00100000:2.0:1789304965.403431:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785742592 00000100:00100000:2.0:1789304965.403470:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1789304965.403478:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785742592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304965.403520:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785742592:12345-0@lo:400:kworker.0 Request processed in 43us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304965.403526:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1789304965.403567:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785742592:0@lo:400:kworker.0 00000100:00080000:2.0:1789304965.403585:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304965.404650:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304965.404826:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785742464:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304965.404850:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304965.408561:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304965.408670:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765668992 00000100:00100000:3.0:1789304965.408680:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765668992 00000100:00100000:3.0:1789304965.408730:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 624 00000100:00100000:3.0:1789304965.408737:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765668992:12345-192.168.202.29@tcp:16:dd.0 00000100:00100000:0.0:1789304965.411965:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765668864 00000100:00100000:0.0:1789304965.411982:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765668864 00010000:00010000:0.0:1789304965.412029:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070d5cc6b/0xefc0bb7231297983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100888 expref: 6 pid: 6693 timeout: 2515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304965.412568:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 448 00000100:00100000:0.0:1789304965.412579:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765668864:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789304965.412686:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304965.412693:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070d5cc6b/0xefc0bb7231297983 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100888 expref: 6 pid: 6693 timeout: 2515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.412714:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070d5cc6b/0xefc0bb7231297983 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100888 expref: 6 pid: 6693 timeout: 2515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.412740:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070d5cc6b/0xefc0bb7231297983 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100888 expref: 6 pid: 6693 timeout: 2515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.412758:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304965.412763:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304965.412768:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.412779:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.412808:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304965.413212:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765668864:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 633us (8565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304965.413222:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 448 00010000:00010000:0.0:1789304965.413355:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.413366:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.413375:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.413383:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304965.413406:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304965.414249:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304965.414265:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.414275:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304965.414280:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.414292:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.414309:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.414317:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416bb361/0xefc0bb7231297a01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304965.414339:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304965.414341:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304965.414342:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304965.415163:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785742336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14452us (14650us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789304965.415175:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000004:00080000:2.0:1789304965.416733:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c08b35880/2, rc 0, transno 4294967367 00000100:00100000:2.0:1789304965.416751:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785742336:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789304965.444914:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00000001:00080000:0.0:1789304965.444937:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00000100:00100000:1.0:1789304965.445299:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765668992:12345-192.168.202.29@tcp:16:dd.0 Request processed in 36555us (36740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304965.445311:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 624 00000100:00100000:1.0:1789304965.451607:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304965.451788:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765669248 00000100:00100000:2.0:1789304965.451832:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765669248 00000100:00100000:2.0:1789304965.452055:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 116 00000100:00100000:2.0:1789304965.453161:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:57500:x1876219765669248:12345-192.168.202.29@tcp:35:dd.0 00000100:00100000:2.0:1789304965.453872:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:57500:x1876219765669248:12345-192.168.202.29@tcp:35:dd.0 Request processed in 1801us (2274us total) trans 4294967735 rc 0/0 00000100:00100000:2.0:1789304965.453882:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 116 00010000:00010000:2.0:1789304965.458327:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304966.482994:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789304966.775723:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967735 is committed 00010000:00010000:1.0:1789304967.509397:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789304967.841773:0:98569:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2417519678968ns, next at 2413721157116ns, rc = 0 00000004:00080000:0.0:1789304967.841876:0:98569:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2417519784710ns, next at 2414941291270ns, rc = 0 00000004:00080000:3.0:1789304967.844877:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 101 committed 00000004:00080000:3.0:1789304967.844907:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 93 committed 00000100:00100000:1.0:1789304967.972619:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785743232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304967.972690:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304967.972795:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785743232 00000100:00100000:0.0:1789304967.972804:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785743232 00000100:00100000:0.0:1789304967.972866:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1789304967.972875:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785743232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304967.972909:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304967.972951:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785743232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304967.972957:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00080000:3.0:1789304967.973009:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304967.973070:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785743232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304968.058193:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304968.058257:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304968.058275:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304968.058361:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304968.058430:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765669376 00000100:00100000:0.0:1789304968.058443:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765669376 00000100:00100000:0.0:1789304968.058496:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1357 00000100:00100000:0.0:1789304968.058507:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765669376:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304968.058543:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765669504 00000100:00100000:1.0:1789304968.058547:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765669504 00000100:00100000:0.0:1789304968.058576:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765669376:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 72us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304968.058586:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1357 00000100:00100000:1.0:1789304968.058589:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1735 00000100:00100000:1.0:1789304968.058596:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765669504:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304968.058634:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765669504:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304968.058641:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1735 00000100:00080000:1.0:1789304968.058791:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304968.059771:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765669632 00000100:00100000:3.0:1789304968.059783:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765669632 00000100:00100000:2.0:1789304968.059967:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765669760 00000100:00100000:2.0:1789304968.059972:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765669760 00000100:00100000:3.0:1789304968.060032:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1332 00000100:00100000:3.0:1789304968.060042:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765669632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304968.060129:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765669632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304968.060136:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1332 00000100:00080000:1.0:1789304968.061872:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304968.062236:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1333 00000100:00100000:2.0:1789304968.062250:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765669760:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304968.062369:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765669760:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 123us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304968.062376:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1333 00000100:00080000:0.0:1789304968.063441:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304968.531979:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304968.981755:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785743360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304968.981828:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304968.981892:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785743360 00000100:00100000:0.0:1789304968.981900:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785743360 00000100:00100000:0.0:1789304968.981965:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1789304968.981974:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785743360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789304968.982012:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789304968.982059:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785743360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304968.982067:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00080000:0.0:1789304968.982103:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304968.982130:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:0.0:1789304968.982136:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c3f86d180, transno 4294967367 00000100:00100000:0.0:1789304968.982153:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785743360:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789304969.432434:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967367 is committed 00010000:00010000:3.0:1789304969.556771:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304969.564984:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304969.565431:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765669888 00000100:00100000:1.0:1789304969.565542:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765669888 00000100:00100000:1.0:1789304969.565599:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1144 00000100:00100000:1.0:1789304969.565610:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:57692:x1876219765669888:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304969.565766:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:57692:x1876219765669888:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 157us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304969.565774:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1144 00000100:00100000:3.0:1789304969.573234:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304969.575814:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765670016 00000100:00100000:0.0:1789304969.575832:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765670016 00000100:00100000:0.0:1789304969.575894:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 625 00000100:00100000:0.0:1789304969.575904:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:57692:x1876219765670016:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789304969.576348:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:57692:x1876219765670016:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 443us (3122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304969.576356:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 625 00000100:00100000:3.0:1789304969.582678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304969.583140:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765670144 00000100:00100000:2.0:1789304969.583151:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765670144 00000100:00100000:2.0:1789304969.583224:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 626 00000100:00100000:2.0:1789304969.583234:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:57692:x1876219765670144:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304969.583775:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:57692:x1876219765670144:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 539us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304969.583784:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 626 00000100:00100000:2.0:1789304969.588499:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304969.588728:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765670272 00000100:00100000:3.0:1789304969.588738:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765670272 00000100:00100000:3.0:1789304969.588799:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1145 00000100:00100000:3.0:1789304969.588809:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:57692:x1876219765670272:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304969.589292:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:57692:x1876219765670272:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 482us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304969.589301:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1145 00000100:00100000:1.0:1789304969.595403:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304969.595497:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765670400 00000100:00100000:2.0:1789304969.595509:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765670400 00000100:00100000:2.0:1789304969.595568:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1146 00000100:00100000:2.0:1789304969.595577:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:57692:x1876219765670400:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304969.595681:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:57692:x1876219765670400:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 104us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304969.595689:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1146 00000100:00100000:0.0:1789304969.604040:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304969.604194:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765670528 00000100:00100000:2.0:1789304969.604214:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765670528 00000100:00100000:2.0:1789304969.604268:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 627 00000100:00100000:2.0:1789304969.604278:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:57692:x1876219765670528:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304969.607227:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:57692:x1876219765670528:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 2939us (3186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304969.607243:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 627 00000100:00100000:2.0:1789304969.612271:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304969.615069:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765670656 00000100:00100000:3.0:1789304969.615083:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765670656 00000100:00100000:3.0:1789304969.615195:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 628 00000100:00100000:3.0:1789304969.615207:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:57692:x1876219765670656:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304969.615639:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:57692:x1876219765670656:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 433us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304969.615650:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 628 00000100:00100000:1.0:1789304969.620022:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304969.620110:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765670784 00000100:00100000:2.0:1789304969.620120:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765670784 00000100:00100000:2.0:1789304969.620201:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1147 00000100:00100000:2.0:1789304969.620219:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:57692:x1876219765670784:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304969.620874:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:57692:x1876219765670784:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 655us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304969.620884:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1147 00000100:00100000:1.0:1789304969.689538:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304969.689641:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765671040 00000100:00100000:2.0:1789304969.689652:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765671040 00000100:00100000:2.0:1789304969.689718:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1148 00000100:00100000:2.0:1789304969.689729:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:57695:x1876219765671040:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1789304969.689779:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304969.689806:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312979ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610089d expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.689825:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9e2c421d2b00) 00010000:00010000:2.0:1789304969.689836:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304969.689857:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297a08 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.689871:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297a08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.689881:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297a08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.689893:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.689900:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.689906:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.690248:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297a16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.690256:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.690263:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304969.691054:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].36, 64 off10496 00000004:00080000:2.0:1789304969.691067:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2419368976121ns, next at 2420368973213ns, rc = 0 00010000:00010000:2.0:1789304969.691217:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691230:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691238:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691250:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691257:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691264:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691294:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304969.691318:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691324:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297a16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691331:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297a16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691336:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304969.691341:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297a16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691348:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297a16 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691358:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789304969.691361:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304969.691366:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297a16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691375:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297a16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691395:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297a08 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691401:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297a08 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691406:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297a08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691410:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304969.691413:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297a08 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691419:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297a08 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691427:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:2.0:1789304969.691429:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304969.691432:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297a08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304969.691437:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297a08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304969.691446:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004861733 reply state 00000000758ebb77 transno 4294967736 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304969.691456:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304969.691540:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:57695:x1876219765671040:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1811us (2009us total) trans 4294967736 rc 0/0 00000100:00100000:2.0:1789304969.691549:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1148 00010000:00010000:3.0:1789304969.691672:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304969.691679:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.691685:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304969.691689:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.691696:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.691707:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:3.0:1789304969.691710:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304969.691713:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.691719:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297a1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.691734:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304969.691736:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304969.691738:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304969.695335:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.695354:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.695362:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.695374:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304969.695379:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.695388:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.695405:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c421d2200) 00010000:00010000:3.0:1789304969.695408:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304969.695414:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304969.695420:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297a0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304970.514452:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785743872:0@lo:400:kworker.0 00000100:00100000:0.0:1789304970.514527:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304970.514596:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789304970.514603:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785743744:0@lo:400:kworker.0 00000100:00100000:0.0:1789304970.514647:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304970.514678:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785743872 00000100:00100000:0.0:1789304970.514687:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785743872 00000100:00100000:0.0:1789304970.514741:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736 00000100:00100000:0.0:1789304970.514750:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785743872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304970.514797:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785743872:12345-0@lo:400:kworker.0 Request processed in 49us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304970.514804:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736 00000100:00100000:0.0:1789304970.514826:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785743744 00000100:00100000:0.0:1789304970.514830:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785743744 00000100:00100000:0.0:1789304970.514853:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:0.0:1789304970.514858:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785743744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304970.514883:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785743744:12345-0@lo:400:kworker.0 Request processed in 25us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304970.514888:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00080000:0.0:1789304970.514902:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304970.514906:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304970.514930:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785743744:0@lo:400:kworker.0 00000100:00100000:0.0:1789304970.514938:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785743872:0@lo:400:kworker.0 00000100:00100000:3.0:1789304970.514998:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785743616:0@lo:400:kworker.0 00000100:00100000:3.0:1789304970.515029:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304970.515041:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785743488:0@lo:400:kworker.0 00000100:00100000:3.0:1789304970.515062:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785744128:0@lo:400:kworker.0 00000100:00100000:2.0:1789304970.515074:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304970.515083:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304970.515117:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785744000:0@lo:400:kworker.0 00000100:00100000:3.0:1789304970.515133:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785744128 00000100:00100000:3.0:1789304970.515136:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785744128 00000100:00100000:2.0:1789304970.515139:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304970.515174:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:2.0:1789304970.515176:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785743616 00000100:00100000:2.0:1789304970.515179:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785743616 00000100:00100000:3.0:1789304970.515181:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785744128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304970.515200:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785744000 00000100:00100000:2.0:1789304970.515203:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785744000 00000100:00100000:2.0:1789304970.515223:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:3.0:1789304970.515225:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785744128:12345-0@lo:400:kworker.0 Request processed in 45us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304970.515228:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785743616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304970.515231:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1789304970.515257:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:3.0:1789304970.515263:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c08b35880, transno 4294967367 00000100:00100000:3.0:1789304970.515274:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785744128:0@lo:400:kworker.0 00000100:00100000:0.0:1789304970.515407:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1738 00000100:00100000:0.0:1789304970.515415:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785744000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304970.515726:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785743616:12345-0@lo:400:kworker.0 Request processed in 497us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304970.515733:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1789304970.515759:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785743488 00000100:00100000:2.0:1789304970.515763:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785743488 00000100:00100000:2.0:1789304970.515797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:2.0:1789304970.515804:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785743488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304970.515840:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785743488:12345-0@lo:400:kworker.0 Request processed in 37us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304970.515846:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:2.0:1789304970.515885:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785743488:0@lo:400:kworker.0 00000100:00080000:2.0:1789304970.515922:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789304970.515926:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304970.516309:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785744000:12345-0@lo:400:kworker.0 Request processed in 893us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304970.516317:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1738 00000100:00100000:3.0:1789304970.516337:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785743616:0@lo:400:kworker.0 00000100:00100000:0.0:1789304970.516393:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785744000:0@lo:400:kworker.0 00010000:00010000:1.0:1789304970.579417:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304971.617240:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789304971.715768:0:98715:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2421393673968ns, next at 2420368973213ns, rc = 0 00000001:00080000:0.0:1789304971.751083:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967736 is committed 00000004:00080000:0.0:1789304971.751309:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 94 committed 00000100:00100000:2.0:1789304971.751984:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785744256:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789304971.752056:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304971.752430:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785744256 00000100:00100000:3.0:1789304971.752440:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785744256 00000100:00100000:3.0:1789304971.752497:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1789304971.752506:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785744256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789304971.752535:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:36 count 1 00010000:00010000:3.0:1789304971.752560:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304971.752581:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb72312979fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008a4 expref: 5 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304971.752592:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x24:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1789304971.752596:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789304971.752601:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304971.752635:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb72312979fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008a4 expref: 5 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304971.752650:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb72312979fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008a4 expref: 5 pid: 6692 timeout: 2521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304971.752669:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876219785744384:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789304971.752741:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1cc00 going to sleep for 11 seconds 00000004:00080000:0.0:1789304971.754238:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 95 committed 00000100:00100000:2.0:1789304971.758562:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304971.758671:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765671168 00000100:00100000:1.0:1789304971.758681:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765671168 00010000:00010000:1.0:1789304971.758744:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb72312979fa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008a4 expref: 6 pid: 6692 timeout: 2521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304971.758853:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 449 00000100:00100000:1.0:1789304971.758865:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04161880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765671168:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789304971.758884:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789304971.758890:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb72312979fa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008a4 expref: 6 pid: 6692 timeout: 2521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304971.758907:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb72312979fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008a4 expref: 6 pid: 6692 timeout: 2521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304971.758933:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304971.758938:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304971.758944:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304971.758953:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304971.758972:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789304971.759029:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04161880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765671168:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 166us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304971.759037:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 449 00000100:00080000:2.0:1789304971.759086:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789304971.759211:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004929f185/0xefc0bb72312979fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008a4 expref: 5 pid: 6692 timeout: 2521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304971.759229:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1876219785744384:192.168.202.29@tcp:104: 00010000:00010000:3.0:1789304971.759250:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304971.759260:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304971.759268:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304971.759278:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304971.759287:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304971.759310:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789304971.759888:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785744256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7382us (7830us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789304971.759902:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00010000:00010000:2.0:1789304971.759978:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789304971.759985:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304971.759995:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789304971.759999:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304971.760009:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304971.760025:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304971.760032:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070d5cc6b/0xefc0bb7231297a24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304971.760052:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304971.760054:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304971.760055:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789304971.760086:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b01158e00/2, rc 0, transno 4294967369 00000100:00100000:2.0:1789304971.760146:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785744256:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789304971.760583:0:98715:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2421438492004ns, next at 2414941291270ns, rc = 0 00000004:00080000:0.0:1789304971.764792:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 102 committed 00010000:00010000:1.0:1789304972.626427:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304973.075133:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789304973.078252:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785744512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304973.078329:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304973.078556:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785744512 00000100:00100000:1.0:1789304973.078565:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785744512 00000100:00100000:1.0:1789304973.078633:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1789304973.078642:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785744512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304973.078678:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304973.078735:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04162680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785744512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304973.078742:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1789304973.078824:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785744512:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789304973.078999:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304973.154570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304973.154906:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765671296 00000100:00100000:2.0:1789304973.154918:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765671296 00000100:00100000:2.0:1789304973.154976:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1359 00000100:00100000:2.0:1789304973.154986:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765671296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304973.155061:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765671296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304973.155069:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1359 00000100:00100000:0.0:1789304973.163523:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304973.163573:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304973.163622:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304973.163708:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765671680 00000100:00100000:3.0:1789304973.163718:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765671680 00000100:00100000:3.0:1789304973.163797:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765671552 00000100:00100000:3.0:1789304973.163801:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765671552 00000100:00100000:3.0:1789304973.163826:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1336 00000100:00100000:3.0:1789304973.163835:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765671680:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304973.163928:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765671680:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304973.163936:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1336 00000100:00100000:3.0:1789304973.163953:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1337 00000100:00100000:3.0:1789304973.163959:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765671552:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304973.163985:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765671552:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304973.163990:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1337 00000100:00080000:0.0:1789304973.164606:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789304973.164612:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304973.165398:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765671424 00000100:00100000:2.0:1789304973.165408:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765671424 00000100:00100000:2.0:1789304973.165470:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1739 00000100:00100000:2.0:1789304973.165479:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765671424:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304973.165538:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765671424:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 61us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304973.165545:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1739 00000100:00080000:0.0:1789304973.166001:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304973.650880:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304974.098634:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789304974.098660:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785744640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304974.098737:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304974.099008:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785744640 00000100:00100000:0.0:1789304974.099019:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785744640 00000100:00100000:0.0:1789304974.099112:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:0.0:1789304974.099131:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785744640:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789304974.099354:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789304974.099388:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789304974.099452:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785744640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 323us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304974.099459:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1789304974.099552:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785744640:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789304974.691820:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789304974.719444:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967369 is committed 00000100:00100000:1.0:1789304975.637943:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785745024:0@lo:400:kworker.0 00000100:00100000:1.0:1789304975.638035:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304975.638140:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789304975.638148:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785744896:0@lo:400:kworker.0 00000100:00100000:1.0:1789304975.638175:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304975.638197:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785745408:0@lo:400:kworker.0 00000100:00100000:1.0:1789304975.638218:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304975.638247:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785745024 00000100:00100000:1.0:1789304975.638254:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785745024 00000100:00100000:1.0:1789304975.638298:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785745408 00000100:00100000:1.0:1789304975.638301:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785745408 00000100:00100000:1.0:1789304975.638329:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1789304975.638337:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785745024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304975.638387:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785745024:12345-0@lo:400:kworker.0 Request processed in 51us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304975.638407:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1789304975.638426:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1789304975.638433:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785745408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304975.638461:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785745408:12345-0@lo:400:kworker.0 Request processed in 29us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304975.638467:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00080000:1.0:1789304975.638490:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304975.638519:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785745408:0@lo:400:kworker.0 00000100:00100000:1.0:1789304975.638529:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:1.0:1789304975.638534:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b01158e00, transno 4294967369 00000100:00100000:1.0:1789304975.638544:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785745024:0@lo:400:kworker.0 00000100:00100000:2.0:1789304975.639282:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785745152:0@lo:400:kworker.0 00000100:00100000:2.0:1789304975.639319:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304975.639353:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789304975.639359:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785744768:0@lo:400:kworker.0 00000100:00100000:2.0:1789304975.639400:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304975.639426:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785745280:0@lo:400:kworker.0 00000100:00100000:2.0:1789304975.639448:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304975.639475:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785744896 00000100:00100000:2.0:1789304975.639479:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785744896 00000100:00100000:2.0:1789304975.639508:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785745152 00000100:00100000:2.0:1789304975.639512:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785745152 00000100:00100000:2.0:1789304975.639534:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785745280 00000100:00100000:2.0:1789304975.639537:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785745280 00000100:00100000:2.0:1789304975.639550:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1740 00000100:00100000:2.0:1789304975.639556:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785744896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304975.639597:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785744896:12345-0@lo:400:kworker.0 Request processed in 41us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304975.639603:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1740 00000100:00100000:2.0:1789304975.639616:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1741 00000100:00100000:2.0:1789304975.639623:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785745152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304975.639653:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785745152:12345-0@lo:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304975.639658:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1741 00000100:00100000:2.0:1789304975.639670:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742 00000100:00100000:2.0:1789304975.639675:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785745280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304975.639701:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785745280:12345-0@lo:400:kworker.0 Request processed in 26us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304975.639707:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742 00000100:00080000:2.0:1789304975.639734:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304975.639903:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785744896:0@lo:400:kworker.0 00000100:00100000:2.0:1789304975.639953:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785745280:0@lo:400:kworker.0 00000100:00100000:2.0:1789304975.639967:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785745152:0@lo:400:kworker.0 00000100:00100000:1.0:1789304975.640233:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785744768 00000100:00100000:1.0:1789304975.640238:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785744768 00000100:00100000:1.0:1789304975.640273:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1789304975.640281:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785744768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304975.640429:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785744768:12345-0@lo:400:kworker.0 Request processed in 148us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304975.640436:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1789304975.644647:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c37028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785744768:0@lo:400:kworker.0 00010000:00010000:1.0:1789304975.698279:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304976.722898:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304977.748312:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304978.194769:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304978.194793:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785745536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304978.194858:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304978.195460:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785745536 00000100:00100000:1.0:1789304978.195472:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785745536 00000100:00100000:1.0:1789304978.195547:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1789304978.195556:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785745536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304978.195593:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304978.195663:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785745536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304978.195671:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00080000:3.0:1789304978.195845:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304978.195887:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785745536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304978.287569:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304978.287671:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304978.287706:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304978.287744:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304978.291070:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765671936 00000100:00100000:3.0:1789304978.291145:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765671936 00000100:00100000:3.0:1789304978.291273:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1743 00000100:00100000:3.0:1789304978.291288:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765671936:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304978.291378:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765671936:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 94us (3671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304978.291386:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1743 00000100:00080000:0.0:1789304978.292404:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304978.292492:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765672064 00000100:00100000:1.0:1789304978.292502:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765672064 00000100:00100000:1.0:1789304978.292565:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765672192 00000100:00100000:1.0:1789304978.292570:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765672192 00000100:00100000:1.0:1789304978.292599:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1340 00000100:00100000:1.0:1789304978.292608:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765672064:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304978.292669:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765672064:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 61us (4997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304978.292676:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1340 00000100:00100000:1.0:1789304978.292690:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1341 00000100:00100000:1.0:1789304978.292696:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765672192:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304978.292723:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765672192:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (4979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304978.292728:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1341 00000100:00080000:0.0:1789304978.293218:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304978.293221:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304978.295735:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765671808 00000100:00100000:2.0:1789304978.295753:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765671808 00000100:00100000:2.0:1789304978.295889:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1361 00000100:00100000:2.0:1789304978.295900:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765671808:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304978.295992:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765671808:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (8964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304978.295999:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1361 00010000:00010000:1.0:1789304978.773500:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304979.218571:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785745664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304979.218663:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304979.219000:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785745664 00000100:00100000:1.0:1789304979.219009:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785745664 00000100:00100000:1.0:1789304979.219111:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1789304979.219123:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785745664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304979.219163:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304979.219224:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04161c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785745664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304979.219231:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1789304979.219277:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785745664:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789304979.219487:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304979.794339:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304980.754361:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785745792:0@lo:400:kworker.0 00000100:00100000:3.0:1789304980.754440:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304980.754441:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785745920:0@lo:400:kworker.0 00000100:00100000:0.0:1789304980.754478:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304980.754547:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785745792 00000100:00100000:1.0:1789304980.754559:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785745792 00000100:00100000:1.0:1789304980.754618:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1789304980.754627:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785745792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304980.754685:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785745792:12345-0@lo:400:kworker.0 Request processed in 58us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304980.754692:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:2.0:1789304980.754726:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785746048:0@lo:400:kworker.0 00000100:00100000:2.0:1789304980.754759:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304980.754798:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785745920 00000100:00100000:2.0:1789304980.754802:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785745920 00000100:00100000:3.0:1789304980.754803:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785746176:0@lo:400:kworker.0 00000100:00100000:3.0:1789304980.754830:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304980.754830:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1744 00000100:00100000:2.0:1789304980.754836:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785745920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304980.754858:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785746176 00000100:00100000:3.0:1789304980.754862:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785746176 00000100:00100000:2.0:1789304980.754867:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785745920:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304980.754872:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1744 00000100:00100000:1.0:1789304980.754926:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785746048 00000100:00100000:1.0:1789304980.754930:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785746048 00000100:00100000:1.0:1789304980.754967:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1789304980.754973:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785746048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304980.755008:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785746048:12345-0@lo:400:kworker.0 Request processed in 35us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304980.755014:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1789304980.755033:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785746304:0@lo:400:kworker.0 00000100:00100000:1.0:1789304980.755066:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304980.766863:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785745920:0@lo:400:kworker.0 00000100:00100000:0.0:1789304980.766882:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785746432:0@lo:400:kworker.0 00000100:00100000:0.0:1789304980.766957:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304980.767037:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785746432 00000100:00100000:0.0:1789304980.767045:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785746432 00000100:00100000:0.0:1789304980.767831:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1789304980.767844:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785746432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304980.767912:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785746432:12345-0@lo:400:kworker.0 Request processed in 73us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304980.767920:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1789304980.767965:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785746432:0@lo:400:kworker.0 00000100:00100000:0.0:1789304980.769183:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785746048:0@lo:400:kworker.0 00000100:00100000:3.0:1789304980.773502:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785746304 00000100:00100000:3.0:1789304980.773526:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785746304 00000100:00100000:3.0:1789304980.773611:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:3.0:1789304980.773624:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785746176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304980.773743:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785746176:12345-0@lo:400:kworker.0 Request processed in 122us (18911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304980.773751:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00100000:3.0:1789304980.773769:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:3.0:1789304980.773776:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785746304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304980.773808:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785746304:12345-0@lo:400:kworker.0 Request processed in 33us (18741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304980.773817:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:3.0:1789304980.773875:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785746176:0@lo:400:kworker.0 00000100:00100000:1.0:1789304980.774258:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785746304:0@lo:400:kworker.0 00000100:00100000:1.0:1789304980.774287:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785745792:0@lo:400:kworker.0 00000100:00080000:1.0:1789304980.774333:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789304980.774339:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789304980.821462:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304981.842365:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304982.866302:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304983.314925:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785746560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304983.315000:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304983.315398:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785746560 00000100:00100000:1.0:1789304983.315418:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785746560 00000100:00100000:1.0:1789304983.315491:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1789304983.315501:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785746560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304983.315540:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304983.315594:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785746560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304983.315601:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1789304983.315646:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785746560:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789304983.317548:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304983.394622:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304983.394681:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304983.394723:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304983.394793:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304983.394830:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765672448 00000100:00100000:3.0:1789304983.394843:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765672448 00000100:00100000:3.0:1789304983.394933:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1747 00000100:00100000:3.0:1789304983.394948:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765672448:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304983.394994:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765672320 00000100:00100000:0.0:1789304983.395012:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765672320 00000100:00100000:3.0:1789304983.395062:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765672448:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304983.395072:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1747 00000100:00100000:0.0:1789304983.395115:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1363 00000100:00100000:0.0:1789304983.395127:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765672320:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304983.395204:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765672320:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304983.395212:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1363 00000100:00080000:0.0:1789304983.395287:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304983.395628:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765672576 00000100:00100000:1.0:1789304983.395633:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765672576 00000100:00100000:1.0:1789304983.395688:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765672704 00000100:00100000:1.0:1789304983.395692:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765672704 00000100:00100000:1.0:1789304983.395715:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1344 00000100:00100000:1.0:1789304983.395733:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765672576:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304983.395773:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765672576:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 50us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304983.395780:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1344 00000100:00100000:1.0:1789304983.395797:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1345 00000100:00100000:1.0:1789304983.395808:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765672704:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304983.395838:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765672704:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304983.395848:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1345 00000100:00080000:0.0:1789304983.396005:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789304983.396009:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789304983.894462:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304984.338469:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785746688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789304984.338581:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304984.338810:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785746688 00000100:00100000:2.0:1789304984.338822:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785746688 00000100:00080000:0.0:1789304984.338898:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304984.338920:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1789304984.338934:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785746688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304984.338992:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304984.339131:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785746688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304984.339140:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1789304984.339362:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785746688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789304984.930969:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304985.874560:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785746944:0@lo:400:kworker.0 00000100:00100000:2.0:1789304985.874657:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304985.874730:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785747200:0@lo:400:kworker.0 00000100:00100000:2.0:1789304985.874732:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785747456:0@lo:400:kworker.0 00000100:00100000:2.0:1789304985.874759:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304985.874760:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304985.874825:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785746944 00000100:00100000:0.0:1789304985.874835:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785746944 00000100:00100000:0.0:1789304985.874890:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785747200 00000100:00100000:0.0:1789304985.874893:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785747200 00000100:00100000:1.0:1789304985.874897:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1748 00000100:00100000:1.0:1789304985.874908:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785746944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304985.874922:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:0.0:1789304985.874928:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785747200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304985.874971:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789304985.874971:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304985.874978:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785746816:0@lo:400:kworker.0 00000100:00100000:2.0:1789304985.874978:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785747072:0@lo:400:kworker.0 00000100:00100000:2.0:1789304985.875018:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304985.875037:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304985.875059:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785747328:0@lo:400:kworker.0 00000100:00100000:3.0:1789304985.875130:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304985.875165:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785747328 00000100:00100000:2.0:1789304985.875169:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785747328 00000100:00100000:3.0:1789304985.875173:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785746816 00000100:00100000:3.0:1789304985.875176:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785746816 00000100:00100000:2.0:1789304985.875193:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750 00000100:00100000:2.0:1789304985.875199:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785747328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304985.875200:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:3.0:1789304985.875206:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785746816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304985.875246:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785747328:12345-0@lo:400:kworker.0 Request processed in 47us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304985.875254:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750 00000100:00100000:2.0:1789304985.875292:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785747456 00000100:00100000:2.0:1789304985.875296:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785747456 00000100:00100000:2.0:1789304985.875322:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785747072 00000100:00100000:2.0:1789304985.875327:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785747072 00000100:00100000:2.0:1789304985.875349:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1789304985.875370:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785747456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304985.875408:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785747456:12345-0@lo:400:kworker.0 Request processed in 53us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304985.875414:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1789304985.875427:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1789304985.875433:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785747072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304985.875462:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785747072:12345-0@lo:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304985.875468:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1789304985.875514:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785747072:0@lo:400:kworker.0 00000100:00100000:2.0:1789304985.875526:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785747456:0@lo:400:kworker.0 00000100:00100000:3.0:1789304985.879265:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785746816:12345-0@lo:400:kworker.0 Request processed in 4043us (4211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304985.879283:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1789304985.880557:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785746816:0@lo:400:kworker.0 00000100:00100000:2.0:1789304985.880592:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785747328:0@lo:400:kworker.0 00000100:00080000:2.0:1789304985.880700:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304985.880781:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785747200:12345-0@lo:400:kworker.0 Request processed in 5849us (6016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304985.880794:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00100000:0.0:1789304985.880845:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785747200:0@lo:400:kworker.0 00000100:00080000:2.0:1789304985.880942:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304985.881174:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785746944:12345-0@lo:400:kworker.0 Request processed in 6266us (6516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304985.881189:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1748 00000100:00100000:2.0:1789304985.881317:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785746944:0@lo:400:kworker.0 00010000:00010000:2.0:1789304985.938781:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304986.962391:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304987.358203:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304987.358446:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765672832 00000100:00100000:2.0:1789304987.358463:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765672832 00000100:00100000:2.0:1789304987.358575:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1149 00000100:00100000:2.0:1789304987.358589:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:57914:x1876219765672832:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789304987.358725:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:57914:x1876219765672832:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 139us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304987.358733:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1149 00000100:00080000:0.0:1789304987.358932:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304987.360916:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304987.361654:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765672960 00000100:00100000:2.0:1789304987.361673:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765672960 00000100:00100000:2.0:1789304987.361793:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 630 00000100:00100000:2.0:1789304987.361805:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:57914:x1876219765672960:12345-192.168.202.29@tcp:19:lfs.0 00000100:00080000:0.0:1789304987.361936:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304987.362372:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:57914:x1876219765672960:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 557us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304987.362381:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 630 00000100:00100000:1.0:1789304987.364388:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304987.364564:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765673088 00000100:00100000:2.0:1789304987.364577:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765673088 00000100:00100000:2.0:1789304987.364740:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 631 00000100:00100000:2.0:1789304987.364753:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:57914:x1876219765673088:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304987.365556:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:57914:x1876219765673088:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 800us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304987.365567:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 631 00000100:00080000:0.0:1789304987.366613:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304987.373780:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304987.373973:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765673216 00000100:00100000:0.0:1789304987.373987:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765673216 00000100:00100000:0.0:1789304987.374117:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1150 00000100:00100000:0.0:1789304987.374130:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:57914:x1876219765673216:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789304987.375556:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:57914:x1876219765673216:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 1419us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304987.375572:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1150 00000100:00100000:0.0:1789304987.396566:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304987.396689:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765673344 00000100:00100000:1.0:1789304987.396707:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765673344 00000100:00100000:1.0:1789304987.396806:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1151 00000100:00100000:1.0:1789304987.396819:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:57914:x1876219765673344:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789304987.396946:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:57914:x1876219765673344:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 130us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304987.396955:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1151 00000100:00100000:1.0:1789304987.416140:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304987.421177:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765673472 00000100:00100000:2.0:1789304987.421200:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765673472 00000100:00100000:2.0:1789304987.421299:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 632 00000100:00100000:2.0:1789304987.421311:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:57914:x1876219765673472:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789304987.421892:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:57914:x1876219765673472:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 581us (5768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304987.421902:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 632 00000100:00100000:3.0:1789304987.425304:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304987.425348:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765673600 00000100:00100000:3.0:1789304987.425361:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765673600 00000100:00100000:3.0:1789304987.425427:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 633 00000100:00100000:3.0:1789304987.425440:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:57914:x1876219765673600:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:3.0:1789304987.425920:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:57914:x1876219765673600:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 482us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304987.425929:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 633 00000100:00100000:2.0:1789304987.440172:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304987.440231:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765673728 00000100:00100000:3.0:1789304987.440245:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765673728 00000100:00100000:3.0:1789304987.440320:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1152 00000100:00100000:3.0:1789304987.440334:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:57914:x1876219765673728:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789304987.440912:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:57914:x1876219765673728:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 579us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304987.440922:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1152 00010000:00010000:2.0:1789304987.989075:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304988.435804:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785747584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304988.435899:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304988.436948:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785747584 00000100:00100000:1.0:1789304988.436965:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785747584 00000100:00100000:1.0:1789304988.437087:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1789304988.437125:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785747584:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304988.437131:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789304988.437178:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304988.437275:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785747584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304988.437284:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:3.0:1789304988.437371:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785747584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789304988.521745:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304988.521813:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304988.521848:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765673856 00000100:00100000:3.0:1789304988.521862:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765673856 00000100:00100000:0.0:1789304988.521895:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765673984 00000100:00100000:0.0:1789304988.521899:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765673984 00000100:00100000:3.0:1789304988.521933:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1365 00000100:00100000:0.0:1789304988.521940:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1751 00000100:00100000:3.0:1789304988.521944:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765673856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304988.521946:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765673984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304988.522052:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765673984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304988.522060:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1751 00000100:00100000:3.0:1789304988.525469:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765673856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 3506us (3719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304988.525488:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1365 00000100:00100000:3.0:1789304988.531765:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304988.531825:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304988.531845:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765674240 00000100:00100000:1.0:1789304988.531861:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765674240 00000100:00100000:1.0:1789304988.531929:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765674112 00000100:00100000:1.0:1789304988.531933:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765674112 00000100:00100000:1.0:1789304988.531959:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1348 00000100:00100000:1.0:1789304988.531971:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765674240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304988.532081:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765674240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 111us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304988.532107:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1348 00000100:00100000:1.0:1789304988.532127:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1349 00000100:00100000:1.0:1789304988.532133:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765674112:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304988.532159:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765674112:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304988.532165:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1349 00010000:00010000:3.0:1789304989.022461:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304989.415466:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304989.415569:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765674368 00000100:00100000:1.0:1789304989.415583:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765674368 00000100:00100000:1.0:1789304989.415677:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1153 00000100:00100000:1.0:1789304989.415690:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:57928:x1876219765674368:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:1.0:1789304989.415719:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304989.415749:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231297a2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008ab expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.415842:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297a32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.415861:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.415878:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304989.415925:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:1.0:1789304989.415930:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304989.415957:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297a32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.416002:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370000/0xefc0bb7231297a2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ab expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.416024:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297a32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ab expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.416034:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:1.0:1789304989.416038:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789304989.416041:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370e00, rc 0) 00000100:00100000:1.0:1789304989.416143:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:57928:x1876219765674368:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 455us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304989.416151:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1153 00000100:00080000:3.0:1789304989.416225:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789304989.421414:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304989.421490:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765674624 00000100:00100000:3.0:1789304989.421505:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765674624 00000100:00100000:3.0:1789304989.421602:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1154 00000100:00100000:3.0:1789304989.421616:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:57928:x1876219765674624:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304989.421689:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304989.421727:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297a32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ab expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.421756:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb72312979d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100896 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.421770:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304989.421799:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304989.421838:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.421855:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.421868:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304989.467856:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785747712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789304989.467982:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304989.469291:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785747712 00000100:00100000:2.0:1789304989.469307:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785747712 00000100:00100000:2.0:1789304989.469414:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1789304989.469428:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785747712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789304989.469486:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789304989.469607:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785747712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304989.469616:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1789304989.469698:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785747712:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789304989.471416:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789304989.482607:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967737 is committed 00000004:00010000:3.0:1789304989.482676:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055a6ab3b reply state 00000000d2a4e08b transno 4294967737 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304989.482694:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304989.482716:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00080000:3.0:1789304989.482849:0:30980:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304989.482873:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:57928:x1876219765674624:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 61253us (61463us total) trans 4294967737 rc 0/0 00000100:00100000:3.0:1789304989.482884:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1154 00010000:00010000:3.0:1789304989.482932:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.482942:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.482952:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.482959:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304989.482965:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.482988:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.483011:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19b00) 00010000:00010000:3.0:1789304989.483014:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789304989.483021:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.483029:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304989.550174:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304989.550301:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765674752 00000100:00100000:0.0:1789304989.550318:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765674752 00000100:00100000:0.0:1789304989.550711:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1155 00000100:00100000:0.0:1789304989.550726:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:57932:x1876219765674752:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:0.0:1789304989.550759:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304989.550787:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297a40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008b2 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.550886:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297a47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.550904:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297a47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.550918:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297a47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.550935:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297a4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.550942:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297a4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.550949:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297a4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551463:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297a55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551477:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551485:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304989.551513:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:0.0:1789304989.551518:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304989.551546:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551562:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297a47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551568:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297a47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551577:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297a47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551584:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304989.551590:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297a47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551613:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297a47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551628:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:0.0:1789304989.551631:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304989.551638:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297a47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551650:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297a47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551668:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297a4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551676:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297a4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551682:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297a4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551688:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304989.551692:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297a4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551700:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297a4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551708:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c0558db00) 00010000:00010000:0.0:1789304989.551711:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304989.551714:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297a4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551720:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297a4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551757:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297a40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008b2 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551773:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297a55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008b2 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.551782:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:0.0:1789304989.551785:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304989.551787:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb800, rc 0) 00000100:00100000:0.0:1789304989.551888:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:57932:x1876219765674752:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 1165us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304989.551897:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1155 00000100:00100000:0.0:1789304989.555692:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304989.555795:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765675008 00000100:00100000:3.0:1789304989.555808:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765675008 00000100:00100000:3.0:1789304989.555891:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1156 00000100:00100000:3.0:1789304989.555904:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:57932:x1876219765675008:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789304989.555932:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789304989.555959:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008b9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.556386:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297a63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.556405:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297a63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.556420:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297a63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.556437:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.556446:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.556455:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789304989.557292:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24:0x0], index 1: 0 00010000:00010000:3.0:1789304989.557640:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297a71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557657:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557669:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557714:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297a63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557721:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297a63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557729:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297a63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557735:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304989.557740:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297a63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557748:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297a63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557763:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:3.0:1789304989.557767:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304989.557774:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297a63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557781:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297a63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304989.557798:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adbae0b3 reply state 000000007b93ce5e transno 4294967738 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304989.557809:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789304989.557856:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297a5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008b9 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557873:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297a71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008b9 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304989.557881:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:3.0:1789304989.557884:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789304989.557886:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f600, rc 0) 00000100:00100000:3.0:1789304989.557992:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:57932:x1876219765675008:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 2090us (2315us total) trans 4294967738 rc 0/0 00000100:00100000:3.0:1789304989.558003:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1156 00010000:00010000:2.0:1789304989.567425:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.567449:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.567459:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.567466:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304989.567473:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.567482:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.567504:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c2ea19b00) 00010000:00010000:2.0:1789304989.567508:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304989.567514:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.567526:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297a6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304989.567669:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304989.567763:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765675264 00000100:00100000:0.0:1789304989.567778:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765675264 00000100:00100000:0.0:1789304989.567867:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1157 00000100:00100000:0.0:1789304989.567881:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:57932:x1876219765675264:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:0.0:1789304989.567961:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304989.567994:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297a71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008b9 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.568846:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9e2c2ea19300) 00010000:00010000:0.0:1789304989.568866:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304989.569149:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.569176:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.569187:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304989.569348:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d9ce84d reply state 0000000080a36458 transno 4294967739 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304989.569359:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304989.569499:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:57932:x1876219765675264:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 1617us (2410us total) trans 4294967739 rc 0/0 00000100:00100000:2.0:1789304989.569509:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1157 00000100:00100000:2.0:1789304989.577689:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304989.577790:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765675392 00000100:00100000:1.0:1789304989.577805:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765675392 00000100:00100000:1.0:1789304989.577882:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1158 00000100:00100000:1.0:1789304989.577895:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:57932:x1876219765675392:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:1.0:1789304989.577931:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304989.577960:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297a86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008c0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.578056:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008c0 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.578075:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008c0 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.578132:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:1.0:1789304989.578136:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789304989.578141:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370a00, rc 0) 00000100:00100000:1.0:1789304989.578238:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:57932:x1876219765675392:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 345us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304989.578246:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1158 00010000:00010000:0.0:1789304989.578687:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.578699:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.578707:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.578713:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304989.578720:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.578730:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.578744:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:0.0:1789304989.578748:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304989.578752:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.578759:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297a7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304989.581771:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304989.581926:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765675520 00000100:00100000:1.0:1789304989.581941:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765675520 00000100:00100000:1.0:1789304989.582383:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 634 00000100:00100000:1.0:1789304989.582395:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765675520:12345-192.168.202.29@tcp:2:touch.60003 00000100:00100000:1.0:1789304989.582816:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765675520:12345-192.168.202.29@tcp:2:touch.60003 Request processed in 422us (1062us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1789304989.582822:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 634 00000100:00080000:3.0:1789304989.584635:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789304989.588627:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304989.588720:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765675776 00000100:00100000:2.0:1789304989.588738:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765675776 00000100:00100000:2.0:1789304989.588826:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 117 00000100:00100000:2.0:1789304989.588839:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:57932:x1876219765675776:12345-192.168.202.29@tcp:35:touch.60003 00000100:00100000:2.0:1789304989.589777:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:57932:x1876219765675776:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 937us (1155us total) trans 4294967740 rc 0/0 00000100:00100000:2.0:1789304989.589785:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 117 00000100:00100000:0.0:1789304989.649445:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304989.649501:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765675904 00000100:00100000:1.0:1789304989.649516:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765675904 00000100:00100000:1.0:1789304989.649635:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1159 00000100:00100000:1.0:1789304989.649735:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:57936:x1876219765675904:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:1.0:1789304989.649768:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789304989.649795:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297a8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008c7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.649877:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297a94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.649897:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.649923:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.649942:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.649950:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.649957:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650181:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297aa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650192:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650199:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789304989.650248:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5f:0x0]: returning size 0 00000004:00200000:1.0:1789304989.650254:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789304989.650287:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650302:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650312:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297a94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650319:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297a94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650327:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650333:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304989.650339:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650358:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297a94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650372:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:1.0:1789304989.650377:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304989.650383:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297a94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650389:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297a94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650407:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650413:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297a9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650419:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650424:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304989.650426:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650432:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297a9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650438:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c14add200) 00010000:00010000:1.0:1789304989.650441:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304989.650444:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297a9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650449:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297a9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650488:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297a8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008c7 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650503:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008c7 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304989.650511:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:1.0:1789304989.650513:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789304989.650516:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370400, rc 0) 00000100:00100000:1.0:1789304989.650619:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:57936:x1876219765675904:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 886us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304989.650628:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1159 00000100:00100000:0.0:1789304989.654808:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304989.654898:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765676032 00000100:00100000:2.0:1789304989.654923:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765676032 00000100:00100000:2.0:1789304989.655009:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 635 00000100:00100000:2.0:1789304989.655032:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765676032:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:2.0:1789304989.655059:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304989.655138:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231297aa9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008ce expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304989.655180:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x6aa6a09d, atime: 0x6aa6a09d, ctime: 0x6aa6a09d, blocks: 0x1 00010000:00010000:2.0:1789304989.655213:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=2439s v=(0 0) 00010000:00010000:2.0:1789304989.655219:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304989.655231:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231297aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ce expref: 7 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.655259:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231297aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ce expref: 7 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.655276:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789304989.655360:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765676032:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 332us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304989.655368:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 635 00000100:00100000:3.0:1789304989.660473:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304989.663921:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765676288 00000100:00100000:1.0:1789304989.663947:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765676288 00000100:00100000:1.0:1789304989.664072:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1160 00000100:00100000:2.0:1789304989.664390:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:57936:x1876219765676288:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:2.0:1789304989.664468:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789304989.664507:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297aa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008c7 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.664532:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297a86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008c0 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.664541:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9e2c421d2600) 00010000:00010000:2.0:1789304989.664556:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789304989.664583:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297ab0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.664607:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.664616:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.664628:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.664633:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.664638:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.665001:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297abe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.665011:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297abe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.665034:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297abe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789304989.669739:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].36, 64 off10496 00000004:00080000:2.0:1789304989.669760:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2439347669141ns, next at 2440347664779ns, rc = 0 00010000:00010000:2.0:1789304989.669866:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.669884:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.669895:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.669903:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.669910:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.669917:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.669955:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789304989.670001:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297abe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.670009:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297abe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.670521:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297abe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.670529:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304989.670533:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297abe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.670541:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297abe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.670555:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9e2c421d2200) 00010000:00010000:2.0:1789304989.670557:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789304989.670562:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297abe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.670566:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297abe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.670589:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297ab0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.670755:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304989.670762:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.670767:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304989.670769:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.670774:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.670781:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9e2c421d2200) 00010000:00010000:0.0:1789304989.670782:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789304989.670784:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.670791:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297ac5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304989.670814:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304989.670815:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304989.670816:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304989.671472:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297ab0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.671479:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297ab0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.671485:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304989.671489:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297ab0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.671496:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297ab0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.671508:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:2.0:1789304989.671510:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304989.671513:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297ab0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.671517:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297ab0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304989.671534:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b12e2386 reply state 0000000058c8496c transno 4294967741 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304989.671542:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789304989.673734:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:57936:x1876219765676288:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 9635us (13261us total) trans 4294967741 rc 0/0 00000100:00100000:2.0:1789304989.673754:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1160 00010000:00010000:2.0:1789304989.687495:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.687521:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.687531:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.687538:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304989.687545:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.687555:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.687579:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c421d2000) 00010000:00010000:2.0:1789304989.687583:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304989.687589:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304989.687607:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297ab7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304990.034825:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304990.084708:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967368 is committed 00000100:00100000:0.0:1789304990.713761:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304990.713840:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765676416 00000100:00100000:2.0:1789304990.713852:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765676416 00000100:00100000:2.0:1789304990.713944:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1161 00000100:00100000:2.0:1789304990.713956:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:57951:x1876219765676416:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304990.713999:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304990.714022:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297acc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008d5 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.714120:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297ad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.714136:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.714151:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304990.714193:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:2.0:1789304990.714198:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304990.714219:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.714243:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297acc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008d5 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.714260:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008d5 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.714268:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:2.0:1789304990.714271:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304990.714275:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecde00, rc 0) 00000100:00100000:2.0:1789304990.714337:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:57951:x1876219765676416:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 383us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304990.714343:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1161 00000100:00100000:3.0:1789304990.719557:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304990.719597:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765676672 00000100:00100000:3.0:1789304990.719608:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765676672 00000100:00100000:3.0:1789304990.719661:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1162 00000100:00100000:3.0:1789304990.719673:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:57951:x1876219765676672:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789304990.719725:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789304990.719754:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297ad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008d5 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304990.719781:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297a55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008b2 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304990.719791:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:3.0:1789304990.719802:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304990.719828:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304990.719841:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304990.719852:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789304990.775213:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967741 is committed 00000004:00080000:2.0:1789304990.775228:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 103 committed 00000001:00080000:2.0:1789304990.775251:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967742 is committed 00000100:00100000:2.0:1789304990.775395:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785747840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789304990.775468:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304990.775540:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785747840 00000100:00100000:2.0:1789304990.775547:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785747840 00000100:00100000:2.0:1789304990.775597:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1789304990.775605:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785747840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789304990.775635:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:36 count 1 00010000:00010000:2.0:1789304990.775659:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.775682:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231297aa9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ce expref: 5 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.775692:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789304990.775697:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304990.775701:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.775731:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231297aa9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ce expref: 5 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.775747:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231297aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ce expref: 5 pid: 17212 timeout: 2540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304990.775759:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04162d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785747968:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789304990.775816:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f709cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1789304990.775833:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00010000:3.0:1789304990.776315:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000daa79d61 reply state 000000004d8e2b9c transno 4294967742 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304990.776329:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789304990.776341:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00080000:3.0:1789304990.776418:0:5853:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789304990.776430:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:57951:x1876219765676672:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 56759us (56884us total) trans 4294967742 rc 0/0 00000100:00100000:3.0:1789304990.776438:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1162 00010000:00010000:1.0:1789304990.776550:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304990.776560:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304990.776566:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304990.776573:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304990.776578:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304990.776586:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304990.776606:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c2ea19000) 00010000:00010000:1.0:1789304990.776609:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304990.776614:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304990.776620:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297ada lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304990.782778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304990.782812:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765676800 00000100:00100000:0.0:1789304990.782822:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765676800 00010000:00010000:0.0:1789304990.782866:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231297aa9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ce expref: 6 pid: 17212 timeout: 2540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789304990.782905:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 450 00000100:00100000:0.0:1789304990.782916:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c200d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765676800:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789304990.782933:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789304990.782939:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231297aa9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ce expref: 6 pid: 17212 timeout: 2540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.782954:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231297aa9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ce expref: 6 pid: 17212 timeout: 2540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.782993:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304990.782998:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789304990.783003:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.783027:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.783049:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789304990.783131:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c200d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765676800:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 216us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304990.783139:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 450 00010000:00010000:2.0:1789304990.787335:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000018044c6/0xefc0bb7231297aa9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ce expref: 5 pid: 17212 timeout: 2540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304990.787360:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04162d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1876219785747968:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789304990.787389:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.787403:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.787410:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.787421:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.787429:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304990.787467:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789304990.788386:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789304990.788396:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.788406:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789304990.788410:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.788420:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.788439:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.788447:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9816aac/0xefc0bb7231297ae1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.788467:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304990.788469:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789304990.788471:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304990.789001:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785747840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13393us (13529us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789304990.789143:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000004:00080000:0.0:1789304990.791264:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b04160a80/2, rc 0, transno 4294967369 00000100:00100000:0.0:1789304990.791281:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785747840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789304990.854436:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304990.854537:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765676928 00000100:00100000:0.0:1789304990.854549:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765676928 00000100:00100000:0.0:1789304990.854613:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1163 00000100:00100000:0.0:1789304990.854625:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:57955:x1876219765676928:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:0.0:1789304990.854651:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304990.854675:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297ae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008dc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.854744:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297aef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.854760:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297aef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.854770:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297aef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.854907:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297af6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.854916:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.854924:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856557:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297afd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856575:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856586:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304990.856617:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:0.0:1789304990.856622:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304990.856643:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856656:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297aef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856663:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297aef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856670:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297aef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856675:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304990.856679:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297aef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856687:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297aef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856699:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:0.0:1789304990.856702:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304990.856707:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297aef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856717:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297aef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856732:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856737:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297af6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856741:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297af6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856746:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304990.856748:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297af6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856754:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297af6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856760:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c0558db00) 00010000:00010000:0.0:1789304990.856762:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304990.856765:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297af6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856770:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297af6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856805:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297ae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008dc expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856820:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008dc expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304990.856828:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:0.0:1789304990.856830:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304990.856832:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbc00, rc 0) 00000100:00100000:0.0:1789304990.856909:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:57955:x1876219765676928:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 2286us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304990.856918:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1163 00000100:00100000:0.0:1789304990.997317:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785748224:0@lo:400:kworker.0 00000100:00100000:0.0:1789304990.997412:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304990.997476:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789304990.997482:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785748096:0@lo:400:kworker.0 00000100:00100000:0.0:1789304990.997517:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304990.997538:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785748608:0@lo:400:kworker.0 00000100:00100000:0.0:1789304990.997560:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304990.997593:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785748224 00000100:00100000:0.0:1789304990.997601:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785748224 00000100:00100000:0.0:1789304990.997645:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785748608 00000100:00100000:0.0:1789304990.997647:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785748608 00000100:00100000:0.0:1789304990.997677:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752 00000100:00100000:0.0:1789304990.997685:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785748224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789304990.997736:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785748224:12345-0@lo:400:kworker.0 Request processed in 51us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304990.997743:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752 00000100:00100000:0.0:1789304990.997761:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:0.0:1789304990.997767:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785748608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304990.997940:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785748480:0@lo:400:kworker.0 00000100:00100000:1.0:1789304990.997983:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304990.998007:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789304990.998013:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785748352:0@lo:400:kworker.0 00000100:00100000:1.0:1789304990.998037:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304990.998084:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785748480 00000100:00100000:1.0:1789304990.998113:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785748480 00000100:00100000:1.0:1789304990.998141:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:1.0:1789304990.998147:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785748480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304990.998182:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785748480:12345-0@lo:400:kworker.0 Request processed in 35us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304990.998188:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000100:00100000:1.0:1789304990.998228:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785748224:0@lo:400:kworker.0 00000100:00100000:1.0:1789304990.998255:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785748480:0@lo:400:kworker.0 00000100:00100000:2.0:1789304990.998437:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785748096 00000100:00100000:2.0:1789304990.998443:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785748096 00000100:00100000:2.0:1789304990.998482:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1789304990.998490:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785748096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304990.998535:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785748096:12345-0@lo:400:kworker.0 Request processed in 46us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304990.998541:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1789304990.998576:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785748352 00000100:00100000:2.0:1789304990.998580:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785748352 00000100:00100000:2.0:1789304990.998605:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:2.0:1789304990.998612:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785748352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304990.998648:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785748352:12345-0@lo:400:kworker.0 Request processed in 36us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304990.998654:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00080000:2.0:1789304990.998677:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304990.998694:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785748096:0@lo:400:kworker.0 00000100:00100000:2.0:1789304990.998714:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785748352:0@lo:400:kworker.0 00000100:00100000:1.0:1789304991.000696:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785748608:12345-0@lo:400:kworker.0 Request processed in 2917us (3123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304991.000712:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000100:00100000:2.0:1789304991.000982:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785748608:0@lo:400:kworker.0 00010000:00010000:0.0:1789304991.060141:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789304991.799827:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304991.802263:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765677056 00000100:00100000:1.0:1789304991.802277:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765677056 00000100:00080000:3.0:1789304991.807707:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304991.807772:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1164 00000100:00100000:2.0:1789304991.807787:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:57969:x1876219765677056:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789304991.807808:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304991.807829:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297b04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008e3 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304991.807895:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297b0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304991.807910:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304991.807924:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789304991.808063:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:2.0:1789304991.808068:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789304991.808184:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304991.808215:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297b04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008e3 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304991.808233:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008e3 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304991.808240:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:2.0:1789304991.808243:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789304991.808246:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd800, rc 0) 00000100:00100000:2.0:1789304991.808348:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:57969:x1876219765677056:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 565us (9407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304991.808356:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1164 00000100:00100000:2.0:1789304991.811468:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304991.811539:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765677312 00000100:00100000:1.0:1789304991.811550:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765677312 00000100:00100000:1.0:1789304991.811605:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1165 00000100:00100000:1.0:1789304991.811616:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:57969:x1876219765677312:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789304991.811674:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789304991.811700:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297b0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008e3 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304991.811721:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297afd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008dc expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304991.811731:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558dc00) 00010000:00010000:1.0:1789304991.811741:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789304991.811766:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304991.811778:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304991.811788:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789304991.812478:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000996b7475 reply state 00000000ae91c3a2 transno 4294967743 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304991.812490:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789304991.812499:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000100:00100000:1.0:1789304991.812585:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:57969:x1876219765677312:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 970us (1125us total) trans 4294967743 rc 0/0 00000100:00100000:1.0:1789304991.812596:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1165 00010000:00010000:1.0:1789304991.815745:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304991.815761:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304991.815769:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304991.815775:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370e00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304991.815780:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304991.815788:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304991.815805:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c14add100) 00010000:00010000:1.0:1789304991.815808:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789304991.815813:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304991.815819:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370e00/0xefc0bb7231297b12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304991.942396:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304991.942481:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765677440 00000100:00100000:1.0:1789304991.942491:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765677440 00000100:00100000:1.0:1789304991.942547:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1166 00000100:00100000:1.0:1789304991.942558:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:57981:x1876219765677440:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304991.942654:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:57981:x1876219765677440:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 98us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304991.942662:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1166 00000100:00100000:3.0:1789304991.944336:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304991.944390:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765677568 00000100:00100000:2.0:1789304991.944398:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765677568 00000100:00080000:3.0:1789304991.944446:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789304991.944468:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 637 00000100:00100000:2.0:1789304991.944478:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:57981:x1876219765677568:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304991.944941:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:57981:x1876219765677568:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 463us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304991.944961:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 637 00000100:00100000:3.0:1789304991.950312:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304991.950679:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765677696 00000100:00100000:2.0:1789304991.950689:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765677696 00000100:00080000:3.0:1789304991.950738:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304991.950764:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 638 00000100:00100000:2.0:1789304991.950775:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:57981:x1876219765677696:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789304991.951323:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:57981:x1876219765677696:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 548us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304991.951332:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 638 00000100:00100000:0.0:1789304991.953294:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304991.954134:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765677824 00000100:00100000:2.0:1789304991.954145:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765677824 00000100:00100000:2.0:1789304991.954215:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1167 00000100:00100000:2.0:1789304991.954225:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:57981:x1876219765677824:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304991.954569:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:57981:x1876219765677824:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 345us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304991.954578:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1167 00000100:00100000:3.0:1789304991.958117:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304991.958718:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765677952 00000100:00100000:2.0:1789304991.958728:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765677952 00000100:00100000:2.0:1789304991.958787:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1168 00000100:00100000:2.0:1789304991.958797:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:57981:x1876219765677952:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304991.958902:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:57981:x1876219765677952:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 105us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304991.958910:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1168 00000100:00100000:1.0:1789304991.964369:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304991.964741:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765678080 00000100:00100000:2.0:1789304991.964764:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765678080 00000100:00100000:2.0:1789304991.964823:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 639 00000100:00100000:2.0:1789304991.964834:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:57981:x1876219765678080:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304991.965388:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:57981:x1876219765678080:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 554us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304991.965397:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 639 00000100:00100000:0.0:1789304991.968488:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304991.968581:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765678208 00000100:00100000:2.0:1789304991.968590:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765678208 00000100:00100000:2.0:1789304991.968708:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 640 00000100:00100000:2.0:1789304991.968716:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:57981:x1876219765678208:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304991.969067:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:57981:x1876219765678208:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 350us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304991.969076:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 640 00000100:00100000:3.0:1789304991.971710:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304991.971876:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765678336 00000100:00100000:1.0:1789304991.971886:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765678336 00000100:00100000:1.0:1789304991.971957:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1169 00000100:00100000:1.0:1789304991.971967:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:57981:x1876219765678336:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789304991.972463:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:57981:x1876219765678336:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 497us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304991.972472:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1169 00000100:00100000:1.0:1789304992.036468:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304992.036567:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765678464 00000100:00100000:0.0:1789304992.036577:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765678464 00000100:00100000:0.0:1789304992.036646:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1170 00000100:00100000:0.0:1789304992.036655:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:57985:x1876219765678464:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789304992.036675:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789304992.036697:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297b19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.036776:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297b20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.036790:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.036801:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.036815:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.036822:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.036828:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037205:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297b2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037213:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037217:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789304992.037234:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:0.0:1789304992.037237:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789304992.037251:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297b2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037260:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037265:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297b20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037269:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297b20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037272:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304992.037276:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297b20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037283:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297b20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037293:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:0.0:1789304992.037297:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304992.037301:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037307:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037319:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037323:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037327:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037330:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789304992.037331:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037335:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037339:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c0558db00) 00010000:00010000:0.0:1789304992.037340:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789304992.037342:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037345:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037366:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297b19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ea expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037379:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297b2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ea expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789304992.037383:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558da00) 00010000:00010000:0.0:1789304992.037385:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789304992.037387:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afac00, rc 0) 00000100:00100000:0.0:1789304992.037438:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:57985:x1876219765678464:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 785us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304992.037445:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1170 00000100:00100000:1.0:1789304992.041399:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304992.041592:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765678720 00000100:00100000:2.0:1789304992.041604:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765678720 00000100:00100000:2.0:1789304992.041667:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1171 00000100:00100000:2.0:1789304992.041678:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:57985:x1876219765678720:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:2.0:1789304992.041699:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304992.041718:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297b35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008f1 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.042262:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297b3c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.042278:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297b3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.042290:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297b3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.042303:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.042310:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.042316:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789304992.043503:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25:0x0], index 0: 0 00010000:00010000:2.0:1789304992.043761:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297b4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.043775:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.043785:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.043824:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297b3c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.043836:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297b3c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.043843:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297b3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.043850:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304992.043854:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297b3c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.044536:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297b3c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.044550:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558da00) 00010000:00010000:2.0:1789304992.044553:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304992.044558:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297b3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.044563:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297b3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789304992.044578:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd076729 reply state 00000000508acf41 transno 4294967744 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304992.044586:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789304992.044626:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297b35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f1 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.044641:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f1 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.044653:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789304992.044655:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789304992.044658:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc800, rc 0) 00000100:00100000:2.0:1789304992.044780:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:57985:x1876219765678720:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 3103us (3390us total) trans 4294967744 rc 0/0 00000100:00100000:2.0:1789304992.044789:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1171 00010000:00010000:2.0:1789304992.046830:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.046846:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.046853:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.046869:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789304992.046874:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.046882:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.046896:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c421d2000) 00010000:00010000:2.0:1789304992.046899:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789304992.046915:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.046922:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304992.056274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304992.056361:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765678848 00000100:00100000:2.0:1789304992.056371:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765678848 00000100:00100000:2.0:1789304992.056427:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 641 00000100:00100000:2.0:1789304992.056435:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:57985:x1876219765678848:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:2.0:1789304992.056452:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789304992.056472:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b0a1dc7/0xefc0bb7231297b58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008f8 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789304992.056498:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789304992.056519:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=2441s v=(0 0) 00010000:00010000:2.0:1789304992.056523:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789304992.056532:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b0a1dc7/0xefc0bb7231297b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f8 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.056549:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b0a1dc7/0xefc0bb7231297b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f8 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304992.056560:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd400, rc 0) 00000100:00100000:2.0:1789304992.056614:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:57985:x1876219765678848:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 179us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304992.056621:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 641 00000100:00100000:3.0:1789304992.072240:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304992.072359:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765678976 00000100:00100000:2.0:1789304992.072370:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765678976 00002000:00100000:2.0:1789304992.072423:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x25:0x0] (0->1048575) req@ffff9e2c385e8000 x1876219765678976/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:303/0 lens 488/0 e 0 to 0 dl 1789305003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789304992.072436:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c385e8000 with x1876219765678976 ext(0->1048575) 00002000:00010000:2.0:1789304992.072441:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2c385e8000 00000100:00100000:2.0:1789304992.072467:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 29 00000100:00100000:2.0:1789304992.072478:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765678976:12345-192.168.202.29@tcp:4:dd.60003 00010000:00010000:1.0:1789304992.082316:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789304992.085372:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765678976:12345-192.168.202.29@tcp:4:dd.60003 Request processed in 12884us (13132us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789304992.085387:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 29 00002000:00100000:3.0:1789304992.085399:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x25:0x0] (0->1048575) req@ffff9e2c385e8000 x1876219765678976/t4294967370(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:303/0 lens 488/448 e 0 to 0 dl 1789305003 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1789304992.085409:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c385e8000 with x1876219765678976 ext(0->1048575) 00002000:00010000:3.0:1789304992.085415:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9e2c385e8000 00000100:00100000:3.0:1789304992.087505:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304992.087571:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765679104 00000100:00100000:2.0:1789304992.087580:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765679104 00000100:00100000:2.0:1789304992.087630:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1172 00000100:00100000:2.0:1789304992.087639:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:57985:x1876219765679104:12345-192.168.202.29@tcp:44:dd.60003 00000001:00080000:1.0:1789304992.112630:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967743 is committed 00000001:00080000:1.0:1789304992.112646:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967744 is committed 00000100:00100000:3.0:1789304992.112956:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:57985:x1876219765679104:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 25306us (25445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304992.112968:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1172 00000100:00100000:1.0:1789304992.115308:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789304992.115420:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765679232 00000100:00100000:0.0:1789304992.115429:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765679232 00000100:00100000:0.0:1789304992.115474:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 642 00000100:00100000:0.0:1789304992.115480:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765679232:12345-192.168.202.29@tcp:16:dd.60003 00000001:00080000:3.0:1789304992.159212:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00000100:00100000:0.0:1789304992.159645:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765679232:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 44157us (44336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304992.159658:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 642 00000100:00100000:1.0:1789304992.166432:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304992.166603:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765679488 00000100:00100000:2.0:1789304992.166614:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765679488 00000100:00100000:2.0:1789304992.166711:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 118 00000100:00100000:2.0:1789304992.166723:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:57985:x1876219765679488:12345-192.168.202.29@tcp:35:dd.60003 00000100:00100000:2.0:1789304992.167255:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:57985:x1876219765679488:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 533us (1369us total) trans 4294967745 rc 0/0 00000100:00100000:2.0:1789304992.167263:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 118 00010000:00010000:0.0:1789304993.106224:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789304993.290073:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967745 is committed 00000100:00100000:0.0:1789304993.556423:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789304993.556447:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785748736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789304993.556524:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304993.556629:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785748736 00000100:00100000:1.0:1789304993.556639:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785748736 00000100:00100000:1.0:1789304993.556705:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1789304993.556715:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785748736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789304993.556749:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789304993.556801:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785748736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304993.556808:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1789304993.556850:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785748736:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789304993.556915:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304993.636392:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304993.636446:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304993.636487:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304993.636518:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304993.636580:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765679616 00000100:00100000:3.0:1789304993.636590:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765679616 00000100:00100000:3.0:1789304993.636656:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1367 00000100:00100000:3.0:1789304993.636668:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765679616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789304993.636760:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765679616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304993.636768:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1367 00000100:00100000:0.0:1789304993.637421:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765680000 00000100:00100000:0.0:1789304993.637428:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765680000 00000100:00100000:0.0:1789304993.637487:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765679872 00000100:00100000:0.0:1789304993.637491:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765679872 00000100:00100000:0.0:1789304993.637518:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1351 00000100:00100000:0.0:1789304993.637527:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765680000:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304993.637575:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765680000:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 49us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304993.637582:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1351 00000100:00100000:0.0:1789304993.637598:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1352 00000100:00100000:0.0:1789304993.637604:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765679872:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304993.637636:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765679872:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304993.637642:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1352 00000100:00080000:3.0:1789304993.638689:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304993.638697:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789304993.638960:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765679744 00000100:00100000:1.0:1789304993.638971:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765679744 00000100:00100000:1.0:1789304993.639039:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1755 00000100:00100000:1.0:1789304993.639050:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2357:x1876219765679744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304993.639143:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2357:x1876219765679744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 96us (2761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304993.639150:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1755 00000100:00080000:3.0:1789304993.639955:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789304994.130223:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789304994.582203:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785748864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789304994.582347:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304994.582432:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785748864 00000100:00100000:1.0:1789304994.582439:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785748864 00000100:00100000:1.0:1789304994.582497:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1789304994.582507:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785748864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304994.582545:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789304994.582594:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785748864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304994.582602:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00080000:1.0:1789304994.582625:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789304994.582664:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785748864:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1789304994.589006:0:99126:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2444266911974ns, next at 2420368973213ns, rc = 0 00000004:00080000:2.0:1789304994.589173:0:99126:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2444267082102ns, next at 2440347664779ns, rc = 0 00000004:00080000:1.0:1789304994.600725:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 104 committed 00000004:00080000:1.0:1789304994.600755:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 96 committed 00010000:00010000:2.0:1789304995.154535:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789304995.161432:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967369 is committed 00000100:00100000:0.0:1789304996.065763:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304996.065849:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765680128 00000100:00100000:2.0:1789304996.065860:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765680128 00000100:00100000:2.0:1789304996.065947:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1173 00000100:00100000:2.0:1789304996.065958:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:58178:x1876219765680128:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789304996.066058:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:58178:x1876219765680128:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 102us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304996.066066:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1173 00000100:00080000:3.0:1789304996.066548:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789304996.073137:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304996.076380:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765680256 00000100:00100000:2.0:1789304996.076396:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765680256 00000100:00100000:2.0:1789304996.076478:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 643 00000100:00100000:2.0:1789304996.076491:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:58178:x1876219765680256:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304996.076884:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:58178:x1876219765680256:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 395us (3758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304996.076889:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 643 00000100:00080000:3.0:1789304996.077183:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304996.093328:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304996.093403:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765680384 00000100:00100000:2.0:1789304996.093414:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765680384 00000100:00080000:3.0:1789304996.093470:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789304996.093487:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 644 00000100:00100000:2.0:1789304996.093499:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58178:x1876219765680384:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789304996.094005:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58178:x1876219765680384:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 507us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304996.094012:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 644 00000100:00100000:0.0:1789304996.095993:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304996.096081:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765680512 00000100:00100000:3.0:1789304996.096128:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765680512 00000100:00100000:3.0:1789304996.096189:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1174 00000100:00100000:3.0:1789304996.096200:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:58178:x1876219765680512:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304996.096581:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:58178:x1876219765680512:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 381us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304996.096590:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1174 00000100:00100000:0.0:1789304996.100250:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304996.100524:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765680640 00000100:00100000:3.0:1789304996.100535:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765680640 00000100:00100000:3.0:1789304996.100591:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1175 00000100:00100000:3.0:1789304996.100603:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:58178:x1876219765680640:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304996.100706:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:58178:x1876219765680640:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 105us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304996.100714:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1175 00000100:00100000:2.0:1789304996.107173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304996.107499:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765680768 00000100:00100000:3.0:1789304996.107510:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765680768 00000100:00100000:3.0:1789304996.107576:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 645 00000100:00100000:3.0:1789304996.107588:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:58178:x1876219765680768:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304996.107995:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04163b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:58178:x1876219765680768:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 408us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304996.108003:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 645 00000100:00100000:3.0:1789304996.114896:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304996.114955:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765680896 00000100:00100000:2.0:1789304996.114967:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765680896 00000100:00100000:2.0:1789304996.115038:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 646 00000100:00100000:2.0:1789304996.115048:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58178:x1876219765680896:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789304996.115602:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58178:x1876219765680896:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 554us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304996.115608:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 646 00000100:00100000:3.0:1789304996.116621:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785749120:0@lo:400:kworker.0 00000100:00100000:3.0:1789304996.116673:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304996.116720:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785749632:0@lo:400:kworker.0 00000100:00100000:3.0:1789304996.116749:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304996.116774:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789304996.116792:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785749248:0@lo:400:kworker.0 00000100:00100000:3.0:1789304996.116815:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304996.116846:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785749120 00000100:00100000:3.0:1789304996.116865:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785749120 00000100:00100000:3.0:1789304996.116921:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756 00000100:00100000:3.0:1789304996.116930:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785749120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789304996.117177:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785749376:0@lo:400:kworker.0 00000100:00100000:2.0:1789304996.117208:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304996.117237:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789304996.117243:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785748992:0@lo:400:kworker.0 00000100:00100000:2.0:1789304996.117274:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789304996.117296:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785749504:0@lo:400:kworker.0 00000100:00100000:2.0:1789304996.117319:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789304996.117454:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785749120:12345-0@lo:400:kworker.0 Request processed in 525us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304996.117460:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756 00000100:00100000:3.0:1789304996.117474:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785749376 00000100:00100000:3.0:1789304996.117476:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785749376 00000100:00100000:3.0:1789304996.117498:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785749504 00000100:00100000:3.0:1789304996.117500:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785749504 00000100:00100000:3.0:1789304996.117509:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:3.0:1789304996.117514:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785749376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304996.117539:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785749376:12345-0@lo:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304996.117542:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00100000:3.0:1789304996.117550:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:3.0:1789304996.117553:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785749504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304996.117569:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785749504:12345-0@lo:400:kworker.0 Request processed in 16us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304996.117572:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:3.0:1789304996.117584:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785749632 00000100:00100000:3.0:1789304996.117586:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785749632 00000100:00100000:3.0:1789304996.117601:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785749248 00000100:00100000:3.0:1789304996.117602:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785749248 00000100:00100000:3.0:1789304996.117613:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:3.0:1789304996.117616:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785749632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304996.117634:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785749632:12345-0@lo:400:kworker.0 Request processed in 18us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304996.117638:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:3.0:1789304996.117643:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1789304996.117647:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785749248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789304996.117673:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785749248:12345-0@lo:400:kworker.0 Request processed in 26us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304996.117676:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00080000:3.0:1789304996.117690:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789304996.117693:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789304996.117694:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789304996.117713:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785749504:0@lo:400:kworker.0 00000100:00100000:3.0:1789304996.117719:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785749376:0@lo:400:kworker.0 00000100:00100000:1.0:1789304996.117826:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785748992 00000100:00100000:1.0:1789304996.117831:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785748992 00000100:00100000:1.0:1789304996.117862:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:1.0:1789304996.117867:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785748992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789304996.117892:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785748992:12345-0@lo:400:kworker.0 Request processed in 26us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304996.117896:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1789304996.117986:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785749248:0@lo:400:kworker.0 00000100:00100000:2.0:1789304996.117998:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785749120:0@lo:400:kworker.0 00000100:00100000:2.0:1789304996.118008:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:2.0:1789304996.118014:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b04160a80, transno 4294967369 00000100:00100000:2.0:1789304996.118032:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785749632:0@lo:400:kworker.0 00000100:00100000:3.0:1789304996.118126:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785748992:0@lo:400:kworker.0 00000100:00100000:1.0:1789304996.121577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304996.121755:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765681024 00000100:00100000:3.0:1789304996.121765:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765681024 00000100:00100000:3.0:1789304996.121837:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1176 00000100:00100000:3.0:1789304996.121858:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:58178:x1876219765681024:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789304996.124932:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:58178:x1876219765681024:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 2935us (3212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789304996.124947:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1176 00010000:00010000:1.0:1789304996.183022:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304996.223577:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304996.223702:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765681280 00000100:00100000:3.0:1789304996.223713:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765681280 00000100:00100000:3.0:1789304996.223776:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1177 00000100:00100000:3.0:1789304996.223787:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:58182:x1876219765681280:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:3.0:1789304996.223842:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789304996.223869:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297b4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f1 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.223890:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:3.0:1789304996.223901:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789304996.223933:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b5f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.223950:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.223975:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.223990:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.223997:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.224004:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.224361:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297b6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.224371:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297b6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.224378:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297b6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789304996.225237:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].37, 64 off10560 00000004:00080000:3.0:1789304996.225251:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2445903158339ns, next at 2446903155623ns, rc = 0 00010000:00010000:3.0:1789304996.225344:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225358:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225369:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225376:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225382:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225387:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225415:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789304996.225438:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297b6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225445:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297b6d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225451:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297b6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225456:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304996.225461:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297b6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225468:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297b6d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225477:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304996.225480:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789304996.225485:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297b6d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225490:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297b6d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225507:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b5f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225514:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b5f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225523:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225528:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789304996.225530:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b5f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225535:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b5f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225542:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558da00) 00010000:00010000:3.0:1789304996.225544:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789304996.225547:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b5f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225552:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b5f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789304996.225560:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000106fb4bb reply state 000000000ef2a180 transno 4294967746 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789304996.225569:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789304996.225651:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:58182:x1876219765681280:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 1863us (2081us total) trans 4294967746 rc 0/0 00000100:00100000:3.0:1789304996.225659:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1177 00010000:00010000:3.0:1789304996.225695:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304996.225701:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225707:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304996.225711:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225718:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225726:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9e2c2ea19c00) 00010000:00010000:3.0:1789304996.225729:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789304996.225732:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225737:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297b74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304996.225750:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304996.225752:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789304996.225754:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304996.233064:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304996.233084:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304996.233123:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304996.233130:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789304996.233135:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304996.233144:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304996.233163:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff9e2c2ea19600) 00010000:00010000:1.0:1789304996.233166:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789304996.233171:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304996.233178:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297b66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304997.205947:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789304998.227358:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304998.441733:0:99273:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2448119639249ns, next at 2446903155623ns, rc = 0 00000004:00080000:1.0:1789304998.470055:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 98 committed 00000001:00080000:1.0:1789304998.470083:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967746 is committed 00000004:00080000:1.0:1789304998.470111:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 97 committed 00000100:00100000:1.0:1789304998.470243:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785749760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789304998.470310:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304998.470400:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785749760 00000100:00100000:1.0:1789304998.470408:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785749760 00000100:00100000:1.0:1789304998.470458:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1789304998.470468:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785749760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789304998.470496:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:37 count 1 00010000:00010000:1.0:1789304998.470522:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304998.470545:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b0a1dc7/0xefc0bb7231297b58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f8 expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304998.470555:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x25:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1789304998.470560:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789304998.470565:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304998.470594:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b0a1dc7/0xefc0bb7231297b58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f8 expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304998.470609:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b0a1dc7/0xefc0bb7231297b58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f8 expref: 5 pid: 6691 timeout: 2548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304998.470620:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785749888:192.168.202.29@tcp:104: 00000100:00100000:1.0:1789304998.470678:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c11baf840 going to sleep for 11 seconds 00000100:00080000:1.0:1789304998.470691:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789304998.475785:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789304998.475899:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765681408 00000100:00100000:2.0:1789304998.475909:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765681408 00010000:00010000:2.0:1789304998.475967:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b0a1dc7/0xefc0bb7231297b58 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f8 expref: 6 pid: 6691 timeout: 2548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789304998.476010:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 451 00000100:00100000:2.0:1789304998.476020:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765681408:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789304998.476036:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789304998.476042:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b0a1dc7/0xefc0bb7231297b58 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f8 expref: 6 pid: 6691 timeout: 2548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304998.476057:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b0a1dc7/0xefc0bb7231297b58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f8 expref: 6 pid: 6691 timeout: 2548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304998.476083:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304998.476122:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789304998.476129:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304998.476140:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304998.476163:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789304998.476214:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765681408:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 196us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304998.476222:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 451 00000100:00080000:3.0:1789304998.476343:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789304998.476677:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b0a1dc7/0xefc0bb7231297b58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008f8 expref: 5 pid: 6691 timeout: 2548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789304998.476694:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1876219785749888:192.168.202.29@tcp:104: 00010000:00010000:1.0:1789304998.476718:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304998.476729:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304998.476736:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304998.476747:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304998.476754:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789304998.476819:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789304998.477470:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785749760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7002us (7158us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789304998.477480:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000004:00080000:2.0:1789304998.477583:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c411e7b80/2, rc 0, transno 4294967371 00000100:00100000:2.0:1789304998.477603:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785749760:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789304998.477809:0:99273:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2448155718030ns, next at 2440347664779ns, rc = 0 00010000:00010000:3.0:1789304998.482385:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789304998.482402:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304998.482418:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789304998.482423:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304998.482436:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304998.482463:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789304998.482473:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c66e249/0xefc0bb7231297b7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789304998.483512:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304998.483519:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789304998.483521:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789304998.490016:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 105 committed 00000100:00100000:2.0:1789304998.687053:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785750016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789304998.687150:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789304998.687539:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785750016 00000100:00100000:0.0:1789304998.687548:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785750016 00000100:00100000:0.0:1789304998.687682:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:0.0:1789304998.687693:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785750016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789304998.687730:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789304998.687788:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785750016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304998.687795:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00080000:0.0:1789304998.687827:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304998.687859:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785750016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789304998.759365:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304998.759418:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789304998.759467:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789304998.759570:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765681664 00000100:00100000:1.0:1789304998.759581:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765681664 00000100:00100000:1.0:1789304998.759659:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1759 00000100:00100000:1.0:1789304998.759669:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765681664:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789304998.759750:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765681664:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304998.759757:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1759 00000100:00080000:3.0:1789304998.759919:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789304998.759981:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765681536 00000100:00100000:2.0:1789304998.759987:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765681536 00000100:00100000:2.0:1789304998.760024:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1369 00000100:00100000:2.0:1789304998.760032:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765681536:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789304998.760072:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765681536:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 42us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789304998.760082:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1369 00000100:00100000:0.0:1789304998.760754:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765681792 00000100:00100000:0.0:1789304998.760761:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765681792 00000100:00080000:3.0:1789304998.760824:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789304998.760824:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1355 00000100:00100000:0.0:1789304998.760833:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765681792:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789304998.760892:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765681792:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 51us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789304998.760899:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1355 00010000:00010000:1.0:1789304999.251339:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789304999.698379:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789304999.698406:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785750144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789304999.698487:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789304999.698669:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785750144 00000100:00100000:1.0:1789304999.698678:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785750144 00000100:00100000:1.0:1789304999.698737:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1789304999.698747:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785750144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789304999.698783:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789304999.698848:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fdd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785750144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789304999.698856:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1789304999.698993:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785750144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789305000.274295:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305001.236883:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785750400:0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.237084:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305001.238784:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785750912:0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.238833:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305001.238870:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789305001.238876:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785750272:0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.238904:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305001.240053:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785750784:0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.240513:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305001.240558:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785750656:0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.240588:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305001.240613:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789305001.240620:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fdd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785750528:0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.240649:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305001.242267:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785750400 00000100:00100000:3.0:1789305001.242283:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785750400 00000100:00100000:2.0:1789305001.242805:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785750912 00000100:00100000:2.0:1789305001.242811:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785750912 00000100:00100000:2.0:1789305001.242857:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785750528 00000100:00100000:2.0:1789305001.242871:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785750528 00000100:00100000:2.0:1789305001.242898:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1789305001.242998:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785750784 00000100:00100000:3.0:1789305001.243002:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785750784 00000100:00100000:3.0:1789305001.243023:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785750656 00000100:00100000:3.0:1789305001.243026:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785750656 00000100:00100000:3.0:1789305001.243040:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760 00000100:00100000:3.0:1789305001.243047:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785750400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305001.243584:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785750400:0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.243762:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785750912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305001.243883:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1789305001.243894:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785750528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.244228:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785750912:12345-0@lo:400:kworker.0 Request processed in 1322us (5393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305001.244236:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1789305001.244273:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785750912:0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.246727:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:2.0:1789305001.246747:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785750784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.246854:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785750784:12345-0@lo:400:kworker.0 Request processed in 114us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305001.246870:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00100000:2.0:1789305001.246895:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:2.0:1789305001.246902:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785750656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.246950:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785750656:12345-0@lo:400:kworker.0 Request processed in 49us (6361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305001.246955:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:2.0:1789305001.246976:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785750272 00000100:00100000:2.0:1789305001.246983:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785750272 00000100:00100000:2.0:1789305001.247027:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1789305001.247033:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785750272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305001.247064:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785750272:12345-0@lo:400:kworker.0 Request processed in 31us (8159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305001.247070:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1789305001.247511:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785750656:0@lo:400:kworker.0 00000100:00100000:0.0:1789305001.248212:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785750272:0@lo:400:kworker.0 00000100:00100000:0.0:1789305001.248234:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785750784:0@lo:400:kworker.0 00000100:00100000:3.0:1789305001.248425:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785750400:12345-0@lo:400:kworker.0 Request processed in 5375us (11340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305001.248434:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760 00000100:00080000:3.0:1789305001.248461:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789305001.248467:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789305001.248469:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305001.256255:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785750528:12345-0@lo:400:kworker.0 Request processed in 12354us (15594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305001.256271:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1789305001.257214:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fdd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785750528:0@lo:400:kworker.0 00010000:00010000:2.0:1789305001.299358:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789305001.330979:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00010000:00010000:1.0:1789305002.322956:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305003.346376:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305003.794289:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789305003.794313:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785751040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305003.794388:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305003.794888:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785751040 00000100:00100000:3.0:1789305003.794897:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785751040 00000100:00080000:2.0:1789305003.795021:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305003.795108:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1789305003.795118:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785751040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789305003.795160:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305003.795271:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785751040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305003.795279:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1789305003.799660:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785751040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305003.879789:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305003.879852:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305003.879876:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765681920 00000100:00100000:2.0:1789305003.879899:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765681920 00000100:00100000:2.0:1789305003.879970:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1371 00000100:00100000:2.0:1789305003.879981:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765681920:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305003.880040:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765682048 00000100:00100000:3.0:1789305003.880047:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765682048 00000100:00100000:2.0:1789305003.880065:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765681920:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305003.880075:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1371 00000100:00100000:3.0:1789305003.880139:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1763 00000100:00100000:3.0:1789305003.880149:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765682048:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305003.880184:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765682048:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305003.880190:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1763 00000100:00080000:2.0:1789305003.880267:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305003.882335:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305003.882374:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305003.882401:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765682176 00000100:00100000:2.0:1789305003.882414:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765682176 00000100:00100000:2.0:1789305003.882487:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765682304 00000100:00100000:2.0:1789305003.882491:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765682304 00000100:00080000:3.0:1789305003.882498:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789305003.882504:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305003.882520:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1358 00000100:00100000:2.0:1789305003.882530:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765682176:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305003.882611:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765682176:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305003.882619:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1358 00000100:00100000:2.0:1789305003.882639:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1359 00000100:00100000:2.0:1789305003.882647:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765682304:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305003.882677:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765682304:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305003.882683:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1359 00010000:00010000:2.0:1789305004.370301:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305004.819308:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305004.819334:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785751168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305004.819413:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305004.819822:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785751168 00000100:00100000:0.0:1789305004.819840:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785751168 00000100:00100000:0.0:1789305004.819910:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:0.0:1789305004.819921:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785751168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305004.819957:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305004.820015:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785751168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305004.820022:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:0.0:1789305004.820063:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967371 gen 2 00000004:00080000:0.0:1789305004.820067:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c411e7b80, transno 4294967371 00000100:00100000:0.0:1789305004.820084:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785751168:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789305004.821247:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789305005.394403:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305006.356401:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785751680:0@lo:400:kworker.0 00000100:00100000:3.0:1789305006.356478:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305006.356550:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789305006.356557:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785751552:0@lo:400:kworker.0 00000100:00100000:3.0:1789305006.356599:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305006.356651:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785751680 00000100:00100000:3.0:1789305006.356659:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785751680 00000100:00100000:3.0:1789305006.357006:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1764 00000100:00100000:3.0:1789305006.357117:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785751680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305006.357182:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785751680:12345-0@lo:400:kworker.0 Request processed in 98us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305006.357189:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1764 00000100:00100000:0.0:1789305006.357406:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785751296:0@lo:400:kworker.0 00000100:00100000:0.0:1789305006.357445:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305006.357474:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785751808:0@lo:400:kworker.0 00000100:00100000:0.0:1789305006.357497:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305006.357519:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789305006.357525:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785751424:0@lo:400:kworker.0 00000100:00100000:0.0:1789305006.357546:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305006.357564:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785751936:0@lo:400:kworker.0 00000100:00100000:3.0:1789305006.357696:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785751808 00000100:00080000:2.0:1789305006.357858:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305006.357873:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785751552 00000100:00100000:2.0:1789305006.357879:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785751552 00000100:00100000:2.0:1789305006.357930:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:2.0:1789305006.357938:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785751552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305006.357977:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785751552:12345-0@lo:400:kworker.0 Request processed in 40us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305006.357983:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00080000:2.0:1789305006.358006:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789305006.358034:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785751424 00000100:00100000:2.0:1789305006.358040:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785751424 00000100:00100000:2.0:1789305006.358063:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765 00000100:00100000:2.0:1789305006.358069:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785751424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305006.358125:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785751424:12345-0@lo:400:kworker.0 Request processed in 56us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305006.358132:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765 00000100:00100000:2.0:1789305006.358184:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785751552:0@lo:400:kworker.0 00000100:00100000:2.0:1789305006.358199:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b04088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785751680:0@lo:400:kworker.0 00000100:00100000:2.0:1789305006.358260:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785751296 00000100:00100000:2.0:1789305006.358264:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785751296 00000100:00100000:2.0:1789305006.358289:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1789305006.358295:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785751296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305006.358326:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785751296:12345-0@lo:400:kworker.0 Request processed in 32us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305006.358332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1789305006.360212:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305006.360288:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785751296:0@lo:400:kworker.0 00000100:00100000:0.0:1789305006.360318:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785751424:0@lo:400:kworker.0 00000100:00100000:3.0:1789305006.360984:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785751808 00000100:00080000:1.0:1789305006.361980:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305006.362014:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766 00000100:00100000:1.0:1789305006.362027:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785751808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305006.362154:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785751808:12345-0@lo:400:kworker.0 Request processed in 131us (4654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305006.362162:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766 00000100:00100000:2.0:1789305006.362553:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785751936 00000100:00100000:2.0:1789305006.362562:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785751936 00000100:00100000:2.0:1789305006.362616:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:2.0:1789305006.362624:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785751936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305006.362663:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785751936:12345-0@lo:400:kworker.0 Request processed in 40us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305006.362669:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:3.0:1789305006.364054:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785751936:0@lo:400:kworker.0 00000100:00100000:3.0:1789305006.364073:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785751808:0@lo:400:kworker.0 00000100:00080000:1.0:1789305006.364430:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789305006.418401:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305007.443404:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305008.471989:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305008.914496:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785752064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789305008.914575:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305008.915417:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785752064 00000100:00100000:0.0:1789305008.915427:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785752064 00000100:00100000:0.0:1789305008.915502:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:0.0:1789305008.915513:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785752064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789305008.915570:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305008.915687:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785752064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305008.915694:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1789305008.915767:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785752064:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789305008.915906:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305008.996269:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305008.996367:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765682432 00000100:00100000:1.0:1789305008.996379:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765682432 00000100:00100000:1.0:1789305008.996440:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1373 00000100:00100000:1.0:1789305008.996451:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765682432:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305008.996531:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765682432:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305008.996539:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1373 00000100:00100000:3.0:1789305009.006477:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305009.006519:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305009.006550:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305009.006632:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765682816 00000100:00100000:0.0:1789305009.006641:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765682816 00000100:00100000:0.0:1789305009.006701:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765682688 00000100:00100000:0.0:1789305009.006704:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765682688 00000100:00100000:0.0:1789305009.006724:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1362 00000100:00100000:0.0:1789305009.006734:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765682816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305009.006824:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765682816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 92us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305009.006832:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1362 00000100:00100000:0.0:1789305009.006849:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1363 00000100:00100000:0.0:1789305009.006854:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765682688:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305009.006879:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765682688:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305009.006885:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1363 00000100:00100000:2.0:1789305009.007132:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765682560 00000100:00100000:2.0:1789305009.007137:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765682560 00000100:00100000:2.0:1789305009.007182:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1767 00000100:00100000:2.0:1789305009.007190:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765682560:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305009.007237:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765682560:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 48us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305009.007242:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1767 00000100:00080000:3.0:1789305009.007444:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789305009.007449:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789305009.007451:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789305009.490421:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305009.938441:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785752192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305009.938519:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305009.938961:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785752192 00000100:00100000:1.0:1789305009.938969:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785752192 00000100:00100000:1.0:1789305009.939051:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1789305009.939059:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785752192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305009.939106:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305009.939175:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785752192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305009.939182:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:2.0:1789305009.940113:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785752192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789305009.941257:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789305010.514348:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305011.475265:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785752448:0@lo:400:kworker.0 00000100:00100000:1.0:1789305011.475277:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785752576:0@lo:400:kworker.0 00000100:00100000:0.0:1789305011.475370:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785752320:0@lo:400:kworker.0 00000100:00100000:3.0:1789305011.475571:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785752704:0@lo:400:kworker.0 00000100:00100000:2.0:1789305011.476940:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305011.477006:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785752960:0@lo:400:kworker.0 00000100:00100000:2.0:1789305011.477039:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305011.477109:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785752448 00000100:00100000:2.0:1789305011.477118:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785752448 00000100:00100000:2.0:1789305011.477167:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768 00000100:00100000:2.0:1789305011.477175:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785752448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305011.477329:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785752448:12345-0@lo:400:kworker.0 Request processed in 154us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305011.477338:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768 00000100:00100000:2.0:1789305011.477383:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785752448:0@lo:400:kworker.0 00000100:00100000:2.0:1789305011.477416:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785752960 00000100:00100000:2.0:1789305011.477420:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785752960 00000100:00100000:2.0:1789305011.477459:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1789305011.477465:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785752960:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789305011.477944:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305011.478334:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785752960:12345-0@lo:400:kworker.0 Request processed in 867us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305011.478343:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1789305011.478416:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785752960:0@lo:400:kworker.0 00000100:00100000:1.0:1789305011.483272:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305011.483379:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785752576 00000100:00100000:1.0:1789305011.483390:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785752576 00000100:00100000:1.0:1789305011.483452:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:1.0:1789305011.483462:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785752576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305011.483533:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785752576:12345-0@lo:400:kworker.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305011.483540:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00080000:1.0:1789305011.483565:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305011.483722:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785752576:0@lo:400:kworker.0 00000100:00100000:0.0:1789305011.489852:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305011.489923:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785752832:0@lo:400:kworker.0 00000100:00100000:0.0:1789305011.489967:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305011.490084:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785752320 00000100:00100000:2.0:1789305011.490120:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785752320 00000100:00100000:2.0:1789305011.490169:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1789305011.490179:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785752320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305011.490243:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785752320:12345-0@lo:400:kworker.0 Request processed in 65us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305011.490250:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1789305011.490299:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785752320:0@lo:400:kworker.0 00000100:00100000:1.0:1789305011.490487:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785752832 00000100:00100000:1.0:1789305011.490492:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785752832 00000100:00100000:1.0:1789305011.490546:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:1.0:1789305011.490555:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785752832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305011.490601:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785752832:12345-0@lo:400:kworker.0 Request processed in 48us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305011.490607:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00100000:1.0:1789305011.490638:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785752832:0@lo:400:kworker.0 00000100:00080000:2.0:1789305011.490786:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305011.492018:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305011.492167:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785752704 00000100:00100000:0.0:1789305011.492178:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785752704 00000100:00100000:0.0:1789305011.492251:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:0.0:1789305011.492259:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785752704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305011.492330:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785752704:12345-0@lo:400:kworker.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305011.492337:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00080000:2.0:1789305011.492408:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305011.492484:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785752704:0@lo:400:kworker.0 00010000:00010000:2.0:1789305011.540328:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305012.563425:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305013.586429:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305014.036326:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789305014.036349:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785753088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305014.036417:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305014.036772:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785753088 00000100:00100000:1.0:1789305014.036781:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785753088 00000100:00100000:1.0:1789305014.036853:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1789305014.036866:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785753088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305014.036898:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305014.036949:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785753088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305014.036956:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00080000:2.0:1789305014.037039:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305014.037174:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785753088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305014.113193:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305014.114716:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305014.114855:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765683072 00000100:00100000:1.0:1789305014.114868:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765683072 00000100:00100000:1.0:1789305014.114968:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1771 00000100:00100000:1.0:1789305014.114981:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765683072:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305014.115054:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765683072:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305014.115061:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1771 00000100:00080000:3.0:1789305014.115348:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305014.115581:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765682944 00000100:00100000:2.0:1789305014.115587:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765682944 00000100:00100000:2.0:1789305014.115638:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1375 00000100:00100000:2.0:1789305014.115647:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765682944:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305014.115695:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765682944:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 48us (2513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305014.115702:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1375 00000100:00100000:0.0:1789305014.123526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305014.123572:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305014.123811:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765683328 00000100:00100000:3.0:1789305014.123823:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765683328 00000100:00100000:3.0:1789305014.123906:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765683200 00000100:00100000:3.0:1789305014.123910:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765683200 00000100:00100000:3.0:1789305014.123944:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1366 00000100:00100000:3.0:1789305014.123954:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765683328:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305014.124032:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765683328:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305014.124040:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1366 00000100:00100000:3.0:1789305014.124057:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1367 00000100:00100000:3.0:1789305014.124064:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765683200:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305014.124121:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765683200:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305014.124127:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1367 00000100:00080000:0.0:1789305014.124403:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789305014.124408:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789305014.611808:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305015.059207:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c411e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785753216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305015.059282:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305015.059463:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785753216 00000100:00100000:0.0:1789305015.059471:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785753216 00000100:00100000:0.0:1789305015.059552:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:0.0:1789305015.059563:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785753216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305015.059596:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305015.059643:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785753216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305015.059650:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00080000:3.0:1789305015.060025:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305015.060066:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c411e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785753216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789305015.636343:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305016.212430:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305016.212492:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765683456 00000100:00100000:0.0:1789305016.212503:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765683456 00000100:00100000:0.0:1789305016.212585:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1178 00000100:00100000:0.0:1789305016.212597:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:58440:x1876219765683456:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789305016.212701:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:58440:x1876219765683456:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305016.212709:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1178 00000100:00080000:3.0:1789305016.212793:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305016.219233:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305016.219280:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765683584 00000100:00100000:1.0:1789305016.219291:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765683584 00000100:00100000:1.0:1789305016.219358:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 648 00000100:00100000:1.0:1789305016.219370:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c411e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:58440:x1876219765683584:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789305016.219981:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c411e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:58440:x1876219765683584:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 611us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305016.219991:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 648 00000100:00080000:1.0:1789305016.220020:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305016.228888:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305016.228963:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765683712 00000100:00100000:0.0:1789305016.228975:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765683712 00000100:00100000:0.0:1789305016.229046:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 649 00000100:00100000:0.0:1789305016.229059:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58440:x1876219765683712:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789305016.229472:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58440:x1876219765683712:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 416us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305016.229479:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 649 00000100:00080000:1.0:1789305016.229551:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305016.233658:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305016.233735:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765683840 00000100:00100000:2.0:1789305016.233748:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765683840 00000100:00100000:2.0:1789305016.233817:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1179 00000100:00100000:2.0:1789305016.233828:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:58440:x1876219765683840:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789305016.234475:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:58440:x1876219765683840:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 644us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305016.234484:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1179 00000100:00100000:2.0:1789305016.240023:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305016.240152:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765683968 00000100:00100000:0.0:1789305016.240165:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765683968 00000100:00100000:0.0:1789305016.240227:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1180 00000100:00100000:0.0:1789305016.240239:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:58440:x1876219765683968:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789305016.240360:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:58440:x1876219765683968:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 122us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305016.240369:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1180 00000100:00100000:3.0:1789305016.251066:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305016.251188:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765684096 00000100:00100000:3.0:1789305016.251200:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765684096 00000100:00100000:3.0:1789305016.251258:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 650 00000100:00100000:3.0:1789305016.251268:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:58440:x1876219765684096:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789305016.253480:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:58440:x1876219765684096:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 2201us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305016.253492:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 650 00000100:00100000:1.0:1789305016.260842:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305016.261763:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765684224 00000100:00100000:0.0:1789305016.261777:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765684224 00000100:00100000:0.0:1789305016.261838:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 651 00000100:00100000:0.0:1789305016.261848:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:58440:x1876219765684224:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789305016.262264:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:58440:x1876219765684224:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 416us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305016.262273:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 651 00000100:00100000:3.0:1789305016.267916:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305016.268053:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765684352 00000100:00100000:1.0:1789305016.268065:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765684352 00000100:00100000:1.0:1789305016.268229:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1181 00000100:00100000:1.0:1789305016.268243:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:58440:x1876219765684352:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789305016.268728:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:58440:x1876219765684352:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 479us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305016.268738:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1181 00000100:00100000:3.0:1789305016.303308:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305016.308550:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765684480 00000100:00100000:2.0:1789305016.308564:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765684480 00000100:00100000:2.0:1789305016.309117:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1182 00000100:00100000:2.0:1789305016.309132:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:58441:x1876219765684480:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789305016.309154:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305016.309180:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861008ff expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305016.309253:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231297b89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305016.309269:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231297b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305016.309281:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231297b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789305016.309316:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:2.0:1789305016.309318:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789305016.309334:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231297b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305016.309355:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297b82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ff expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305016.309371:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231297b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ff expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305016.309379:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558da00) 00010000:00010000:2.0:1789305016.309382:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789305016.309386:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd200, rc 0) 00000100:00100000:2.0:1789305016.309464:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:58441:x1876219765684480:12345-192.168.202.29@tcp:101:rm.0 Request processed in 335us (6167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305016.309472:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1182 00000100:00100000:1.0:1789305016.314878:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305016.314998:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765684736 00000100:00100000:3.0:1789305016.315011:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765684736 00000100:00100000:3.0:1789305016.315164:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1183 00000100:00100000:3.0:1789305016.315178:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:58441:x1876219765684736:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789305016.315204:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305016.315229:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100906 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789305016.315339:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00010000:3.0:1789305016.315603:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100906 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305016.315619:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789305016.315622:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789305016.315628:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297b90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100906 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305016.315645:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789305016.315712:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:58441:x1876219765684736:12345-192.168.202.29@tcp:101:rm.0 Request processed in 536us (839us total) trans 4294967747 rc 301/301 00000100:00100000:3.0:1789305016.315738:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1183 00000100:00100000:3.0:1789305016.320568:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305016.330351:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765684864 00000100:00100000:1.0:1789305016.330366:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765684864 00000100:00100000:1.0:1789305016.330449:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 119 00000100:00100000:1.0:1789305016.330461:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:58441:x1876219765684864:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:0.0:1789305016.338618:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:58441:x1876219765684864:12345-192.168.202.29@tcp:37:rm.0 Request processed in 8150us (18053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305016.338634:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 119 00000100:00100000:1.0:1789305016.349945:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305016.350059:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765685120 00000100:00100000:3.0:1789305016.350072:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765685120 00000100:00100000:3.0:1789305016.350168:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 120 00000100:00100000:3.0:1789305016.350181:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:58441:x1876219765685120:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:3.0:1789305016.350509:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:58441:x1876219765685120:12345-192.168.202.29@tcp:35:rm.0 Request processed in 332us (574us total) trans 4294967748 rc 0/0 00000100:00100000:3.0:1789305016.350516:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 120 00000100:00100000:3.0:1789305016.359963:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305016.360013:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765685376 00000100:00100000:0.0:1789305016.360023:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765685376 00000100:00100000:0.0:1789305016.360087:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1184 00000100:00100000:0.0:1789305016.360110:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:58441:x1876219765685376:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:0.0:1789305016.360279:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789305016.360309:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231297b89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ff expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360336:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afac00/0xefc0bb7231297b2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861008ea expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360348:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558da00) 00010000:00010000:0.0:1789305016.360364:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb723129783a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100834 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360374:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:0.0:1789305016.360380:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789305016.360406:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360419:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360429:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360439:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360445:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360452:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360691:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297bac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360698:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297bac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.360702:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297bac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789305016.361746:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00010000:0.0:1789305016.361887:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297bac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.361947:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297bac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.361954:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297bac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.361961:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305016.361966:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297bac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.361976:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297bac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.361989:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9e2c0558d800) 00010000:00010000:0.0:1789305016.361992:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789305016.361996:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297bac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.362000:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297bac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.362020:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.362025:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b9e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.362031:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.362036:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305016.362039:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.362044:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b9e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.362051:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d500) 00010000:00010000:0.0:1789305016.362053:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305016.362055:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305016.362061:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297b9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789305016.362073:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6836f7f reply state 000000005a2bc88d transno 4294967749 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305016.362083:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789305016.365059:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:58441:x1876219765685376:12345-192.168.202.29@tcp:36:rm.0 Request processed in 4939us (5094us total) trans 4294967749 rc 0/0 00000100:00100000:0.0:1789305016.365076:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1184 00010000:00010000:3.0:1789305016.373172:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305016.373190:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305016.373200:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305016.373206:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305016.373210:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305016.373218:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305016.373236:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c0558d000) 00010000:00010000:3.0:1789305016.373240:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305016.373245:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305016.373251:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297ba5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305016.595691:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785753344:0@lo:400:kworker.0 00000100:00100000:0.0:1789305016.596680:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305016.596749:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785753856:0@lo:400:kworker.0 00000100:00100000:0.0:1789305016.597561:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305016.597601:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789305016.597609:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785753472:0@lo:400:kworker.0 00000100:00100000:0.0:1789305016.597635:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305016.597653:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785753984:0@lo:400:kworker.0 00000100:00100000:0.0:1789305016.597680:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305016.597714:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785753600:0@lo:400:kworker.0 00000100:00100000:0.0:1789305016.597749:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305016.597776:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789305016.597782:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785753728:0@lo:400:kworker.0 00000100:00100000:0.0:1789305016.597807:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305016.597841:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785753344 00000100:00100000:0.0:1789305016.597848:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785753344 00000100:00100000:0.0:1789305016.597896:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1789305016.597904:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785753344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305016.597954:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785753344:12345-0@lo:400:kworker.0 Request processed in 50us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305016.597962:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1789305016.597998:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785753856 00000100:00100000:0.0:1789305016.598002:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785753856 00000100:00100000:0.0:1789305016.598036:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785753472 00000100:00100000:0.0:1789305016.598039:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785753472 00000100:00100000:0.0:1789305016.598053:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785753728 00000100:00100000:0.0:1789305016.598056:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785753728 00000100:00100000:0.0:1789305016.598069:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772 00000100:00100000:0.0:1789305016.598074:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785753856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305016.600392:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785753344:0@lo:400:kworker.0 00000100:00100000:3.0:1789305016.600416:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785753856:0@lo:400:kworker.0 00000100:00100000:3.0:1789305016.600461:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773 00000100:00100000:3.0:1789305016.600487:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785753472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305016.604873:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785753856:12345-0@lo:400:kworker.0 Request processed in 6788us (7304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305016.604890:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772 00000100:00100000:0.0:1789305016.604929:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1774 00000100:00100000:0.0:1789305016.604945:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785753728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305016.605662:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785753472:12345-0@lo:400:kworker.0 Request processed in 5188us (8021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305016.605673:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773 00000100:00100000:3.0:1789305016.605706:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785753984 00000100:00100000:3.0:1789305016.605726:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785753984 00000100:00100000:3.0:1789305016.605843:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785753600 00000100:00100000:3.0:1789305016.605847:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785753600 00000100:00100000:3.0:1789305016.605874:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1789305016.605882:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785753984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305016.605923:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785753984:12345-0@lo:400:kworker.0 Request processed in 42us (8242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305016.605929:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1789305016.605940:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1789305016.605946:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785753600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305016.605980:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785753600:12345-0@lo:400:kworker.0 Request processed in 35us (8231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305016.605986:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:0.0:1789305016.606887:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785753728:12345-0@lo:400:kworker.0 Request processed in 1945us (9075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305016.606899:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1774 00000100:00080000:0.0:1789305016.606925:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789305016.606930:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305016.606967:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785753728:0@lo:400:kworker.0 00000100:00100000:0.0:1789305016.606980:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785753600:0@lo:400:kworker.0 00000100:00100000:3.0:1789305016.607064:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785753472:0@lo:400:kworker.0 00000100:00100000:3.0:1789305016.607081:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785753984:0@lo:400:kworker.0 00010000:00010000:2.0:1789305016.659403:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305017.682570:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305018.706521:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305019.155470:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789305019.155495:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785754112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305019.155574:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305019.155640:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785754112 00000100:00100000:1.0:1789305019.155648:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785754112 00000100:00100000:1.0:1789305019.155722:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1789305019.155732:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785754112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305019.155781:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305019.155836:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785754112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305019.155848:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00080000:1.0:1789305019.155876:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305019.155919:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785754112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305019.240540:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305019.240584:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305019.240611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305019.240633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305019.240659:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765685504 00000100:00100000:0.0:1789305019.240668:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765685504 00000100:00100000:0.0:1789305019.240746:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1377 00000100:00100000:0.0:1789305019.240763:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765685504:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305019.240835:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765685632 00000100:00100000:0.0:1789305019.240837:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765685504:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305019.240843:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765685632 00000100:00100000:0.0:1789305019.240849:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1377 00000100:00100000:3.0:1789305019.240901:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1775 00000100:00100000:3.0:1789305019.240912:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765685632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305019.241116:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765685632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 206us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305019.241125:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1775 00000100:00100000:3.0:1789305019.241145:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765685888 00000100:00100000:3.0:1789305019.241149:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765685888 00000100:00100000:3.0:1789305019.241238:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765685760 00000100:00100000:3.0:1789305019.241243:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765685760 00000100:00100000:0.0:1789305019.245942:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1370 00000100:00100000:1.0:1789305019.246052:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765685888:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305019.246162:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765685888:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 196us (5550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305019.246170:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1370 00000100:00100000:1.0:1789305019.246197:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1371 00000100:00100000:1.0:1789305019.246204:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765685760:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305019.246227:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765685760:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (5594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305019.246232:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1371 00000100:00080000:2.0:1789305019.249173:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789305019.249181:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789305019.249184:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789305019.266472:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967749 is committed 00000020:00000080:2.0:1789305019.637479:0:99639:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff12249fb0 20000000:00000080:2.0:1789305019.637497:0:99639:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854dc00 uarg=0000000000000000 10000000:01000000:2.0:1789305019.637548:0:99639:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305019.638019:0:99639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305019.638053:0:99639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129782c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297825 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305019.638060:0:99639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305019.638123:0:99639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129782c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297825 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305019.638135:0:99639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129782c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297825 expref: 18 pid: 5845 timeout: 2569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305019.638146:0:99639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99639:1876219785754240:0@lo:104: 00000100:00100000:2.0:1789305019.638235:0:99639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305019.638286:0:99639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789305019.638415:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785754240 00000100:00100000:3.0:1789305019.638424:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785754240 00000100:00100000:3.0:1789305019.638481:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789305019.638491:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:99639:x1876219785754240:12345-0@lo:104: 00010000:00010000:3.0:1789305019.638504:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638572:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305019.638578:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:99639:x1876219785754240:12345-0@lo:104: Request processed in 90us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305019.638585:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00010000:3.0:1789305019.638608:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789305019.638614:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638626:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371e00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789305019.638630:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638639:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789305019.638647:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305019.638653:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789305019.638683:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638700:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305019.638718:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638723:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41371e00/0xefc0bb7231297825 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129782c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638745:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305019.638746:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305019.638747:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305019.638763:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785754368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305019.638787:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305019.638817:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785754368 00000100:00100000:3.0:1789305019.638820:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785754368 00010000:00010000:3.0:1789305019.638833:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129782c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297825 expref: 19 pid: 5845 timeout: 2569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305019.638848:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1789305019.638852:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785754368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305019.638860:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305019.638863:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129782c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297825 expref: 19 pid: 5845 timeout: 2569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638869:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129782c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297825 expref: 19 pid: 5845 timeout: 2569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638881:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638886:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638895:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638899:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638904:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638908:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638911:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305019.638913:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638918:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638924:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305019.638930:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305019.638949:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785754368:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305019.638952:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1789305019.638978:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c09a06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785754368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305019.639214:0:99639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fe00/0xefc0bb723129782c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297825 expref: 18 pid: 5845 timeout: 2569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305019.639222:0:99639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99639:1876219785754240:0@lo:104: 00010000:00010000:2.0:1789305019.639233:0:99639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305019.639242:0:99639:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305019.639248:0:99639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305019.639255:0:99639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231297bb3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305019.730539:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305020.179247:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305020.179269:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785754496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305020.179341:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305020.179404:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785754496 00000100:00100000:1.0:1789305020.179412:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785754496 00000100:00100000:1.0:1789305020.179470:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1789305020.179479:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785754496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305020.179513:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305020.179559:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785754496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305020.179567:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00080000:1.0:1789305020.179588:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305020.179623:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785754496:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1789305020.592975:0:99687:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf069c3f0 20000000:00000080:2.0:1789305020.592993:0:99687:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3854cc00 uarg=0000000000000000 10000000:01000000:2.0:1789305020.593040:0:99687:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305020.593062:0:99687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305020.593078:0:99687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305020.593156:0:99687:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305020.593165:0:99687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305020.593172:0:99687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305020.593178:0:99687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305020.593184:0:99687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305020.593189:0:99687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305020.593196:0:99687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305020.593209:0:99687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305020.593221:0:99687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305020.593228:0:99687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231297bba lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305020.769511:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305021.588396:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305021.588405:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305021.588410:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305021.588456:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305021.588470:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305021.588482:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305021.588509:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785754624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305021.588579:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305021.588630:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789305021.591618:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785754624 00000100:00100000:3.0:1789305021.591636:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785754624 00000100:00100000:3.0:1789305021.591862:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1789305021.591874:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785754624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305021.591893:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305021.591916:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297bc8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297bc1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305021.591959:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297bc8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297bc1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305021.591971:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297bc8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297bc1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305021.591980:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789305021.592065:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785754624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305021.592073:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1789305021.592403:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785754624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305021.592424:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305021.592435:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305021.592457:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789305021.592463:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305021.592470:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305021.721870:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785754752:0@lo:400:kworker.0 00000100:00100000:3.0:1789305021.721947:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305021.722005:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785755264:0@lo:400:kworker.0 00000100:00100000:3.0:1789305021.722035:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305021.722066:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789305021.722072:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785755136:0@lo:400:kworker.0 00000100:00100000:3.0:1789305021.722121:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305021.722156:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785754880:0@lo:400:kworker.0 00000100:00100000:3.0:1789305021.722184:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305021.722201:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305021.722207:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785755008:0@lo:400:kworker.0 00000100:00100000:3.0:1789305021.722230:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305021.722307:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785755264 00000100:00100000:3.0:1789305021.722315:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785755264 00000100:00100000:3.0:1789305021.722372:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785754880 00000100:00100000:3.0:1789305021.722376:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785754880 00000100:00100000:3.0:1789305021.722405:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1789305021.722415:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785755264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305021.722475:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785755264:12345-0@lo:400:kworker.0 Request processed in 61us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305021.722482:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1789305021.722503:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:3.0:1789305021.722511:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785754880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305021.722550:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785754880:12345-0@lo:400:kworker.0 Request processed in 40us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305021.722556:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00080000:3.0:1789305021.722576:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305021.722616:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785754880:0@lo:400:kworker.0 00000100:00100000:3.0:1789305021.722657:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785755264:0@lo:400:kworker.0 00000100:00100000:0.0:1789305021.722993:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785754752 00000100:00100000:0.0:1789305021.723000:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785754752 00000100:00100000:0.0:1789305021.723042:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785755136 00000100:00100000:0.0:1789305021.723046:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785755136 00000100:00100000:0.0:1789305021.723070:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785755008 00000100:00100000:0.0:1789305021.723073:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785755008 00000100:00100000:0.0:1789305021.723086:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:0.0:1789305021.723114:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785754752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305021.723235:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785754752:12345-0@lo:400:kworker.0 Request processed in 123us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305021.723244:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:0.0:1789305021.723259:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:0.0:1789305021.723265:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785755136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305021.723296:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785755136:12345-0@lo:400:kworker.0 Request processed in 31us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305021.723302:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:0.0:1789305021.723312:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:0.0:1789305021.723317:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785755008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305021.723347:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c09a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785755008:12345-0@lo:400:kworker.0 Request processed in 30us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305021.723353:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00080000:0.0:1789305021.723382:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305021.723404:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785755008:0@lo:400:kworker.0 00000100:00100000:0.0:1789305021.723429:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785755136:0@lo:400:kworker.0 00000100:00100000:0.0:1789305021.723440:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785754752:0@lo:400:kworker.0 00010000:00010000:2.0:1789305021.782937:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305022.814243:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305023.826991:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305023.830854:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305023.830900:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765686016 00000100:00100000:1.0:1789305023.830910:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765686016 00000100:00100000:1.0:1789305023.830970:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1185 00000100:00100000:1.0:1789305023.830980:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:58554:x1876219765686016:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:1.0:1789305023.831001:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305023.831022:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297bcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610090d expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.831112:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297bd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.831126:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.831138:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789305023.831173:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789305023.831177:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789305023.831196:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.831220:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297bcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610090d expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.831239:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610090d expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.831258:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:1.0:1789305023.831260:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789305023.831264:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370a00, rc 0) 00000100:00100000:1.0:1789305023.831320:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:58554:x1876219765686016:12345-192.168.202.29@tcp:101:rm.0 Request processed in 342us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305023.831328:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1185 00000100:00080000:1.0:1789305023.831348:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305023.834805:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305023.834910:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765686144 00000100:00100000:3.0:1789305023.834921:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765686144 00000100:00100000:3.0:1789305023.834976:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1186 00000100:00100000:3.0:1789305023.834987:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:58554:x1876219765686144:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789305023.835004:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305023.835023:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297bdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100914 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835356:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297be4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835372:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297be4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835383:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297be4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835398:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297beb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835404:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835410:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835594:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297be4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835602:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297be4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835609:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297be4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835615:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305023.835620:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297be4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835632:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297be4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835643:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:3.0:1789305023.835655:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305023.835661:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297be4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835667:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e600/0xefc0bb7231297be4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.835678:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.836239:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297beb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.836257:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297beb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.836262:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305023.836265:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297beb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.836271:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297beb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.836281:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789305023.836283:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305023.836286:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297beb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.836296:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297beb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.836331:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297bdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100914 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.836341:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:3.0:1789305023.836343:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305023.836347:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297bdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100914 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.836356:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789305023.836425:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:58554:x1876219765686144:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1439us (1626us total) trans 0 rc 301/301 00000100:00100000:3.0:1789305023.836432:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1186 00000100:00100000:1.0:1789305023.877026:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305023.877378:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305023.877466:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765686272 00000100:00100000:0.0:1789305023.877478:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765686272 00000100:00100000:0.0:1789305023.877534:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765686528 00000100:00100000:0.0:1789305023.877537:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765686528 00000100:00100000:0.0:1789305023.877562:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1187 00000100:00100000:0.0:1789305023.877571:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765686272:12345-192.168.202.29@tcp:41:mkdir.0 00000004:00000024:0.0:1789305023.877617:0:30980:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1789305023.877706:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765686272:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 136us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305023.877714:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1187 00000100:00100000:0.0:1789305023.877732:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1188 00000100:00100000:0.0:1789305023.877739:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+6:58558:x1876219765686528:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:0.0:1789305023.877794:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305023.878034:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297bd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610090d expref: 6 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.878052:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c14addb00) 00010000:00010000:0.0:1789305023.878060:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789305023.878285:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297bf2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.878299:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.878309:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.878321:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.878326:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.878330:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789305023.879591:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00010000:0.0:1789305023.879605:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.879613:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297bf2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.879621:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297bf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.879627:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305023.879631:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297bf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.879638:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297bf2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.879660:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d500) 00010000:00010000:0.0:1789305023.879663:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305023.879668:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297bf2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305023.879673:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297bf2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789305023.879993:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000263755e5 reply state 00000000cd605793 transno 4294967750 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305023.880004:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789305023.880195:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:58558:x1876219765686528:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 2350us (2712us total) trans 4294967750 rc 0/0 00000100:00100000:0.0:1789305023.880205:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1188 00010000:00010000:1.0:1789305023.889835:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.889855:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.889863:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.889870:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305023.889874:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.889883:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.889901:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c0558d800) 00010000:00010000:1.0:1789305023.889904:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789305023.889909:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.889916:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297bf9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305023.936387:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305023.936503:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765686656 00000100:00100000:3.0:1789305023.936514:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765686656 00000100:00100000:3.0:1789305023.936580:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1189 00000100:00100000:3.0:1789305023.936592:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:58562:x1876219765686656:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:3.0:1789305023.936619:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305023.936643:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297c00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610091b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.936725:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297c07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.936739:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.936752:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789305023.936788:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789305023.936793:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789305023.936815:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297c07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.936838:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297c00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610091b expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.936858:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297c07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610091b expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305023.936866:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789305023.936869:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789305023.936873:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e200, rc 0) 00000100:00100000:3.0:1789305023.936941:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:58562:x1876219765686656:12345-192.168.202.29@tcp:101:chown.0 Request processed in 353us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305023.936949:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1189 00000100:00100000:2.0:1789305023.952508:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305023.952612:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765686784 00000100:00100000:1.0:1789305023.952623:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765686784 00000100:00100000:1.0:1789305023.952698:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1190 00000100:00100000:1.0:1789305023.952710:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:58562:x1876219765686784:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:1.0:1789305023.952732:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305023.952754:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297c0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100922 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.952819:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297c15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.952835:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.952846:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.952862:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297c1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.952869:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.952876:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.952977:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.952984:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.952991:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789305023.953021:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:1.0:1789305023.953024:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789305023.953043:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953054:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953060:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297c15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953066:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297c15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953071:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305023.953074:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297c15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953080:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297c15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953137:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:1.0:1789305023.953141:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789305023.953146:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297c15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953152:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953168:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953177:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297c1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953183:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953187:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305023.953190:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953196:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297c1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953203:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c14add900) 00010000:00010000:1.0:1789305023.953206:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789305023.953208:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297c1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953214:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297c1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953244:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371200/0xefc0bb7231297c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100922 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953271:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100922 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.953279:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:1.0:1789305023.953282:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789305023.953285:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370a00, rc 0) 00000100:00100000:1.0:1789305023.953353:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:58562:x1876219765686784:12345-192.168.202.29@tcp:101:chown.0 Request processed in 646us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305023.953361:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1190 00000100:00100000:0.0:1789305023.959208:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305023.961046:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765687040 00000100:00100000:1.0:1789305023.961063:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765687040 00000100:00100000:1.0:1789305023.961160:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1191 00000100:00100000:1.0:1789305023.961172:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:58562:x1876219765687040:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:1.0:1789305023.961228:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305023.961257:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297c23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100922 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.961281:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14add200) 00010000:00010000:1.0:1789305023.961292:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789305023.961318:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.961330:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305023.961350:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789305024.001126:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e858c2d reply state 000000001f20f267 transno 4294967751 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305024.001148:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789305024.001168:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000100:00100000:1.0:1789305024.001292:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:58562:x1876219765687040:12345-192.168.202.29@tcp:36:chown.0 Request processed in 40118us (42088us total) trans 4294967751 rc 0/0 00000100:00100000:1.0:1789305024.001305:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1191 00000001:00080000:3.0:1789305024.001454:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967750 is committed 00000001:00080000:3.0:1789305024.001485:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967751 is committed 00010000:00010000:2.0:1789305024.001538:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.001549:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.001557:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.001563:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305024.001568:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.001576:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.001593:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14add400) 00010000:00010000:2.0:1789305024.001596:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789305024.001601:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.001612:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297c2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305024.277331:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785755392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305024.277415:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305024.277530:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785755392 00000100:00100000:0.0:1789305024.277538:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785755392 00000100:00100000:0.0:1789305024.277602:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1789305024.277613:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785755392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789305024.277656:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305024.277714:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785755392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305024.277721:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00080000:1.0:1789305024.278240:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305024.278285:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785755392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305024.356474:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305024.356527:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305024.356606:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305024.356638:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305024.356706:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765687296 00000100:00100000:2.0:1789305024.356719:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765687168 00000100:00100000:1.0:1789305024.356719:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765687296 00000100:00100000:2.0:1789305024.356726:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765687168 00000100:00100000:2.0:1789305024.356787:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1379 00000100:00100000:1.0:1789305024.356791:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1779 00000100:00100000:2.0:1789305024.356801:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765687168:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305024.356807:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765687296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305024.356895:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765687168:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 98us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305024.356902:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1379 00000100:00100000:3.0:1789305024.360309:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765687424 00000100:00100000:3.0:1789305024.360328:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765687424 00000100:00100000:3.0:1789305024.360404:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765687552 00000100:00100000:3.0:1789305024.360409:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765687552 00000100:00100000:3.0:1789305024.360439:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1374 00000100:00100000:3.0:1789305024.360450:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765687424:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:1.0:1789305024.361046:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789305024.361053:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305024.361086:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765687296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 4282us (4477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305024.361110:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1779 00000100:00100000:2.0:1789305024.366980:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1375 00000100:00100000:2.0:1789305024.367002:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765687552:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305024.367135:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765687552:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 142us (10495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305024.367143:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1375 00000100:00100000:3.0:1789305024.368874:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765687424:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 8416us (12336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305024.368889:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1374 00010000:00010000:2.0:1789305024.850635:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789305024.949302:0:99884:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffe2802f90 20000000:00000080:3.0:1789305024.949324:0:99884:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412e8800 uarg=0000000000000000 10000000:01000000:3.0:1789305024.949374:0:99884:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305024.949976:0:99884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305024.949997:0:99884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297bc8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297bc1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305024.950007:0:99884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305024.950053:0:99884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297bc8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297bc1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305024.950069:0:99884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297bc8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297bc1 expref: 18 pid: 5846 timeout: 2574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305024.950085:0:99884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38461c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99884:1876219785755520:0@lo:104: 00000100:00100000:3.0:1789305024.951778:0:99884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305024.951848:0:99884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388c8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789305024.952239:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785755520 00000100:00100000:0.0:1789305024.952247:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785755520 00000100:00100000:0.0:1789305024.952307:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789305024.952316:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:99884:x1876219785755520:12345-0@lo:104: 00010000:00010000:0.0:1789305024.952333:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.952412:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305024.952417:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b04017480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:99884:x1876219785755520:12345-0@lo:104: Request processed in 104us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305024.952424:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00010000:2.0:1789305024.952475:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305024.952482:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.952490:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789305024.952494:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.952503:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789305024.952515:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305024.952521:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789305024.952559:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.952567:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789305024.952588:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.952595:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231297bc1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297bc8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305024.952612:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305024.952614:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305024.952616:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305024.952628:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785755648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789305024.952668:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305024.955826:0:99884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38461c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99884:1876219785755520:0@lo:104: 00010000:00010000:1.0:1789305024.955857:0:99884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305024.956062:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785755648 00000100:00100000:0.0:1789305024.956069:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785755648 00010000:00010000:0.0:1789305024.956129:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297bc8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297bc1 expref: 19 pid: 5846 timeout: 2574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305024.956162:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789305024.956172:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785755648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305024.956187:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305024.956192:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297bc8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297bc1 expref: 19 pid: 5846 timeout: 2574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956204:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297bc8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297bc1 expref: 19 pid: 5846 timeout: 2574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956222:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e800/0xefc0bb7231297bc8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297bc1 expref: 19 pid: 5846 timeout: 2574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956239:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956248:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956267:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956275:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956282:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956288:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956294:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305024.956298:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956306:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956317:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305024.956324:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305024.956385:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785755648:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (3716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305024.956392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789305024.956422:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785755648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305024.957683:0:99884:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305024.957698:0:99884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305024.957705:0:99884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e400/0xefc0bb7231297c31 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305025.298286:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789305025.298309:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785755776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305025.298392:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305025.298546:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785755776 00000100:00100000:1.0:1789305025.298555:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785755776 00000100:00100000:1.0:1789305025.298642:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1789305025.298652:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785755776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305025.298687:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305025.298986:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785755776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 335us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305025.298993:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1789305025.299048:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785755776:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789305025.299126:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789305025.700951:0:99932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff4b8d82e0 20000000:00000080:3.0:1789305025.700974:0:99932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b01fb3c00 uarg=0000000000000000 10000000:01000000:3.0:1789305025.701027:0:99932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305025.701051:0:99932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305025.701072:0:99932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305025.701084:0:99932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305025.701265:0:99932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305025.701273:0:99932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305025.701280:0:99932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305025.701287:0:99932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305025.701291:0:99932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305025.701300:0:99932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305025.701314:0:99932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305025.701322:0:99932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305025.701328:0:99932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c38 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305025.877954:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305026.578587:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305026.578596:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305026.578600:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305026.578661:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305026.578800:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305026.578813:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305026.578839:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785755904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305026.578918:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305026.578974:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789305026.579042:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785755904 00000100:00100000:3.0:1789305026.579051:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785755904 00000100:00100000:3.0:1789305026.579151:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1789305026.579160:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785755904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305026.579174:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305026.579200:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c46 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297c3f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305026.579223:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297c3f expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305026.579234:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297c3f expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305026.579242:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789305026.579283:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785755904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305026.579289:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1789305026.579584:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785755904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305026.579600:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305026.579609:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305026.579637:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789305026.579643:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305026.579650:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305026.836189:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785756160:0@lo:400:kworker.0 00000100:00100000:0.0:1789305026.836270:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305026.836348:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789305026.836355:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785756288:0@lo:400:kworker.0 00000100:00100000:0.0:1789305026.836384:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305026.836418:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785756160 00000100:00100000:0.0:1789305026.836426:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785756160 00000100:00100000:1.0:1789305026.836703:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785756032:0@lo:400:kworker.0 00000100:00100000:1.0:1789305026.836737:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305026.836767:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785756544:0@lo:400:kworker.0 00000100:00100000:1.0:1789305026.836794:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305026.836812:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305026.836818:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785756416:0@lo:400:kworker.0 00000100:00100000:1.0:1789305026.836836:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305026.836864:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785756288 00000100:00100000:1.0:1789305026.836868:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785756288 00000100:00100000:1.0:1789305026.836918:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785756032 00000100:00100000:1.0:1789305026.836921:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785756032 00000100:00100000:1.0:1789305026.836936:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785756416 00000100:00100000:1.0:1789305026.836938:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785756416 00000100:00100000:1.0:1789305026.836954:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:1.0:1789305026.836961:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785756288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305026.837029:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785756288:12345-0@lo:400:kworker.0 Request processed in 53us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305026.837037:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00100000:1.0:1789305026.837054:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1789305026.837059:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785756032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305026.837088:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785756032:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305026.837113:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1789305026.837124:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1782 00000100:00100000:1.0:1789305026.837128:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3702b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785756416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305026.837150:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3702b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785756416:12345-0@lo:400:kworker.0 Request processed in 22us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305026.837155:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1782 00000100:00100000:1.0:1789305026.837558:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785756416:0@lo:400:kworker.0 00000100:00100000:1.0:1789305026.837570:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785756032:0@lo:400:kworker.0 00000100:00100000:0.0:1789305026.837766:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785756544 00000100:00100000:0.0:1789305026.837773:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785756544 00000100:00100000:0.0:1789305026.837801:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1789305026.837808:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785756160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305026.837852:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785756160:12345-0@lo:400:kworker.0 Request processed in 45us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305026.837858:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1789305026.837870:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:0.0:1789305026.837876:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785756544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305026.837908:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785756544:12345-0@lo:400:kworker.0 Request processed in 32us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305026.837914:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00080000:0.0:1789305026.837935:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789305026.837940:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305026.837962:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785756288:0@lo:400:kworker.0 00000100:00100000:0.0:1789305026.837973:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785756160:0@lo:400:kworker.0 00000100:00100000:1.0:1789305026.838998:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785756544:0@lo:400:kworker.0 00010000:00010000:2.0:1789305026.898195:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305027.929859:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305028.748439:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305028.748732:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765687680 00000100:00100000:2.0:1789305028.748745:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765687680 00000100:00100000:2.0:1789305028.748858:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:2.0:1789305028.748868:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:5594:x1876219765687680:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789305028.748884:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305028.748911:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297c07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610091b expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305028.748935:0:57145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:2.0:1789305028.748946:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789305028.749057:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37028380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:5594:x1876219765687680:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 191us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305028.749065:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00080000:1.0:1789305028.749977:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789305028.950196:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305029.396296:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789305029.396321:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785756672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305029.396393:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305029.396495:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785756672 00000100:00100000:2.0:1789305029.396503:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785756672 00000100:00100000:2.0:1789305029.396569:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:2.0:1789305029.396578:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785756672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305029.396628:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305029.396681:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37029f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785756672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305029.396687:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:2.0:1789305029.396742:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785756672:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789305029.396798:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305029.475021:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305029.475149:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305029.475229:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305029.475266:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765688192 00000100:00100000:2.0:1789305029.475276:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765688192 00000100:00100000:2.0:1789305029.475364:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1378 00000100:00100000:2.0:1789305029.475388:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765688192:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305029.475465:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765688192:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305029.475472:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1378 00000100:00100000:1.0:1789305029.475572:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765687936 00000100:00100000:1.0:1789305029.475578:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765687936 00000100:00100000:1.0:1789305029.475635:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1783 00000100:00100000:1.0:1789305029.475644:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765687936:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305029.475692:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765687936:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 49us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305029.475699:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1783 00000100:00080000:1.0:1789305029.475719:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305029.475917:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765687808 00000100:00100000:3.0:1789305029.475923:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765687808 00000100:00100000:3.0:1789305029.475967:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1381 00000100:00100000:3.0:1789305029.475976:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765687808:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305029.476025:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765687808:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 50us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305029.476033:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1381 00000100:00100000:2.0:1789305029.486549:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305029.486750:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765688064 00000100:00100000:3.0:1789305029.486764:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765688064 00000100:00100000:3.0:1789305029.486876:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1379 00000100:00100000:3.0:1789305029.486889:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765688064:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:2.0:1789305029.487023:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305029.487198:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765688064:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 311us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305029.487207:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1379 00000100:00100000:2.0:1789305029.647036:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305029.647130:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765688320 00000100:00100000:3.0:1789305029.647139:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765688320 00000100:00100000:3.0:1789305029.647194:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1192 00000100:00100000:3.0:1789305029.647204:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58667:x1876219765688320:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789305029.647222:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305029.647285:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297c4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100929 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.647361:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231297c54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.647373:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231297c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.647387:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231297c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789305029.647436:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789305029.647439:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789305029.647457:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231297c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.647475:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297c4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100929 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.647488:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231297c54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100929 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.647493:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789305029.647496:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789305029.647498:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ec00, rc 0) 00000100:00100000:3.0:1789305029.647548:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:58667:x1876219765688320:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 345us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305029.647555:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1192 00000100:00100000:2.0:1789305029.652774:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305029.652812:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765688448 00000100:00100000:0.0:1789305029.652825:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765688448 00000100:00100000:0.0:1789305029.652902:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1193 00000100:00100000:0.0:1789305029.652913:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:58667:x1876219765688448:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789305029.652939:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305029.652975:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297c5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100930 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.653045:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297c62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.653062:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.653074:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654027:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654045:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654055:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654462:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297c70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654473:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654480:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789305029.654518:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:0.0:1789305029.654534:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789305029.654558:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654574:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297c62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654581:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297c62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654589:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297c62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654606:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305029.654611:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297c62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654618:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297c62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654630:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:0.0:1789305029.654633:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305029.654638:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297c62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654644:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297c62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654655:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654664:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654670:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654675:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305029.654678:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654683:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654690:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c0558d400) 00010000:00010000:0.0:1789305029.654693:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305029.654696:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654702:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654736:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297c5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100930 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654750:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100930 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.654758:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:0.0:1789305029.654761:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789305029.654763:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:0.0:1789305029.654841:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:58667:x1876219765688448:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 1929us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305029.654849:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1193 00000100:00100000:3.0:1789305029.661382:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305029.661985:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765688704 00000100:00100000:1.0:1789305029.661998:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765688704 00000100:00100000:1.0:1789305029.662062:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1194 00000100:00100000:1.0:1789305029.662070:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:58667:x1876219765688704:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789305029.662145:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305029.662177:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297c70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100930 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.662197:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:1.0:1789305029.662209:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789305029.662237:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.662247:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.662254:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789305029.691018:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967752 is committed 00000004:00010000:1.0:1789305029.691173:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000502b874e reply state 000000008b1d4ff7 transno 4294967752 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305029.691189:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789305029.691208:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00080000:1.0:1789305029.691338:0:30980:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789305029.691360:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:58667:x1876219765688704:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 29284us (29982us total) trans 4294967752 rc 0/0 00000100:00100000:1.0:1789305029.691369:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1194 00010000:00010000:1.0:1789305029.691531:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.691541:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.691549:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.691555:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305029.691559:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.691567:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.691582:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:1.0:1789305029.691585:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789305029.691591:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.691606:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305029.778406:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305029.778503:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765688832 00000100:00100000:1.0:1789305029.778516:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765688832 00000100:00100000:1.0:1789305029.778599:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1195 00000100:00100000:1.0:1789305029.778614:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:58671:x1876219765688832:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:1.0:1789305029.778645:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305029.778667:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100937 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.778735:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297c85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.778751:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297c85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.778765:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297c85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.778783:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297c8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.778790:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297c8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.778798:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297c8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779208:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779218:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779227:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789305029.779259:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:1.0:1789305029.779264:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789305029.779286:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779314:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297c85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779322:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297c85 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779329:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297c85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779336:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371c00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305029.779341:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297c85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779348:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297c85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779360:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:1.0:1789305029.779364:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789305029.779369:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297c85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779375:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371c00/0xefc0bb7231297c85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779386:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297c8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779392:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297c8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779402:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297c8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779407:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305029.779410:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297c8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779416:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297c8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779422:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c14add900) 00010000:00010000:1.0:1789305029.779425:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789305029.779428:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297c8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779433:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371600/0xefc0bb7231297c8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779463:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297c7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100937 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779476:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100937 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.779484:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:1.0:1789305029.779486:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789305029.779489:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371000, rc 0) 00000100:00100000:1.0:1789305029.779559:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:58671:x1876219765688832:12345-192.168.202.29@tcp:101:touch.0 Request processed in 950us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305029.779569:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1195 00000100:00100000:3.0:1789305029.788528:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305029.788635:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765689088 00000100:00100000:0.0:1789305029.788647:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765689088 00000100:00100000:0.0:1789305029.788718:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1196 00000100:00100000:0.0:1789305029.788731:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:58671:x1876219765689088:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789305029.788753:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305029.788777:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c9a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610093e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.789069:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297ca1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.789115:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.789130:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.789211:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.789220:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.789228:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789305029.789922:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25:0x0], index 1: 0 00010000:00010000:0.0:1789305029.790239:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297caf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790252:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790260:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790293:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790301:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297ca1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790308:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790314:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305029.790319:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790326:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297ca1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790338:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:0.0:1789305029.790341:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305029.790346:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297ca1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790352:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297ca1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789305029.790369:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000caad1b5b reply state 000000008d807698 transno 4294967753 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305029.790377:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789305029.790409:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297c9a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610093e expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790424:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297caf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610093e expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.790433:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:0.0:1789305029.790435:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789305029.790438:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa200, rc 0) 00000100:00100000:0.0:1789305029.790519:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:58671:x1876219765689088:12345-192.168.202.29@tcp:101:touch.0 Request processed in 1791us (1999us total) trans 4294967753 rc 0/0 00000100:00100000:0.0:1789305029.790528:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1196 00010000:00010000:2.0:1789305029.793752:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.793769:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.793777:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.793784:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305029.793788:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.793796:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.793813:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c0558d400) 00010000:00010000:2.0:1789305029.793816:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305029.793822:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.793828:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297ca8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305029.803188:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305029.804675:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765689344 00000100:00100000:1.0:1789305029.804691:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765689344 00000100:00100000:1.0:1789305029.804757:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1197 00000100:00100000:1.0:1789305029.804767:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+9:58671:x1876219765689344:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:1.0:1789305029.804823:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305029.804852:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297caf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610093e expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.804870:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9e2c0558d100) 00010000:00010000:1.0:1789305029.804882:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789305029.804927:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.804940:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.804950:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789305029.805080:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d91ad68f reply state 000000002f9e9abe transno 4294967754 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305029.805121:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789305029.805245:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:58671:x1876219765689344:12345-192.168.202.29@tcp:36:touch.0 Request processed in 478us (2069us total) trans 4294967754 rc 0/0 00000100:00100000:1.0:1789305029.805252:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1197 00010000:00010000:1.0:1789305029.807997:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.808020:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.808027:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.808033:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305029.808038:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.808046:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.808065:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9e2c14add900) 00010000:00010000:1.0:1789305029.808068:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789305029.808074:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.808080:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371800/0xefc0bb7231297cbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305029.808347:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305029.808438:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765689472 00000100:00100000:2.0:1789305029.808450:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765689472 00000100:00100000:2.0:1789305029.808511:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1198 00000100:00100000:2.0:1789305029.808521:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:58671:x1876219765689472:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:2.0:1789305029.808548:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305029.808568:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297cc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100945 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.808641:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100945 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.808655:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100945 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.808673:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789305029.808676:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789305029.808678:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40eccc00, rc 0) 00000100:00100000:2.0:1789305029.808747:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:58671:x1876219765689472:12345-192.168.202.29@tcp:101:touch.0 Request processed in 228us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305029.808754:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1198 00000100:00100000:3.0:1789305029.815161:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305029.816442:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765689600 00000100:00100000:2.0:1789305029.816456:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765689600 00000100:00100000:2.0:1789305029.816514:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 652 00000100:00100000:2.0:1789305029.816524:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765689600:12345-192.168.202.29@tcp:2:touch.0 00000100:00100000:2.0:1789305029.817213:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2357:x1876219765689600:12345-192.168.202.29@tcp:2:touch.0 Request processed in 685us (2057us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789305029.817222:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 652 00000100:00100000:1.0:1789305029.821198:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305029.822502:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765689856 00000100:00100000:3.0:1789305029.822518:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765689856 00000100:00100000:3.0:1789305029.822603:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 121 00000100:00100000:3.0:1789305029.822616:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:58671:x1876219765689856:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:3.0:1789305029.823030:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:58671:x1876219765689856:12345-192.168.202.29@tcp:35:touch.0 Request processed in 415us (1842us total) trans 4294967755 rc 0/0 00000100:00100000:3.0:1789305029.823038:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 121 00000100:00100000:1.0:1789305029.897776:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305029.897881:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765689984 00000100:00100000:3.0:1789305029.898035:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765689984 00000100:00100000:3.0:1789305029.898488:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1199 00000100:00100000:3.0:1789305029.898504:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:58675:x1876219765689984:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789305029.898533:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305029.898557:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297ccb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610094c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.898821:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297cd2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.898839:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297cd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.898852:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297cd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.898869:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297cd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.898876:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.898882:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.899147:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297ce0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.899478:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.899489:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789305029.899797:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x62:0x0]: returning size 0 00000004:00200000:3.0:1789305029.899804:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789305029.899827:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.899844:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.899852:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297cd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.899858:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297cd2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.899864:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297cd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.899870:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305029.899874:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297cd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.899882:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297cd2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901118:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:3.0:1789305029.901127:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305029.901134:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297cd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901143:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297cd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901177:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901185:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297cd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901192:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901198:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305029.901201:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901207:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901216:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789305029.901218:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305029.901221:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297cd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901227:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297cd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901286:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297ccb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610094c expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901301:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610094c expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.901308:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:3.0:1789305029.901310:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789305029.901312:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fa00, rc 0) 00000100:00100000:2.0:1789305029.901490:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:58675:x1876219765689984:12345-192.168.202.29@tcp:101:rm.0 Request processed in 2989us (3724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305029.901502:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1199 00000100:00100000:1.0:1789305029.909999:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305029.910155:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765690112 00000100:00100000:3.0:1789305029.910167:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765690112 00000100:00100000:3.0:1789305029.910228:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 653 00000100:00100000:3.0:1789305029.910238:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765690112:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789305029.910257:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305029.910279:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb7231297ce7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100953 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789305029.910308:0:17212:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x6aa6a0c5, atime: 0x6aa6a0c5, ctime: 0x6aa6a0c5, blocks: 0x1 00010000:00010000:3.0:1789305029.910328:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=2479s v=(0 0) 00010000:00010000:3.0:1789305029.910333:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789305029.910342:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb7231297ce7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100953 expref: 7 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.910361:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb7231297ce7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100953 expref: 7 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305029.910375:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f800, rc 0) 00000100:00100000:3.0:1789305029.910444:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765690112:12345-192.168.202.29@tcp:101:rm.0 Request processed in 208us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305029.910452:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 653 00000100:00100000:1.0:1789305029.917222:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305029.917328:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765690368 00000100:00100000:0.0:1789305029.917340:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765690368 00000100:00100000:0.0:1789305029.917406:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1200 00000100:00100000:0.0:1789305029.917416:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c1c958c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:58675:x1876219765690368:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:0.0:1789305029.917470:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789305029.917498:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297ce0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610094c expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.917520:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297cc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100945 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.917532:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:0.0:1789305029.917544:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789305029.917570:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297cee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.917585:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297cee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.917610:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297cee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.917627:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.917634:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.917640:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.917760:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297cfc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.917768:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297cfc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.917775:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297cfc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789305029.918431:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].37, 64 off10560 00000004:00080000:0.0:1789305029.918443:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2479596351742ns, next at 2480596349222ns, rc = 0 00010000:00010000:0.0:1789305029.918507:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918519:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918528:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918535:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918541:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918547:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918564:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789305029.918584:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297cfc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918602:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297cfc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918609:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297cfc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918615:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305029.918620:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297cfc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918628:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297cfc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918639:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:0.0:1789305029.918642:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789305029.918646:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297cfc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918652:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297cfc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918668:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297cee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918675:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297cee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918681:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297cee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918686:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afae00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305029.918688:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297cee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918693:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297cee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918700:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:0.0:1789305029.918702:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305029.918704:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297cee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305029.918709:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297cee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789305029.918721:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ee69e91 reply state 000000007c48c0ba transno 4294967756 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305029.918728:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789305029.918813:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c1c958c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+12:58675:x1876219765690368:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1396us (1601us total) trans 4294967756 rc 0/0 00000100:00100000:0.0:1789305029.918821:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1200 00010000:00010000:1.0:1789305029.920347:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789305029.920359:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.920368:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789305029.920373:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.920383:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.920398:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9e2c0558d600) 00010000:00010000:1.0:1789305029.920400:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789305029.920405:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.920411:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305029.920429:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305029.920431:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305029.920433:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305029.927030:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.927049:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.927058:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.927064:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305029.927069:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.927077:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.927131:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c0558dc00) 00010000:00010000:2.0:1789305029.927135:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305029.927141:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.927148:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb000/0xefc0bb7231297cf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305029.972320:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305030.420467:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789305030.420492:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785756800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305030.420566:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305030.420763:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785756800 00000100:00100000:3.0:1789305030.420772:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785756800 00000100:00100000:3.0:1789305030.420834:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1789305030.420845:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785756800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789305030.420915:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305030.420965:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785756800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305030.420975:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00080000:3.0:1789305030.420998:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305030.421170:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785756800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305030.901807:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305030.901980:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765690496 00000100:00100000:0.0:1789305030.901991:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765690496 00000100:00100000:0.0:1789305030.902648:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1201 00000100:00100000:0.0:1789305030.902660:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:58690:x1876219765690496:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789305030.902684:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305030.902708:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297d0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610095a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305030.902779:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297d11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305030.902795:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305030.902808:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789305030.902851:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:0.0:1789305030.902856:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789305030.902874:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297d11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305030.902899:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297d0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610095a expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305030.902915:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297d11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610095a expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305030.902923:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:0.0:1789305030.902927:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789305030.902931:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afae00, rc 0) 00000100:00100000:0.0:1789305030.902995:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:58690:x1876219765690496:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 337us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305030.903002:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1201 00000100:00080000:2.0:1789305030.905453:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305030.907948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305030.908053:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765690752 00000100:00100000:2.0:1789305030.908064:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765690752 00000100:00100000:2.0:1789305030.908156:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1202 00000100:00100000:2.0:1789305030.908166:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:58690:x1876219765690752:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:2.0:1789305030.908220:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789305030.908247:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afae00/0xefc0bb7231297d11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610095a expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.908268:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371000/0xefc0bb7231297c93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100937 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.908277:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14addc00) 00010000:00010000:2.0:1789305030.908289:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789305030.908315:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.908328:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.908339:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789305030.943985:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad3dbb3b reply state 000000002a4e715b transno 4294967757 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305030.944001:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789305030.944020:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000100:00100000:2.0:1789305030.944165:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:58690:x1876219765690752:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 35996us (36221us total) trans 4294967757 rc 0/0 00000100:00100000:2.0:1789305030.944174:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1202 00000001:00080000:2.0:1789305030.944215:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967756 is committed 00000004:00080000:2.0:1789305030.944223:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 106 committed 00000001:00080000:2.0:1789305030.944251:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967757 is committed 00010000:00010000:2.0:1789305030.944384:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.944393:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.944401:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.944407:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305030.944412:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.944420:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.944435:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c421d2800) 00010000:00010000:2.0:1789305030.944438:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789305030.944444:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.944450:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297d18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305030.944492:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785756928:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789305030.944547:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305030.945170:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785756928 00000100:00100000:2.0:1789305030.945180:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785756928 00000100:00100000:2.0:1789305030.945224:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1789305030.945233:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785756928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789305030.945259:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:37 count 1 00010000:00010000:2.0:1789305030.945284:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.945303:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb7231297ce7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100953 expref: 6 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.945312:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789305030.945316:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789305030.945320:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.945348:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb7231297ce7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100953 expref: 6 pid: 17212 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.945363:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb7231297ce7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100953 expref: 6 pid: 17212 timeout: 2580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305030.945375:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785757056:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789305030.945426:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789305030.956046:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd43100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785757056:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789305030.956080:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305030.956422:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305030.956572:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765690880 00000100:00100000:1.0:1789305030.956579:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765690880 00010000:00010000:1.0:1789305030.956624:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb7231297ce7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100953 expref: 7 pid: 17212 timeout: 2580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305030.956718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 454 00000100:00100000:1.0:1789305030.956728:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765690880:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789305030.956744:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305030.956750:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb7231297ce7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100953 expref: 7 pid: 17212 timeout: 2580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305030.956764:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb7231297ce7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100953 expref: 7 pid: 17212 timeout: 2580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305030.956790:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003074d2dc/0xefc0bb7231297ce7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100953 expref: 7 pid: 17212 timeout: 2580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305030.956804:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789305030.956808:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789305030.956813:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305030.956823:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305030.956950:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789305030.957013:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765690880:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 285us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305030.957020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 454 00010000:00010000:3.0:1789305030.961797:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305030.961816:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305030.961831:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305030.961839:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305030.961866:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789305030.962464:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785756928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17228us (17912us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789305030.962475:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00010000:00010000:2.0:1789305030.963008:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305030.963018:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.963034:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305030.963039:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.963049:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.963074:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.963081:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089e9ef55/0xefc0bb7231297d1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305030.963119:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305030.963121:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305030.963123:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789305030.963165:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c3fd41880/2, rc 0, transno 4294967371 00000100:00100000:2.0:1789305030.963174:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785756928:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789305030.994332:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305031.025956:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305031.028466:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765691008 00000100:00100000:0.0:1789305031.028481:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765691008 00000100:00100000:0.0:1789305031.028542:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1203 00000100:00100000:0.0:1789305031.028555:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:58694:x1876219765691008:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789305031.028589:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305031.028611:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297d26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100961 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029059:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029075:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029087:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029135:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029143:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029150:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029465:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297d3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029475:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029483:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789305031.029512:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:0.0:1789305031.029516:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789305031.029536:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029550:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029560:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029567:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.029573:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305031.029577:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.030503:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.030518:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:0.0:1789305031.030521:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305031.030526:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.030533:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.030547:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.030553:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.030560:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.030565:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305031.030568:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.030574:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.030592:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c0558d200) 00010000:00010000:0.0:1789305031.030595:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305031.030598:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.030604:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.031024:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297d26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100961 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.031042:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297d3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100961 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.031049:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789305031.031052:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789305031.031055:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afba00, rc 0) 00000100:00100000:0.0:1789305031.031304:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:58694:x1876219765691008:12345-192.168.202.29@tcp:101:touch.0 Request processed in 2750us (5355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305031.031313:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1203 00000100:00100000:0.0:1789305031.037261:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305031.037300:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765691264 00000100:00100000:0.0:1789305031.037310:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765691264 00000100:00100000:0.0:1789305031.037373:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1204 00000100:00100000:0.0:1789305031.037384:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:58694:x1876219765691264:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789305031.037405:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305031.037425:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297d42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100968 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.037707:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.037723:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.037734:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.037749:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.037756:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.037762:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789305031.040793:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26:0x0], index 0: 0 00010000:00010000:0.0:1789305031.042397:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297d57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042417:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042429:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042467:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042474:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042481:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042488:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305031.042492:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042500:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042511:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789305031.042514:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305031.042519:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042525:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789305031.042537:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f649d6d3 reply state 00000000ef1c2d0e transno 4294967758 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305031.042546:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789305031.042594:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297d42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100968 expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042614:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100968 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.042621:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9e2c0558d300) 00010000:00010000:0.0:1789305031.042624:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789305031.042634:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa200, rc 0) 00000100:00100000:0.0:1789305031.042712:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:58694:x1876219765691264:12345-192.168.202.29@tcp:101:touch.0 Request processed in 5329us (5459us total) trans 4294967758 rc 0/0 00000100:00100000:0.0:1789305031.042721:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1204 00000100:00100000:3.0:1789305031.048392:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:0.0:1789305031.048922:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.048947:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.048956:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.048963:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305031.048968:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.048977:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.048995:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c0558d200) 00010000:00010000:0.0:1789305031.048998:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305031.049003:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.049010:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305031.049198:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765691520 00000100:00100000:3.0:1789305031.049210:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765691520 00000100:00100000:3.0:1789305031.049263:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1205 00000100:00100000:3.0:1789305031.049273:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:58694:x1876219765691520:12345-192.168.202.29@tcp:36:touch.0 00010000:00010000:3.0:1789305031.049325:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305031.049344:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa200/0xefc0bb7231297d57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100968 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.049357:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9e2c0558d300) 00010000:00010000:3.0:1789305031.049364:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789305031.049478:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.049492:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.049502:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789305031.049764:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4be1dc2 reply state 00000000b2c4275e transno 4294967759 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305031.049774:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789305031.050243:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:58694:x1876219765691520:12345-192.168.202.29@tcp:36:touch.0 Request processed in 969us (1857us total) trans 4294967759 rc 0/0 00000100:00100000:3.0:1789305031.050252:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1205 00000100:00100000:3.0:1789305031.053371:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305031.053507:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765691648 00000100:00100000:0.0:1789305031.053518:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765691648 00000100:00100000:0.0:1789305031.053570:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1206 00000100:00100000:0.0:1789305031.053590:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:58694:x1876219765691648:12345-192.168.202.29@tcp:101:touch.0 00010000:00010000:0.0:1789305031.053619:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305031.053641:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297d6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610096f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.053710:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297d6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610096f expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.053727:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297d6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610096f expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.053749:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:0.0:1789305031.053752:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789305031.053757:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa600, rc 0) 00000100:00100000:0.0:1789305031.053820:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:58694:x1876219765691648:12345-192.168.202.29@tcp:101:touch.0 Request processed in 241us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305031.053828:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1206 00010000:00010000:2.0:1789305031.053844:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.053854:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.053866:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.053872:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305031.053877:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.053886:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.053897:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:2.0:1789305031.053900:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305031.053903:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.053910:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305031.058184:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305031.058526:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765691776 00000100:00100000:2.0:1789305031.058538:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765691776 00000100:00100000:2.0:1789305031.058706:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 655 00000100:00100000:2.0:1789305031.058718:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765691776:12345-192.168.202.29@tcp:2:touch.0 00000100:00100000:2.0:1789305031.059120:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765691776:12345-192.168.202.29@tcp:2:touch.0 Request processed in 403us (944us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789305031.059129:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 655 00000100:00080000:3.0:1789305031.059227:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305031.061654:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305031.061740:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765692032 00000100:00100000:0.0:1789305031.061750:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765692032 00000100:00100000:0.0:1789305031.061851:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 122 00000100:00100000:0.0:1789305031.061862:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+10:58694:x1876219765692032:12345-192.168.202.29@tcp:35:touch.0 00000100:00100000:0.0:1789305031.062254:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:58694:x1876219765692032:12345-192.168.202.29@tcp:35:touch.0 Request processed in 392us (607us total) trans 4294967760 rc 0/0 00000100:00100000:0.0:1789305031.062263:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 122 00000100:00100000:1.0:1789305031.116921:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305031.117078:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765692160 00000100:00100000:0.0:1789305031.117121:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765692160 00000100:00100000:0.0:1789305031.117190:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1207 00000100:00100000:0.0:1789305031.117213:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:58698:x1876219765692160:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789305031.117242:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305031.117264:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100976 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117331:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117347:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117368:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117386:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297d81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117402:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117410:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117742:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297d88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117752:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117760:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789305031.117795:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x63:0x0]: returning size 0 00000004:00200000:0.0:1789305031.117800:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789305031.117820:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117832:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117840:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117846:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117853:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117858:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305031.117862:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117869:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117880:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:0.0:1789305031.117883:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305031.117888:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117894:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbc00/0xefc0bb7231297d7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117906:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117912:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297d81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117916:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297d81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117920:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305031.117922:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297d81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117927:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297d81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.117933:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c0558d200) 00010000:00010000:0.0:1789305031.117935:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305031.118018:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297d81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.118024:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa000/0xefc0bb7231297d81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.118058:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb200/0xefc0bb7231297d73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100976 expref: 13 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.118072:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297d88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100976 expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.118079:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:0.0:1789305031.118081:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789305031.118084:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbe00, rc 0) 00000100:00100000:0.0:1789305031.119032:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:58698:x1876219765692160:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1826us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305031.119042:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1207 00000100:00100000:2.0:1789305031.128404:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305031.128514:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765692288 00000100:00100000:0.0:1789305031.128525:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765692288 00000100:00100000:0.0:1789305031.128594:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 656 00000100:00100000:0.0:1789305031.128605:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765692288:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1789305031.128624:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305031.128645:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231297d8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610097d expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789305031.128674:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x6aa6a0c7, atime: 0x6aa6a0c7, ctime: 0x6aa6a0c7, blocks: 0x1 00010000:00010000:0.0:1789305031.128695:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=2480s v=(0 0) 00010000:00010000:0.0:1789305031.128699:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789305031.128707:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231297d8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610097d expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.128727:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231297d8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610097d expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.128745:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb200, rc 0) 00000100:00100000:0.0:1789305031.128815:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765692288:12345-192.168.202.29@tcp:101:rm.0 Request processed in 212us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305031.128823:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 656 00000100:00100000:2.0:1789305031.131553:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305031.131656:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765692544 00000100:00100000:3.0:1789305031.131666:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765692544 00000100:00100000:3.0:1789305031.131727:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1208 00000100:00100000:3.0:1789305031.131737:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:58698:x1876219765692544:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:3.0:1789305031.131793:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789305031.131825:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afbe00/0xefc0bb7231297d88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100976 expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.131853:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa600/0xefc0bb7231297d6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610096f expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.131865:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789305031.131877:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789305031.131907:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297d96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.131922:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297d96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.131933:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297d96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.131949:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.131956:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.131962:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.132068:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297da4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.132077:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297da4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.132085:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297da4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789305031.133729:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].38, 64 off10624 00000004:00080000:3.0:1789305031.133741:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2480811649262ns, next at 2481811646978ns, rc = 0 00010000:00010000:3.0:1789305031.133816:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133829:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133840:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133848:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133854:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133859:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133886:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789305031.133909:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297da4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133915:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297da4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133922:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297da4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133927:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305031.133933:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297da4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133951:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297da4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133963:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:3.0:1789305031.133966:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789305031.133972:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297da4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.133978:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297da4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.134003:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297d96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.134009:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297d96 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.134014:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297d96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.134020:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305031.134022:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297d96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.134028:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297d96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.134035:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:3.0:1789305031.134037:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305031.134040:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297d96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305031.134045:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297d96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789305031.134053:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f81b4c3e reply state 00000000f0897cb8 transno 4294967761 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305031.134062:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789305031.134186:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:58698:x1876219765692544:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2448us (2639us total) trans 4294967761 rc 0/0 00000100:00100000:3.0:1789305031.134197:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1208 00010000:00010000:2.0:1789305031.138921:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305031.138948:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.138962:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305031.138967:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.138979:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.139004:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9e2c2ea19a00) 00010000:00010000:2.0:1789305031.139007:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789305031.139013:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 1/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.139019:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fa00/0xefc0bb7231297dab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305031.139044:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305031.139046:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305031.139048:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305031.143367:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.143385:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.143394:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.143400:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305031.143405:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.143413:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.143432:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c2ea19700) 00010000:00010000:0.0:1789305031.143435:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305031.143440:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305031.143445:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f200/0xefc0bb7231297d9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305031.956142:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785757184:0@lo:400:kworker.0 00000100:00100000:2.0:1789305031.956294:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305031.956417:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785757696:0@lo:400:kworker.0 00000100:00100000:2.0:1789305031.956448:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305031.956482:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789305031.956487:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785757568:0@lo:400:kworker.0 00000100:00100000:2.0:1789305031.956509:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305031.956509:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785757312:0@lo:400:kworker.0 00000100:00100000:1.0:1789305031.956536:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305031.956540:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785757184 00000100:00100000:2.0:1789305031.956546:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785757184 00000100:00100000:1.0:1789305031.956554:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785757824:0@lo:400:kworker.0 00000100:00100000:1.0:1789305031.956588:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305031.956603:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:1.0:1789305031.956606:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789305031.956611:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785757440:0@lo:400:kworker.0 00000100:00100000:2.0:1789305031.956612:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785757184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305031.956663:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785757184:12345-0@lo:400:kworker.0 Request processed in 52us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305031.956671:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:2.0:1789305031.956706:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785757696 00000100:00100000:2.0:1789305031.956710:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785757696 00000100:00100000:2.0:1789305031.956741:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785757568 00000100:00100000:2.0:1789305031.956744:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785757568 00000100:00100000:2.0:1789305031.956777:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785757312 00000100:00100000:2.0:1789305031.956781:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785757312 00000100:00100000:2.0:1789305031.956797:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:2.0:1789305031.956803:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785757696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305031.956834:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785757696:12345-0@lo:400:kworker.0 Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305031.956840:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:2.0:1789305031.956852:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:2.0:1789305031.956859:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785757568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305031.957011:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1789305031.957021:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785757312:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789305031.960264:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305031.961170:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305031.961545:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785757312:12345-0@lo:400:kworker.0 Request processed in 4523us (5004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305031.961559:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1789305031.961642:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785757824 00000100:00100000:0.0:1789305031.961651:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785757824 00000100:00100000:0.0:1789305031.961707:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785757440 00000100:00100000:0.0:1789305031.961710:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785757440 00000100:00100000:0.0:1789305031.961732:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1789305031.961741:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785757824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305031.961797:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785757824:12345-0@lo:400:kworker.0 Request processed in 57us (5207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305031.961803:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1789305031.961821:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:0.0:1789305031.961827:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785757440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305031.961857:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785757440:12345-0@lo:400:kworker.0 Request processed in 31us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305031.961863:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00080000:0.0:1789305031.961885:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305031.965679:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785757568:12345-0@lo:400:kworker.0 Request processed in 8810us (9158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305031.965697:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:3.0:1789305031.965825:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785757184:0@lo:400:kworker.0 00000100:00100000:3.0:1789305031.965847:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785757696:0@lo:400:kworker.0 00000100:00100000:3.0:1789305031.965889:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785757568:0@lo:400:kworker.0 00000100:00100000:1.0:1789305031.967110:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785757440:0@lo:400:kworker.0 00000100:00100000:1.0:1789305031.967129:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785757312:0@lo:400:kworker.0 00000100:00100000:1.0:1789305031.967211:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785757824:0@lo:400:kworker.0 00010000:00010000:0.0:1789305032.021469:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789305032.038000:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967370 is committed 00000001:00080000:3.0:1789305032.038015:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967371 is committed 00000001:00080000:2.0:1789305032.047882:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00000100:00100000:1.0:1789305032.156080:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305032.158581:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765692672 00000100:00100000:3.0:1789305032.158601:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765692672 00000100:00100000:3.0:1789305032.159824:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1209 00000100:00100000:3.0:1789305032.159838:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:58712:x1876219765692672:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789305032.159862:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305032.159884:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297db2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100984 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.159948:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297db9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.159964:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.159978:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789305032.160020:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:3.0:1789305032.160024:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789305032.160046:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.160073:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100984 expref: 13 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.160112:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100984 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.160122:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:3.0:1789305032.160125:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789305032.160129:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f800, rc 0) 00000100:00100000:3.0:1789305032.160211:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+12:58712:x1876219765692672:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 375us (4138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305032.160218:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1209 00000100:00080000:3.0:1789305032.160409:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305032.164520:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305032.164565:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765692928 00000100:00100000:3.0:1789305032.164587:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765692928 00000100:00100000:3.0:1789305032.164668:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1210 00000100:00100000:3.0:1789305032.164679:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:58712:x1876219765692928:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1789305032.164740:0:30980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789305032.164768:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297db9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100984 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.164794:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297d3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100961 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.164806:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558dd00) 00010000:00010000:3.0:1789305032.164820:0:30980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789305032.164848:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.164862:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.164873:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789305032.165349:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000732cf83 reply state 00000000ad7f7a27 transno 4294967762 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305032.165359:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789305032.165367:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000100:00100000:3.0:1789305032.165454:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:58712:x1876219765692928:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 776us (942us total) trans 4294967762 rc 0/0 00000100:00100000:3.0:1789305032.165461:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1210 00010000:00010000:3.0:1789305032.167130:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.167144:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.167152:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.170774:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305032.170782:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.170793:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.170810:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789305032.170813:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789305032.170818:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305032.170826:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297dc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305032.310925:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305032.310967:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765693056 00000100:00100000:3.0:1789305032.312159:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765693056 00000100:00100000:3.0:1789305032.312225:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1211 00000100:00100000:3.0:1789305032.312237:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:58724:x1876219765693056:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789305032.313219:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:58724:x1876219765693056:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 981us (2299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305032.313229:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1211 00000100:00100000:3.0:1789305032.325754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305032.326219:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765693184 00000100:00100000:1.0:1789305032.326230:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765693184 00000100:00100000:1.0:1789305032.326297:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 657 00000100:00100000:1.0:1789305032.326307:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:58724:x1876219765693184:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789305032.326890:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:58724:x1876219765693184:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 582us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305032.326899:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 657 00000100:00100000:3.0:1789305032.332852:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305032.332966:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765693312 00000100:00100000:0.0:1789305032.332988:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765693312 00000100:00100000:0.0:1789305032.333072:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 658 00000100:00100000:0.0:1789305032.333083:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:58724:x1876219765693312:12345-192.168.202.29@tcp:19:lfs.0 00000100:00080000:3.0:1789305032.333207:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789305032.333487:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:58724:x1876219765693312:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 406us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305032.333496:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 658 00000100:00100000:3.0:1789305032.335751:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305032.335874:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765693440 00000100:00100000:0.0:1789305032.335897:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765693440 00000100:00100000:0.0:1789305032.335960:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1212 00000100:00100000:0.0:1789305032.335970:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:58724:x1876219765693440:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789305032.337032:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:58724:x1876219765693440:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 1000us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305032.337044:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1212 00000100:00100000:3.0:1789305032.341056:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305032.341145:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765693568 00000100:00100000:2.0:1789305032.341155:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765693568 00000100:00100000:2.0:1789305032.341216:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1213 00000100:00100000:2.0:1789305032.341226:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:58724:x1876219765693568:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789305032.341324:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+11:58724:x1876219765693568:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305032.341332:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1213 00000100:00100000:3.0:1789305032.342837:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305032.342959:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765693696 00000100:00100000:0.0:1789305032.342968:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765693696 00000100:00100000:0.0:1789305032.343030:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 659 00000100:00100000:0.0:1789305032.343040:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:58724:x1876219765693696:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789305032.343466:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:58724:x1876219765693696:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 427us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305032.343475:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 659 00000100:00100000:3.0:1789305032.347034:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305032.348729:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765693824 00000100:00100000:0.0:1789305032.348751:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765693824 00000100:00100000:0.0:1789305032.348836:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 660 00000100:00100000:0.0:1789305032.348848:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:58724:x1876219765693824:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789305032.349371:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:58724:x1876219765693824:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 523us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305032.349379:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 660 00000100:00100000:3.0:1789305032.351757:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305032.351863:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765693952 00000100:00100000:0.0:1789305032.351882:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765693952 00000100:00100000:0.0:1789305032.351944:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1214 00000100:00100000:0.0:1789305032.351955:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:58724:x1876219765693952:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789305032.352933:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:58724:x1876219765693952:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 976us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305032.352943:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1214 00000100:00100000:3.0:1789305032.421871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305032.421939:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765694080 00000100:00100000:0.0:1789305032.421952:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765694080 00000100:00100000:0.0:1789305032.422020:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1215 00000100:00100000:0.0:1789305032.422030:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:58728:x1876219765694080:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1789305032.422054:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305032.422087:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297dc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d8610098b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422199:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297dce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422215:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297dce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422228:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297dce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422243:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297dd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422249:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422255:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422490:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297ddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422500:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422507:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789305032.422537:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:0.0:1789305032.422541:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789305032.422562:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422583:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297dce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422590:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297dce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422598:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297dce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422604:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305032.422608:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297dce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422616:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297dce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422628:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:0.0:1789305032.422631:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305032.422635:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297dce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422642:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afaa00/0xefc0bb7231297dce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422654:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422660:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297dd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422669:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422674:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305032.422677:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422683:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422690:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c0558de00) 00010000:00010000:0.0:1789305032.422692:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305032.422695:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297dd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422700:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afba00/0xefc0bb7231297dd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422733:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb600/0xefc0bb7231297dc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610098b expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422747:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610098b expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.422755:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558d300) 00010000:00010000:0.0:1789305032.422756:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789305032.422759:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb800, rc 0) 00000100:00100000:0.0:1789305032.422842:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:58728:x1876219765694080:12345-192.168.202.29@tcp:101:dd.0 Request processed in 812us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305032.422854:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1215 00000100:00100000:3.0:1789305032.427128:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305032.427244:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765694336 00000100:00100000:2.0:1789305032.427255:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765694336 00000100:00100000:2.0:1789305032.427336:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1216 00000100:00100000:2.0:1789305032.427349:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:58728:x1876219765694336:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:2.0:1789305032.427374:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305032.427399:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297de3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100992 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.427541:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297dea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.427557:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297dea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.427580:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297dea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.427596:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.427603:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.427609:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789305032.428274:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26:0x0], index 1: 0 00010000:00010000:2.0:1789305032.428447:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297df8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428459:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428467:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428503:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297dea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428510:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297dea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428517:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297dea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428523:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305032.428528:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297dea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428536:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297dea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428548:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558d300) 00010000:00010000:2.0:1789305032.428552:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305032.428557:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297dea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428563:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecca00/0xefc0bb7231297dea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789305032.428588:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a64eaef reply state 000000003b340d16 transno 4294967763 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305032.428597:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789305032.428625:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297de3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100992 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428639:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297df8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100992 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.428646:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:2.0:1789305032.428648:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789305032.428651:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789305032.428727:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+15:58728:x1876219765694336:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1381us (1643us total) trans 4294967763 rc 0/0 00000100:00100000:2.0:1789305032.428735:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1216 00010000:00010000:0.0:1789305032.431622:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.431701:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.431709:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.431716:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305032.431721:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.431729:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.431746:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c421d2600) 00010000:00010000:0.0:1789305032.431750:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305032.431755:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.431761:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297df1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305032.438039:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305032.442760:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765694464 00000100:00100000:0.0:1789305032.442778:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765694464 00000100:00100000:1.0:1789305032.445476:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 661 00000100:00100000:1.0:1789305032.445494:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:58728:x1876219765694464:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:1.0:1789305032.445521:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305032.445549:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c66e249/0xefc0bb7231297e06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100999 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789305032.445590:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789305032.445633:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=2482s v=(0 0) 00010000:00010000:1.0:1789305032.445639:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789305032.445650:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c66e249/0xefc0bb7231297e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100999 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305032.445670:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c66e249/0xefc0bb7231297e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100999 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305032.445685:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371200, rc 0) 00000100:00100000:1.0:1789305032.445801:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:58728:x1876219765694464:12345-192.168.202.29@tcp:101:dd.0 Request processed in 310us (7774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305032.445808:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 661 00000100:00100000:3.0:1789305032.473759:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305032.473932:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765694592 00000100:00100000:0.0:1789305032.473943:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765694592 00002000:00100000:0.0:1789305032.473996:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x26:0x0] (0->1048575) req@ffff9e2c02f2ea00 x1876219765694592/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:343/0 lens 488/0 e 0 to 0 dl 1789305043 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789305032.474026:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c02f2ea00 with x1876219765694592 ext(0->1048575) 00002000:00010000:0.0:1789305032.474032:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c02f2ea00 00000100:00100000:0.0:1789305032.474062:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 30 00000100:00100000:0.0:1789305032.474072:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765694592:12345-192.168.202.29@tcp:4:dd.0 00000100:00100000:2.0:1789305032.509874:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765694592:12345-192.168.202.29@tcp:4:dd.0 Request processed in 35791us (36114us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789305032.509890:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 30 00002000:00100000:2.0:1789305032.509904:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x26:0x0] (0->1048575) req@ffff9e2c02f2ea00 x1876219765694592/t4294967372(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:343/0 lens 488/448 e 0 to 0 dl 1789305043 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789305032.509915:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2c02f2ea00 with x1876219765694592 ext(0->1048575) 00002000:00010000:2.0:1789305032.509922:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2c02f2ea00 00000100:00100000:1.0:1789305032.516955:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305032.517078:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765694720 00000100:00100000:3.0:1789305032.517104:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765694720 00000100:00100000:3.0:1789305032.517218:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1217 00000100:00100000:3.0:1789305032.517229:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+14:58728:x1876219765694720:12345-192.168.202.29@tcp:44:dd.0 00000100:00100000:2.0:1789305032.564771:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+14:58728:x1876219765694720:12345-192.168.202.29@tcp:44:dd.0 Request processed in 47534us (47815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305032.564784:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1217 00000001:00080000:2.0:1789305032.564827:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967760 is committed 00000001:00080000:2.0:1789305032.564841:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967763 is committed 00000004:00080000:2.0:1789305032.564855:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 99 committed 00000100:00100000:1.0:1789305032.565325:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785757952:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789305032.565491:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305032.565748:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785757952 00000100:00100000:2.0:1789305032.565756:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785757952 00000100:00100000:2.0:1789305032.565854:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1789305032.565865:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785757952:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789305032.565890:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:38 count 1 00010000:00010000:2.0:1789305032.565916:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.565933:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231297d8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610097d expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.565941:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789305032.565944:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789305032.565947:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.565970:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231297d8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610097d expref: 5 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305032.565981:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231297d8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610097d expref: 5 pid: 6693 timeout: 2582 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305032.565991:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785758080:192.168.202.29@tcp:104: 00000100:00100000:2.0:1789305032.566038:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03f0c3c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789305032.569588:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305032.571177:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305032.571268:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305032.571301:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765694976 00000100:00100000:1.0:1789305032.571311:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765694976 00010000:00010000:1.0:1789305032.571351:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231297d8f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610097d expref: 6 pid: 6693 timeout: 2582 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305032.571389:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 455 00000100:00100000:1.0:1789305032.571399:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765694976:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789305032.571414:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305032.571419:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231297d8f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610097d expref: 6 pid: 6693 timeout: 2582 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305032.571440:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231297d8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610097d expref: 6 pid: 6693 timeout: 2582 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305032.571466:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789305032.571470:0:57145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789305032.571476:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305032.571485:0:57145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305032.571507:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789305032.571555:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765694976:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 156us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305032.571562:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 455 00000100:00100000:0.0:1789305032.571710:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765694848 00000100:00100000:0.0:1789305032.571714:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765694848 00000100:00100000:0.0:1789305032.571751:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 663 00000100:00100000:0.0:1789305032.571758:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765694848:12345-192.168.202.29@tcp:16:dd.0 00010000:00010000:0.0:1789305032.576203:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3a9dcef/0xefc0bb7231297d8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610097d expref: 5 pid: 6693 timeout: 2582 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305032.576231:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1876219785758080:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789305032.576257:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.576269:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.576276:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.576287:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.576300:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.576321:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789305032.577345:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1876219785757952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11475us (11847us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789305032.577354:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00010000:00010000:0.0:1789305032.577381:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305032.577386:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.577394:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305032.577397:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.577404:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.577418:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.577423:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a25ffc35/0xefc0bb7231297e0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305032.577437:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305032.577438:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305032.577440:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789305032.577688:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c3fd42300/2, rc 0, transno 4294967373 00000100:00100000:3.0:1789305032.577696:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785757952:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1789305032.592980:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967372 is committed 00000100:00100000:0.0:1789305032.593039:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765694848:12345-192.168.202.29@tcp:16:dd.0 Request processed in 21273us (21860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305032.593051:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 663 00000100:00100000:1.0:1789305032.595189:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305032.595322:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765695232 00000100:00100000:3.0:1789305032.595332:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765695232 00000100:00100000:3.0:1789305032.595396:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 123 00000100:00100000:3.0:1789305032.595406:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:58728:x1876219765695232:12345-192.168.202.29@tcp:35:dd.0 00000100:00100000:3.0:1789305032.595906:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:58728:x1876219765695232:12345-192.168.202.29@tcp:35:dd.0 Request processed in 499us (723us total) trans 4294967764 rc 0/0 00000100:00100000:3.0:1789305032.595914:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 123 00010000:00010000:3.0:1789305033.045326:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789305033.804633:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967764 is committed 00010000:00010000:0.0:1789305034.067189:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305034.514532:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785758208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305034.514635:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305034.514931:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785758208 00000100:00100000:2.0:1789305034.514940:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785758208 00000100:00100000:2.0:1789305034.515003:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1789305034.515013:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785758208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305034.515053:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789305034.515132:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785758208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305034.515139:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00080000:2.0:1789305034.515189:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305034.515219:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967371 gen 2 00000004:00080000:2.0:1789305034.515224:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c3fd41880, transno 4294967371 00000100:00100000:2.0:1789305034.515242:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785758208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305034.595087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305034.595282:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765695360 00000100:00100000:2.0:1789305034.595296:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765695360 00000100:00100000:2.0:1789305034.595371:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1383 00000100:00100000:2.0:1789305034.595383:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765695360:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305034.598539:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765695360:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 3145us (3451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305034.598566:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1383 00000100:00100000:3.0:1789305034.600330:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305034.600474:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305034.600518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305034.602318:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765695616 00000100:00100000:2.0:1789305034.602332:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765695616 00000100:00100000:2.0:1789305034.602396:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765695744 00000100:00100000:2.0:1789305034.602399:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765695744 00000100:00100000:2.0:1789305034.602427:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1382 00000100:00100000:2.0:1789305034.602436:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765695616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1789305034.603735:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789305034.603744:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305034.603802:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1383 00000100:00100000:0.0:1789305034.603822:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765695744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305034.604966:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765695616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 2524us (4636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305034.604982:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1382 00000100:00100000:0.0:1789305034.605079:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2356:x1876219765695744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1267us (4559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305034.605087:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1383 00000100:00100000:3.0:1789305034.609252:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765695488 00000100:00100000:3.0:1789305034.609273:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765695488 00000100:00100000:3.0:1789305034.609365:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1787 00000100:00100000:3.0:1789305034.609377:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765695488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305034.609484:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765695488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 109us (9009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305034.609492:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1787 00000100:00080000:1.0:1789305034.610915:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789305035.014187:0:100327:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2484692093174ns, next at 2481811646978ns, rc = 0 00000004:00080000:3.0:1789305035.014385:0:100327:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2484692293076ns, next at 2480596349222ns, rc = 0 00000004:00080000:2.0:1789305035.057994:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 107 committed 00000004:00080000:2.0:1789305035.058018:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 100 committed 00010000:00010000:0.0:1789305035.097921:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305035.538683:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789305035.538708:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785758336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305035.538794:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305035.539058:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785758336 00000100:00100000:3.0:1789305035.539068:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785758336 00000100:00080000:1.0:1789305035.539226:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305035.539320:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1789305035.539332:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785758336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789305035.539373:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305035.539624:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785758336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 293us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305035.539632:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:0.0:1789305035.544428:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785758336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789305036.118747:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789305036.431004:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00000100:00100000:3.0:1789305036.565866:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305036.565934:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765695872 00000100:00100000:0.0:1789305036.565944:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765695872 00000100:00100000:0.0:1789305036.566012:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1218 00000100:00100000:0.0:1789305036.566023:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:58921:x1876219765695872:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789305036.566161:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:58921:x1876219765695872:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 139us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305036.566168:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1218 00000100:00080000:3.0:1789305036.568482:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305036.573420:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305036.573595:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765696000 00000100:00100000:1.0:1789305036.573606:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765696000 00000100:00100000:1.0:1789305036.573669:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 664 00000100:00100000:1.0:1789305036.573678:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58921:x1876219765696000:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789305036.574052:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58921:x1876219765696000:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 374us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305036.574062:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 664 00000100:00080000:1.0:1789305036.574084:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305036.579565:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305036.579616:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765696128 00000100:00100000:0.0:1789305036.579629:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765696128 00000100:00100000:0.0:1789305036.579697:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 665 00000100:00100000:0.0:1789305036.579709:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:58921:x1876219765696128:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789305036.580122:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:58921:x1876219765696128:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 415us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305036.580130:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 665 00000100:00080000:0.0:1789305036.580164:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305036.581904:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305036.581943:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765696256 00000100:00100000:2.0:1789305036.581951:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765696256 00000100:00100000:2.0:1789305036.581992:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1219 00000100:00100000:2.0:1789305036.581999:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:58921:x1876219765696256:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789305036.582549:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:58921:x1876219765696256:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 548us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305036.582559:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1219 00000100:00100000:0.0:1789305036.585976:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305036.586057:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765696384 00000100:00100000:3.0:1789305036.586068:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765696384 00000100:00100000:3.0:1789305036.586173:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1220 00000100:00100000:3.0:1789305036.586185:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:58921:x1876219765696384:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:3.0:1789305036.586299:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:58921:x1876219765696384:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 116us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305036.586306:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1220 00000100:00100000:1.0:1789305036.589864:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305036.589910:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765696512 00000100:00100000:2.0:1789305036.589920:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765696512 00000100:00100000:2.0:1789305036.589966:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 666 00000100:00100000:2.0:1789305036.589973:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58921:x1876219765696512:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:2.0:1789305036.590921:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:58921:x1876219765696512:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 944us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305036.590928:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 666 00000100:00100000:1.0:1789305036.594493:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305036.594916:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765696640 00000100:00100000:0.0:1789305036.594928:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765696640 00000100:00100000:0.0:1789305036.594992:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 667 00000100:00100000:0.0:1789305036.595004:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:58921:x1876219765696640:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789305036.595500:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:58921:x1876219765696640:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 497us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305036.595508:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 667 00000100:00100000:1.0:1789305036.597542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305036.597638:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765696768 00000100:00100000:0.0:1789305036.597647:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765696768 00000100:00100000:0.0:1789305036.597704:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1221 00000100:00100000:0.0:1789305036.597713:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:58921:x1876219765696768:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:0.0:1789305036.598136:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:58921:x1876219765696768:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 422us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305036.598144:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1221 00000100:00100000:1.0:1789305036.675953:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305036.676001:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765697024 00000100:00100000:1.0:1789305036.676011:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765697024 00000100:00100000:1.0:1789305036.676060:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1222 00000100:00100000:1.0:1789305036.676069:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:58925:x1876219765697024:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:1.0:1789305036.676136:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305036.676166:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297df8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100992 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.676186:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9e2c421d2100) 00010000:00010000:1.0:1789305036.676198:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789305036.676223:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297e14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.676237:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297e14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.676247:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297e14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.676262:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.676273:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.676280:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.676592:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297e22 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.676601:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297e22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.676608:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297e22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789305036.677490:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].38, 64 off10624 00000004:00080000:1.0:1789305036.677503:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2486355411299ns, next at 2487355408764ns, rc = 0 00010000:00010000:1.0:1789305036.677614:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677628:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677638:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677646:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677653:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677665:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677687:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789305036.677720:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297e22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677726:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297e22 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677733:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297e22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677739:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305036.677743:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297e22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677751:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297e22 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677761:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9e2c14adde00) 00010000:00010000:1.0:1789305036.677764:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789305036.677769:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297e22 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677775:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370a00/0xefc0bb7231297e22 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677794:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297e14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677800:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297e14 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677807:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297e14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677812:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305036.677815:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297e14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677821:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297e14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677827:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558d300) 00010000:00010000:1.0:1789305036.677829:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789305036.677832:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297e14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305036.677837:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370200/0xefc0bb7231297e14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789305036.677844:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a898c74c reply state 00000000cec492cc transno 4294967765 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305036.677853:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789305036.677945:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:58925:x1876219765697024:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1873us (1999us total) trans 4294967765 rc 0/0 00000100:00100000:1.0:1789305036.677954:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1222 00010000:00010000:0.0:1789305036.681618:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305036.681633:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.681651:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305036.681655:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.681665:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.681683:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9e2c14adde00) 00010000:00010000:0.0:1789305036.681686:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789305036.681701:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.681707:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370400/0xefc0bb7231297e29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.681734:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305036.681736:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305036.681738:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305036.684524:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.684554:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.684562:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.684568:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305036.684573:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.684586:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.684604:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c14add300) 00010000:00010000:0.0:1789305036.684607:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789305036.684611:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305036.684618:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41371400/0xefc0bb7231297e1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305037.076267:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785758464:0@lo:400:kworker.0 00000100:00100000:2.0:1789305037.076276:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785758592:0@lo:400:kworker.0 00000100:00100000:3.0:1789305037.076334:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785758720:0@lo:400:kworker.0 00000100:00100000:2.0:1789305037.078284:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305037.078309:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305037.078354:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785759104:0@lo:400:kworker.0 00000100:00100000:3.0:1789305037.078366:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785758592 00000100:00100000:3.0:1789305037.078374:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785758592 00000100:00100000:2.0:1789305037.078386:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305037.078411:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789305037.078417:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785758976:0@lo:400:kworker.0 00000100:00100000:3.0:1789305037.078423:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:3.0:1789305037.078431:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785758592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305037.078437:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305037.078465:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785758848:0@lo:400:kworker.0 00000100:00100000:2.0:1789305037.078488:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305037.078503:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785758592:12345-0@lo:400:kworker.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305037.078511:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00100000:2.0:1789305037.078521:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785758720 00000100:00100000:2.0:1789305037.078535:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785758720 00000100:00100000:3.0:1789305037.078537:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785758976 00000100:00100000:3.0:1789305037.078539:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785758976 00000100:00100000:2.0:1789305037.078567:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785759104 00000100:00100000:0.0:1789305037.078578:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:0.0:1789305037.078587:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785758720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305037.078624:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785758720:12345-0@lo:400:kworker.0 Request processed in 40us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305037.078631:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:0.0:1789305037.078651:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785758848 00000100:00100000:0.0:1789305037.078656:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785758848 00000100:00100000:3.0:1789305037.078809:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:3.0:1789305037.078816:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785758976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305037.078847:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785758976:12345-0@lo:400:kworker.0 Request processed in 33us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305037.078852:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1789305037.078865:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785759104 00000100:00100000:2.0:1789305037.078901:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1789305037.078907:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785759104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305037.078907:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305037.078937:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785759104:12345-0@lo:400:kworker.0 Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305037.078943:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1789305037.078952:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785758464 00000100:00100000:1.0:1789305037.078956:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785758464 00000100:00100000:1.0:1789305037.078984:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1789305037.078990:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785758464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305037.079027:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785758464:12345-0@lo:400:kworker.0 Request processed in 38us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305037.079034:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1789305037.079079:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785758464:0@lo:400:kworker.0 00000100:00080000:1.0:1789305037.079150:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789305037.079157:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789305037.079159:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305037.079182:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:1.0:1789305037.079188:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c3fd42300, transno 4294967373 00000100:00100000:1.0:1789305037.079199:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785758720:0@lo:400:kworker.0 00000100:00100000:2.0:1789305037.079279:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785758976:0@lo:400:kworker.0 00000100:00100000:2.0:1789305037.079291:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785758592:0@lo:400:kworker.0 00000100:00100000:2.0:1789305037.079300:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785759104:0@lo:400:kworker.0 00000100:00100000:0.0:1789305037.079390:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790 00000100:00100000:0.0:1789305037.079397:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785758848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305037.079443:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785758848:12345-0@lo:400:kworker.0 Request processed in 47us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305037.079449:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790 00000100:00100000:3.0:1789305037.079723:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785758848:0@lo:400:kworker.0 00010000:00010000:0.0:1789305037.138313:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305038.164318:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789305038.710887:0:100474:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2488388793591ns, next at 2481811646978ns, rc = 0 00000004:00080000:2.0:1789305038.710987:0:100474:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2488388895991ns, next at 2487355408764ns, rc = 0 00000001:00080000:3.0:1789305038.731485:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967765 is committed 00000004:00080000:3.0:1789305038.731498:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 108 committed 00000100:00100000:1.0:1789305038.731691:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305038.731723:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785759232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789305038.731798:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305038.731997:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785759232 00000100:00100000:0.0:1789305038.732006:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785759232 00000100:00100000:0.0:1789305038.732063:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1789305038.732074:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785759232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789305038.732138:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:38 count 1 00010000:00010000:0.0:1789305038.732165:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305038.732188:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c66e249/0xefc0bb7231297e06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100999 expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305038.732198:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x26:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1789305038.732203:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789305038.732207:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305038.732237:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c66e249/0xefc0bb7231297e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100999 expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305038.732250:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c66e249/0xefc0bb7231297e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100999 expref: 5 pid: 6691 timeout: 2588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305038.732262:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785759360:192.168.202.29@tcp:104: 00000100:00100000:0.0:1789305038.732324:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c18b97a80 going to sleep for 11 seconds 00000004:00080000:3.0:1789305038.732932:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 109 committed 00000004:00080000:3.0:1789305038.732983:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 101 committed 00000100:00100000:0.0:1789305038.734281:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1876219785759360:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789305038.734313:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305038.737851:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305038.737935:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765697152 00000100:00100000:1.0:1789305038.737946:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765697152 00010000:00010000:1.0:1789305038.738002:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c66e249/0xefc0bb7231297e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100999 expref: 6 pid: 6691 timeout: 2588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305038.738038:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 456 00000100:00100000:1.0:1789305038.738045:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c200d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765697152:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789305038.738056:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305038.738060:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c66e249/0xefc0bb7231297e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100999 expref: 6 pid: 6691 timeout: 2588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305038.738074:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c66e249/0xefc0bb7231297e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100999 expref: 6 pid: 6691 timeout: 2588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305038.738118:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c66e249/0xefc0bb7231297e06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100999 expref: 6 pid: 6691 timeout: 2588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305038.738131:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789305038.738134:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789305038.738139:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305038.738145:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305038.738166:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789305038.738219:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c200d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765697152:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 174us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305038.738226:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 456 00000100:00080000:2.0:1789305038.738413:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789305038.738517:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305038.738527:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305038.738537:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305038.738545:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305038.738571:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789305038.739227:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785759232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7153us (7427us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789305038.739236:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00010000:00010000:2.0:1789305038.739426:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305038.739434:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305038.739444:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305038.739449:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305038.739459:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305038.739477:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305038.739485:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c46a0b0/0xefc0bb7231297e30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305038.739506:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305038.739518:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305038.739519:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789305038.739771:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b011cad80/2, rc 0, transno 4294967373 00000100:00100000:1.0:1789305038.739792:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785759232:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789305039.186208:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305039.641741:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785759488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305039.641830:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305039.642329:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785759488 00000100:00100000:1.0:1789305039.642340:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785759488 00000100:00100000:1.0:1789305039.642407:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1789305039.642418:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785759488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305039.642466:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789305039.642809:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785759488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 393us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305039.642818:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00080000:3.0:1789305039.643324:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305039.643387:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785759488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305039.716863:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305039.716939:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765697280 00000100:00100000:2.0:1789305039.716951:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765697280 00000100:00100000:2.0:1789305039.717042:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1385 00000100:00100000:2.0:1789305039.717051:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765697280:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305039.717148:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765697280:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305039.717154:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1385 00000100:00100000:1.0:1789305039.719740:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305039.719788:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305039.719871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305039.719951:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765697664 00000100:00100000:3.0:1789305039.719963:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765697664 00000100:00100000:3.0:1789305039.720022:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765697536 00000100:00100000:3.0:1789305039.720025:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765697536 00000100:00100000:3.0:1789305039.720058:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1386 00000100:00100000:3.0:1789305039.720067:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765697664:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305039.720174:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765697664:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 107us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305039.720182:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1386 00000100:00100000:3.0:1789305039.720200:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1387 00000100:00100000:3.0:1789305039.720206:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765697536:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305039.720233:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765697536:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305039.720239:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1387 00000100:00080000:3.0:1789305039.720256:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789305039.721027:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765697408 00000100:00100000:2.0:1789305039.721035:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765697408 00000100:00100000:2.0:1789305039.721118:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1791 00000100:00100000:2.0:1789305039.721128:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765697408:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305039.721177:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765697408:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 51us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305039.721183:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1791 00000100:00080000:3.0:1789305039.721571:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789305040.210388:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305040.661131:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789305040.661157:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785759616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305040.661234:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305040.661555:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785759616 00000100:00100000:3.0:1789305040.661565:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785759616 00000100:00100000:3.0:1789305040.661638:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:3.0:1789305040.661649:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785759616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789305040.661683:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305040.661739:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785759616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305040.661746:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1789305040.661930:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785759616:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789305040.662048:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789305041.235984:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789305041.767162:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967373 is committed 00000100:00100000:0.0:1789305042.195251:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b0115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785759872:0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.195333:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305042.195395:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785760384:0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.195427:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305042.195452:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789305042.195458:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785760000:0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.195490:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305042.195543:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785759872 00000100:00100000:0.0:1789305042.195552:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785759872 00000100:00100000:0.0:1789305042.195604:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:0.0:1789305042.195614:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785759872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.195667:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785759872:12345-0@lo:400:kworker.0 Request processed in 54us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305042.195674:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:0.0:1789305042.195695:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785760384 00000100:00100000:0.0:1789305042.195699:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785760384 00000100:00100000:0.0:1789305042.195727:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785760000 00000100:00100000:0.0:1789305042.195729:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785760000 00000100:00100000:0.0:1789305042.195745:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1789305042.195751:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785760384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.195777:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785760384:12345-0@lo:400:kworker.0 Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305042.195783:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1789305042.195792:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1789305042.195797:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785760000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.195822:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785760000:12345-0@lo:400:kworker.0 Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305042.195828:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00080000:0.0:1789305042.195848:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789305042.195852:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789305042.195886:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785760000:0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.195896:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b0115b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785759872:0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.195904:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:0.0:1789305042.195909:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b011cad80, transno 4294967373 00000100:00100000:0.0:1789305042.195920:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785760384:0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.196379:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785760128:0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.196425:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305042.196452:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789305042.196459:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785759744:0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.196498:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305042.196770:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785759744 00000100:00100000:3.0:1789305042.196777:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785759744 00000100:00100000:3.0:1789305042.196815:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1789305042.196822:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785759744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305042.196870:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785759744:12345-0@lo:400:kworker.0 Request processed in 49us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305042.196876:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1789305042.197331:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785760128 00000100:00100000:3.0:1789305042.197336:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785760128 00000100:00100000:3.0:1789305042.197372:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:3.0:1789305042.197379:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785760128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305042.197419:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785760128:12345-0@lo:400:kworker.0 Request processed in 41us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305042.197425:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00080000:3.0:1789305042.197453:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305042.197737:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785759744:0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.197747:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785760256:0@lo:400:kworker.0 00000100:00100000:0.0:1789305042.197777:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305042.197806:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785760128:0@lo:400:kworker.0 00000100:00100000:3.0:1789305042.199867:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785760256 00000100:00100000:3.0:1789305042.199886:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785760256 00000100:00100000:3.0:1789305042.199982:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794 00000100:00100000:3.0:1789305042.199992:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785760256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305042.200133:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785760256:12345-0@lo:400:kworker.0 Request processed in 142us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305042.200140:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794 00000100:00080000:0.0:1789305042.200373:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305042.200431:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785760256:0@lo:400:kworker.0 00010000:00010000:2.0:1789305042.258515:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305043.283265:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305044.306678:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305044.754585:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305044.754622:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785760512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305044.754695:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305044.754872:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785760512 00000100:00100000:1.0:1789305044.754881:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785760512 00000100:00100000:1.0:1789305044.754953:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:1.0:1789305044.754964:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785760512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305044.755001:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305044.755051:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785760512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305044.755058:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00080000:3.0:1789305044.755191:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305044.755232:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785760512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305044.837264:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305044.837308:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305044.837348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305044.837431:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765697920 00000100:00100000:0.0:1789305044.837442:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765697920 00000100:00100000:0.0:1789305044.837524:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1795 00000100:00100000:0.0:1789305044.837536:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765697920:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305044.837638:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765697920:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 104us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305044.837647:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1795 00000100:00080000:0.0:1789305044.837773:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305044.837960:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765698176 00000100:00100000:3.0:1789305044.837966:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765698176 00000100:00100000:3.0:1789305044.838013:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1390 00000100:00100000:3.0:1789305044.838021:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765698176:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305044.838061:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765698176:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305044.838068:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1390 00000100:00100000:1.0:1789305044.838729:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00080000:0.0:1789305044.838810:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305044.839674:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765698048 00000100:00100000:3.0:1789305044.839684:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765698048 00000100:00100000:3.0:1789305044.839753:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1391 00000100:00100000:3.0:1789305044.839763:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765698048:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305044.839845:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765698048:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 84us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305044.839853:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1391 00000100:00080000:0.0:1789305044.840504:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789305044.845576:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765697792 00000100:00100000:2.0:1789305044.845593:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765697792 00000100:00100000:2.0:1789305044.845672:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1387 00000100:00100000:2.0:1789305044.845683:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765697792:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305044.845788:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765697792:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 107us (8437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305044.845796:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1387 00010000:00010000:2.0:1789305045.330321:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305045.778835:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785760640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305045.778941:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305045.779277:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785760640 00000100:00100000:3.0:1789305045.779289:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785760640 00000100:00100000:3.0:1789305045.779370:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1789305045.779381:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785760640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789305045.779419:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305045.779495:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785760640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305045.779503:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:2.0:1789305045.779663:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785760640:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789305045.779824:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789305046.358873:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305047.318228:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785760768:0@lo:400:kworker.0 00000100:00100000:2.0:1789305047.318318:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305047.318454:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785760768 00000100:00100000:1.0:1789305047.318463:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785760768 00000100:00100000:1.0:1789305047.318553:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:1.0:1789305047.318562:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785760768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.318948:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785761024:0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.318983:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305047.319008:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789305047.319014:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785760896:0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.319036:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305047.319074:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785760896 00000100:00100000:0.0:1789305047.319078:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785760896 00000100:00100000:0.0:1789305047.319129:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:0.0:1789305047.319137:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785760896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.319175:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785760896:12345-0@lo:400:kworker.0 Request processed in 39us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305047.319199:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:0.0:1789305047.319221:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785761024 00000100:00100000:0.0:1789305047.319225:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785761024 00000100:00100000:0.0:1789305047.319257:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1789305047.319263:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785761024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.319292:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785761024:12345-0@lo:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305047.319297:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00080000:0.0:1789305047.319311:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305047.319337:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785760896:0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.319348:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785761024:0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.319390:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785761152:0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.319414:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305047.319455:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785761152 00000100:00100000:0.0:1789305047.319459:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785761152 00000100:00100000:0.0:1789305047.319968:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797 00000100:00100000:0.0:1789305047.319977:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785761152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.320017:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785761152:12345-0@lo:400:kworker.0 Request processed in 43us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305047.320024:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797 00000100:00080000:0.0:1789305047.320044:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305047.320063:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785761152:0@lo:400:kworker.0 00000100:00100000:1.0:1789305047.324966:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785760768:12345-0@lo:400:kworker.0 Request processed in 6395us (6641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305047.324981:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:1.0:1789305047.325610:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785761408:0@lo:400:kworker.0 00000100:00100000:1.0:1789305047.325662:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305047.325710:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785761408 00000100:00100000:1.0:1789305047.325716:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785761408 00000100:00100000:1.0:1789305047.325760:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1789305047.325768:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785761408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305047.325810:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785761408:12345-0@lo:400:kworker.0 Request processed in 44us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305047.325815:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00080000:1.0:1789305047.325829:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305047.325860:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785761408:0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.326040:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789305047.326052:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785761280:0@lo:400:kworker.0 00000100:00100000:0.0:1789305047.326085:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305047.326400:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785761280 00000100:00100000:3.0:1789305047.326405:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785761280 00000100:00100000:3.0:1789305047.326462:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798 00000100:00100000:3.0:1789305047.326470:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785761280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305047.326684:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785761280:12345-0@lo:400:kworker.0 Request processed in 215us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305047.326691:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798 00000100:00100000:3.0:1789305047.326717:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785761280:0@lo:400:kworker.0 00000100:00080000:1.0:1789305047.329841:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305047.330790:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785760768:0@lo:400:kworker.0 00010000:00010000:2.0:1789305047.383573:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305048.405018:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305049.426560:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305049.874400:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785761536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305049.874773:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305049.874995:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785761536 00000100:00100000:1.0:1789305049.875003:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785761536 00000100:00100000:1.0:1789305049.875071:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1789305049.875081:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785761536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305049.875136:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789305049.875141:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305049.875196:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785761536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305049.875204:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1789305049.875230:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785761536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305049.958762:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305049.958814:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305049.958834:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765698432 00000100:00100000:0.0:1789305049.958845:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765698432 00000100:00100000:1.0:1789305049.958857:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305049.958891:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305049.958926:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765698688 00000100:00100000:1.0:1789305049.958930:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765698688 00000100:00100000:2.0:1789305049.958936:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765698560 00000100:00100000:2.0:1789305049.958940:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765698560 00000100:00100000:1.0:1789305049.958966:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1394 00000100:00100000:1.0:1789305049.958976:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765698688:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305049.959002:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765698304 00000100:00100000:3.0:1789305049.959005:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765698304 00000100:00100000:3.0:1789305049.959049:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1389 00000100:00100000:1.0:1789305049.959049:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765698688:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305049.959055:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765698304:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305049.959086:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1799 00000100:00100000:0.0:1789305049.959124:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765698432:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305049.959167:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765698432:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 46us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305049.959173:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1799 00000100:00100000:3.0:1789305049.959276:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765698304:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 221us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305049.959284:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1389 00000100:00080000:3.0:1789305049.959317:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789305049.959321:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789305049.959324:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305049.962814:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1395 00000100:00100000:2.0:1789305049.962845:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765698560:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305049.962923:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765698560:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 95us (4031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305049.962931:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1395 00000100:00100000:1.0:1789305049.965222:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1394 00000100:00100000:1.0:1789305050.388880:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785762048:0@lo:400:kworker.0 00000100:00100000:1.0:1789305050.388963:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305050.389038:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305050.389045:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785761920:0@lo:400:kworker.0 00000100:00100000:1.0:1789305050.389071:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305050.389132:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785762048 00000100:00100000:1.0:1789305050.389140:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785762048 00000100:00100000:1.0:1789305050.389379:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800 00000100:00100000:1.0:1789305050.389391:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785762048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305050.389677:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785762048:12345-0@lo:400:kworker.0 Request processed in 288us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305050.389687:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800 00000100:00080000:1.0:1789305050.389715:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305050.389734:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785761920 00000100:00100000:1.0:1789305050.389738:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785761920 00000100:00100000:1.0:1789305050.389776:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:1.0:1789305050.389784:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785761920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305050.389817:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785761920:12345-0@lo:400:kworker.0 Request processed in 34us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305050.389823:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00080000:1.0:1789305050.389837:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305050.389867:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785761920:0@lo:400:kworker.0 00000100:00100000:1.0:1789305050.389878:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785762048:0@lo:400:kworker.0 00000100:00100000:2.0:1789305050.390164:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785761792:0@lo:400:kworker.0 00000100:00100000:2.0:1789305050.390212:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305050.390244:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785762304:0@lo:400:kworker.0 00000100:00100000:2.0:1789305050.390265:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305050.390284:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789305050.390290:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785761664:0@lo:400:kworker.0 00000100:00100000:2.0:1789305050.390316:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305050.390334:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785762176:0@lo:400:kworker.0 00000100:00100000:2.0:1789305050.390354:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305050.390853:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785762304 00000100:00100000:0.0:1789305050.390861:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785762304 00000100:00100000:0.0:1789305050.390922:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1789305050.390931:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785762304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305050.390986:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785762304:12345-0@lo:400:kworker.0 Request processed in 58us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305050.390993:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1789305050.391039:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785762304:0@lo:400:kworker.0 00000100:00100000:0.0:1789305050.391066:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785761792 00000100:00100000:0.0:1789305050.391070:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785761792 00000100:00100000:0.0:1789305050.391122:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785762176 00000100:00100000:0.0:1789305050.391125:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785762176 00000100:00100000:0.0:1789305050.391152:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:0.0:1789305050.391158:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785761792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305050.391309:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785761792:12345-0@lo:400:kworker.0 Request processed in 151us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305050.391316:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00100000:0.0:1789305050.391329:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:0.0:1789305050.391335:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785762176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305050.391364:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785762176:12345-0@lo:400:kworker.0 Request processed in 29us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305050.391370:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:0.0:1789305050.391409:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785762176:0@lo:400:kworker.0 00000100:00100000:0.0:1789305050.391421:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785761792:0@lo:400:kworker.0 00000100:00080000:1.0:1789305050.392645:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305050.393249:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785761664 00000100:00100000:2.0:1789305050.393262:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785761664 00000100:00100000:2.0:1789305050.393314:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1789305050.393324:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785761664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305050.393419:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785761664:12345-0@lo:400:kworker.0 Request processed in 97us (3101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305050.393425:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:1.0:1789305050.394811:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785761664:0@lo:400:kworker.0 00010000:00010000:2.0:1789305050.451582:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305050.898951:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305050.898985:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785762432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305050.899063:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305050.899177:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785762432 00000100:00100000:2.0:1789305050.899185:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785762432 00000100:00100000:2.0:1789305050.899236:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1789305050.899246:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785762432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789305050.899283:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305050.899350:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785762432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305050.899357:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1789305050.899633:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785762432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789305051.474692:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305052.499404:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305052.579395:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305052.579490:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765698816 00000100:00100000:1.0:1789305052.579504:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765698816 00000100:00100000:1.0:1789305052.579603:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1223 00000100:00100000:1.0:1789305052.579614:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:59102:x1876219765698816:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789305052.579737:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:59102:x1876219765698816:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 124us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305052.579744:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1223 00000100:00080000:2.0:1789305052.579873:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305052.585520:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305052.585813:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765698944 00000100:00100000:1.0:1789305052.585830:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765698944 00000100:00100000:1.0:1789305052.585965:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 669 00000100:00100000:1.0:1789305052.585980:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:59102:x1876219765698944:12345-192.168.202.29@tcp:19:lfs.0 00000100:00080000:2.0:1789305052.586562:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305052.587116:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:59102:x1876219765698944:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 1107us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305052.587129:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 669 00000100:00100000:3.0:1789305052.594696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305052.596647:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765699072 00000100:00100000:1.0:1789305052.596669:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765699072 00000100:00100000:1.0:1789305052.596785:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 670 00000100:00100000:1.0:1789305052.596801:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:59102:x1876219765699072:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789305052.597430:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:59102:x1876219765699072:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 633us (2749us total) trans 0 rc 0/0 00000100:00080000:2.0:1789305052.597556:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305052.598305:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 670 00000100:00100000:0.0:1789305052.603896:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305052.604261:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765699200 00000100:00100000:2.0:1789305052.604275:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765699200 00000100:00100000:2.0:1789305052.604349:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1224 00000100:00100000:2.0:1789305052.604362:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:59102:x1876219765699200:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789305052.605451:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:59102:x1876219765699200:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 1085us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305052.605464:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1224 00000100:00100000:0.0:1789305052.612516:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305052.612726:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765699328 00000100:00100000:1.0:1789305052.612741:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765699328 00000100:00100000:1.0:1789305052.612822:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1225 00000100:00100000:1.0:1789305052.612834:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:59102:x1876219765699328:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:1.0:1789305052.612960:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:59102:x1876219765699328:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 129us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305052.612968:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1225 00000100:00100000:3.0:1789305052.621949:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305052.622074:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765699456 00000100:00100000:1.0:1789305052.622086:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765699456 00000100:00100000:1.0:1789305052.622177:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 671 00000100:00100000:1.0:1789305052.622186:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:59102:x1876219765699456:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:1.0:1789305052.622925:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:59102:x1876219765699456:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 738us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305052.622933:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 671 00000100:00100000:0.0:1789305052.644446:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305052.644509:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765699584 00000100:00100000:0.0:1789305052.644525:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765699584 00000100:00100000:0.0:1789305052.644595:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 672 00000100:00100000:0.0:1789305052.644607:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:59102:x1876219765699584:12345-192.168.202.29@tcp:19:lfs.0 00000100:00100000:0.0:1789305052.645152:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:59102:x1876219765699584:12345-192.168.202.29@tcp:19:lfs.0 Request processed in 545us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305052.645162:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 672 00000100:00100000:0.0:1789305052.652008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305052.652113:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765699712 00000100:00100000:2.0:1789305052.652127:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765699712 00000100:00100000:2.0:1789305052.652368:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1226 00000100:00100000:2.0:1789305052.652391:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:59102:x1876219765699712:12345-192.168.202.29@tcp:48:lfs.0 00000100:00100000:2.0:1789305052.652944:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:59102:x1876219765699712:12345-192.168.202.29@tcp:48:lfs.0 Request processed in 564us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305052.652954:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1226 00010000:00010000:2.0:1789305053.534686:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305054.340951:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305054.342044:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765699840 00000100:00100000:2.0:1789305054.342061:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765699840 00000100:00100000:2.0:1789305054.345534:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1227 00000100:00100000:2.0:1789305054.345556:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:59117:x1876219765699840:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:2.0:1789305054.345588:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305054.345615:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297e37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009a0 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.345715:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297e3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.345733:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.345751:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789305054.345801:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:2.0:1789305054.345804:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789305054.345824:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.345848:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd800/0xefc0bb7231297e37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009a0 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.345863:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297e3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009a0 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.345871:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558d300) 00010000:00010000:2.0:1789305054.345874:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789305054.345878:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecdc00, rc 0) 00000100:00100000:2.0:1789305054.345961:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:59117:x1876219765699840:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 415us (5028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305054.345967:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1227 00000100:00080000:1.0:1789305054.347405:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305054.355044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305054.355483:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765700096 00000100:00100000:1.0:1789305054.355499:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765700096 00000100:00100000:1.0:1789305054.355571:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1228 00000100:00100000:1.0:1789305054.355584:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:59117:x1876219765700096:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:1.0:1789305054.355656:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789305054.355701:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297e3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009a0 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305054.355724:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231297ddc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d8610098b expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305054.355737:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558d300) 00010000:00010000:1.0:1789305054.355750:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789305054.355785:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305054.355800:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305054.355811:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789305054.434403:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3bdf21e reply state 00000000a2490a93 transno 4294967766 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305054.434438:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789305054.434465:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000100:00100000:0.0:1789305054.434644:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:59117:x1876219765700096:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 79056us (79605us total) trans 4294967766 rc 0/0 00000100:00100000:0.0:1789305054.434656:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1228 00000001:00080000:0.0:1789305054.435526:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967766 is committed 00010000:00010000:2.0:1789305054.435620:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.435634:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.435642:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.435648:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305054.435653:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.435663:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.435684:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c14add600) 00010000:00010000:2.0:1789305054.435688:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789305054.435694:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.435701:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c41370800/0xefc0bb7231297e45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305054.510499:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305054.510809:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765700224 00000100:00100000:3.0:1789305054.510824:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765700224 00000100:00100000:3.0:1789305054.510904:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1229 00000100:00100000:3.0:1789305054.510916:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:59121:x1876219765700224:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789305054.510949:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305054.510975:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297e4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009a7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511060:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297e53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511078:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297e53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511124:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297e53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511146:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297e5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511154:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511161:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511619:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297e61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511631:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297e61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511638:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297e61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789305054.511665:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:3.0:1789305054.511670:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789305054.511697:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297e61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511711:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297e53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511719:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297e53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511733:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297e53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511740:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305054.511745:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297e53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511755:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297e53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511769:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789305054.511773:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305054.511779:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511786:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511798:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297e5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511805:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297e5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511811:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297e5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511816:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305054.511819:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297e5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511829:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297e5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511837:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789305054.511839:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305054.511842:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297e5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511848:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f400/0xefc0bb7231297e5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511882:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297e4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009a7 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511898:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297e61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009a7 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.511905:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:3.0:1789305054.511908:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789305054.511910:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789305054.511987:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:59121:x1876219765700224:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 1073us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305054.511996:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1229 00000100:00100000:2.0:1789305054.517249:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305054.517428:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765700480 00000100:00100000:3.0:1789305054.517443:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765700480 00000100:00100000:3.0:1789305054.517533:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1230 00000100:00100000:3.0:1789305054.517545:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:59121:x1876219765700480:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789305054.517576:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305054.517605:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297e68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009ae expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.518650:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.518676:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.519603:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.519631:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.519641:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.519648:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789305054.528838:0:30980:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27:0x0], index 0: 0 00010000:00010000:2.0:1789305054.529311:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297e7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529336:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529353:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297e7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529425:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529434:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529446:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529452:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305054.529458:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529468:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529482:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:2.0:1789305054.529486:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305054.529493:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529501:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789305054.529518:0:30980:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a582bcd4 reply state 00000000de64f903 transno 4294967767 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305054.529529:0:30980:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789305054.529581:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e800/0xefc0bb7231297e68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ae expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529602:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297e7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ae expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.529610:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789305054.529613:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789305054.529615:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecde00, rc 0) 00000100:00100000:2.0:1789305054.529733:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:59121:x1876219765700480:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 12188us (12499us total) trans 4294967767 rc 0/0 00000100:00100000:2.0:1789305054.529744:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1230 00000100:00100000:2.0:1789305054.540688:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:2.0:1789305054.540733:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.540752:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.540762:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.540768:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305054.540774:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.540784:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.540805:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c421d2800) 00010000:00010000:2.0:1789305054.540810:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305054.540816:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.540822:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297e76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305054.540876:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765700736 00000100:00100000:2.0:1789305054.540892:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765700736 00000100:00100000:2.0:1789305054.540958:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1231 00000100:00100000:2.0:1789305054.540970:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:59121:x1876219765700736:12345-192.168.202.29@tcp:36:touch.60003 00010000:00010000:2.0:1789305054.541051:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305054.541074:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecde00/0xefc0bb7231297e7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ae expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.541086:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9e2c421d2900) 00010000:00010000:2.0:1789305054.541118:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789305054.541177:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.541193:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.541205:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789305054.541399:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009b9cb83 reply state 00000000510a854d transno 4294967768 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305054.541411:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789305054.543757:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:59121:x1876219765700736:12345-192.168.202.29@tcp:36:touch.60003 Request processed in 2773us (3082us total) trans 4294967768 rc 0/0 00000100:00100000:2.0:1789305054.543773:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1231 00010000:00010000:1.0:1789305054.552620:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305054.554040:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305054.554164:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765700864 00000100:00100000:3.0:1789305054.554178:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765700864 00000100:00100000:3.0:1789305054.554247:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1232 00000100:00100000:3.0:1789305054.554259:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+10:59121:x1876219765700864:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:3.0:1789305054.554291:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305054.554319:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231297e92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009b5 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.554417:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231297e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009b5 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.554434:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231297e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009b5 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.554455:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:3.0:1789305054.554458:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789305054.554463:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fe00, rc 0) 00000100:00100000:3.0:1789305054.554528:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:59121:x1876219765700864:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 272us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305054.554536:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1232 00010000:00010000:2.0:1789305054.554854:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.554864:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.554876:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.554882:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305054.554888:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.554896:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.554909:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:2.0:1789305054.554912:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305054.554916:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.554922:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305054.557761:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305054.557854:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765700992 00000100:00100000:1.0:1789305054.557868:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765700992 00000100:00100000:1.0:1789305054.557962:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 673 00000100:00100000:1.0:1789305054.557974:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765700992:12345-192.168.202.29@tcp:2:touch.60003 00000100:00080000:3.0:1789305054.558206:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305054.558460:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765700992:12345-192.168.202.29@tcp:2:touch.60003 Request processed in 487us (710us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789305054.558469:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 673 00000100:00100000:0.0:1789305054.571897:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305054.572011:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765701248 00000100:00100000:1.0:1789305054.572028:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765701248 00000100:00100000:1.0:1789305054.572124:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 124 00000100:00100000:1.0:1789305054.572138:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:59121:x1876219765701248:12345-192.168.202.29@tcp:35:touch.60003 00000100:00100000:1.0:1789305054.572649:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+11:59121:x1876219765701248:12345-192.168.202.29@tcp:35:touch.60003 Request processed in 511us (767us total) trans 4294967769 rc 0/0 00000100:00100000:1.0:1789305054.572807:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 124 00000100:00100000:1.0:1789305054.686589:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305054.686739:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765701376 00000100:00100000:2.0:1789305054.686756:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765701376 00000100:00100000:2.0:1789305054.686842:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1233 00000100:00100000:2.0:1789305054.686855:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+11:59125:x1876219765701376:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:2.0:1789305054.686891:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305054.686926:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009bc expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687027:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297ea0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687047:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687064:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687082:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687302:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687314:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687464:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687473:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687481:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789305054.687526:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x65:0x0]: returning size 0 00000004:00200000:2.0:1789305054.687531:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789305054.687562:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687577:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687588:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687599:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297ea0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687607:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687614:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305054.687619:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687628:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297ea0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687642:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:2.0:1789305054.687645:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305054.687652:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297ea0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687659:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297ea0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687724:0:30980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687733:0:30980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687739:0:30980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687744:0:30980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305054.687749:0:30980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687756:0:30980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ea7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687764:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c421d2900) 00010000:00010000:2.0:1789305054.687766:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305054.687769:0:30980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ea7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687775:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ea7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687814:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297e99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009bc expref: 13 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687832:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009bc expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.687839:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:2.0:1789305054.687841:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789305054.687844:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc000, rc 0) 00000100:00100000:2.0:1789305054.687945:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+12:59125:x1876219765701376:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 1091us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305054.687953:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1233 00000100:00100000:2.0:1789305054.694398:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305054.695864:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765701504 00000100:00100000:0.0:1789305054.695888:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765701504 00000100:00100000:0.0:1789305054.696001:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 674 00000100:00100000:0.0:1789305054.696013:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765701504:12345-192.168.202.29@tcp:101:rm.60003 00010000:00010000:0.0:1789305054.696039:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305054.696069:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297eb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009c3 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789305054.696281:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x6aa6a0de, atime: 0x6aa6a0de, ctime: 0x6aa6a0de, blocks: 0x1 00010000:00010000:0.0:1789305054.696314:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=2504s v=(0 0) 00010000:00010000:0.0:1789305054.696320:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789305054.696332:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297eb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009c3 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305054.696371:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297eb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009c3 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305054.696389:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789305054.696488:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765701504:12345-192.168.202.29@tcp:101:rm.60003 Request processed in 477us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305054.696496:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 674 00000100:00100000:0.0:1789305054.720576:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305054.720802:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765701760 00000100:00100000:2.0:1789305054.720819:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765701760 00000100:00100000:2.0:1789305054.720902:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1234 00000100:00100000:2.0:1789305054.720918:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:59125:x1876219765701760:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:2.0:1789305054.721000:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789305054.721043:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc000/0xefc0bb7231297eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009bc expref: 12 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.721077:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fe00/0xefc0bb7231297e92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009b5 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.721227:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:2.0:1789305054.721242:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789305054.721274:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297ebc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.721293:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.721306:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.721323:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.721330:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.721337:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.721503:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297eca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.721516:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297eca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.721524:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297eca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789305054.724907:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].39, 64 off10688 00000004:00080000:2.0:1789305054.724932:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2504402840583ns, next at 2505402836339ns, rc = 0 00010000:00010000:2.0:1789305054.725050:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725072:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725215:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725230:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725238:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725244:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725279:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789305054.725319:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297eca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725326:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297eca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725334:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297eca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725341:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305054.725346:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297eca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725355:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297eca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725381:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9e2c421d2800) 00010000:00010000:2.0:1789305054.725385:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789305054.725393:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297eca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725400:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd600/0xefc0bb7231297eca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725427:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297ebc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725434:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297ebc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725439:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297ebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725445:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305054.725448:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297ebc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725459:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297ebc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725467:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:2.0:1789305054.725470:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305054.725474:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297ebc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.725480:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc200/0xefc0bb7231297ebc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789305054.725492:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff2c29e4 reply state 0000000077fcc11d transno 4294967770 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305054.725503:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789305054.725626:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:59125:x1876219765701760:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 4704us (5067us total) trans 4294967770 rc 0/0 00000100:00100000:2.0:1789305054.725637:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1234 00010000:00010000:3.0:1789305054.726348:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789305054.726368:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.726378:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305054.726381:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.726389:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.726402:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9e2c421d2800) 00010000:00010000:3.0:1789305054.726404:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789305054.726408:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.726414:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb7231297ed1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305054.726440:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305054.726442:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305054.726444:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305054.739537:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.739564:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.739574:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.739582:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305054.739589:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.739603:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.739626:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c421d2900) 00010000:00010000:2.0:1789305054.739631:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305054.739637:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305054.739644:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb7231297ec3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305054.998865:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785762560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305054.998930:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305054.999004:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785762560 00000100:00100000:1.0:1789305054.999011:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785762560 00000100:00100000:1.0:1789305054.999073:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1789305054.999081:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785762560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305054.999143:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305054.999186:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785762560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305054.999193:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00080000:1.0:1789305054.999211:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305054.999244:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785762560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305055.073918:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305055.073977:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305055.074071:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765701888 00000100:00100000:3.0:1789305055.074135:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765701888 00000100:00100000:1.0:1789305055.074154:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765702016 00000100:00100000:1.0:1789305055.074169:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765702016 00000100:00100000:3.0:1789305055.074214:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1391 00000100:00100000:3.0:1789305055.074232:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765701888:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305055.074272:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1398 00000100:00100000:1.0:1789305055.074289:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765702016:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305055.074338:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765701888:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 110us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305055.074348:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1391 00000100:00100000:1.0:1789305055.074386:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765702016:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 100us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305055.074399:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1398 00000100:00080000:2.0:1789305055.074623:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305055.506571:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785762944:0@lo:400:kworker.0 00000100:00100000:1.0:1789305055.506573:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785762816:0@lo:400:kworker.0 00000100:00100000:3.0:1789305055.506801:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785762688:0@lo:400:kworker.0 00000100:00100000:2.0:1789305055.506840:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305055.506869:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305055.506943:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785763200:0@lo:400:kworker.0 00000100:00100000:3.0:1789305055.506965:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305055.506968:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785762944 00000100:00100000:0.0:1789305055.506979:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785762944 00000100:00100000:3.0:1789305055.507009:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785762688 00000100:00100000:3.0:1789305055.507016:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785762688 00000100:00100000:3.0:1789305055.507072:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1789305055.507081:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1789305055.507082:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785762688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305055.507145:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785762944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305055.507160:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785762688:12345-0@lo:400:kworker.0 Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305055.507167:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:3.0:1789305055.507238:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785762688:0@lo:400:kworker.0 00000100:00100000:0.0:1789305055.508272:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785762944:12345-0@lo:400:kworker.0 Request processed in 1131us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305055.508284:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1789305055.508297:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789305055.508325:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305055.508384:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785763072:0@lo:400:kworker.0 00000100:00100000:1.0:1789305055.508423:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785763328:0@lo:400:kworker.0 00000100:00100000:0.0:1789305055.508458:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305055.508484:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305055.510663:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785762944:0@lo:400:kworker.0 00000100:00100000:0.0:1789305055.511028:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785763328 00000100:00100000:0.0:1789305055.511038:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785763328 00000100:00100000:0.0:1789305055.511111:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1789305055.511120:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785763328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305055.511193:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785763328:12345-0@lo:400:kworker.0 Request processed in 75us (2718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305055.511199:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1789305055.511252:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785763328:0@lo:400:kworker.0 00000100:00100000:3.0:1789305055.512696:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785763200 00000100:00100000:3.0:1789305055.512821:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785763200 00000100:00100000:3.0:1789305055.512920:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785762816 00000100:00100000:3.0:1789305055.512924:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785762816 00000100:00100000:3.0:1789305055.512950:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785763072 00000100:00100000:3.0:1789305055.512953:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785763072 00000100:00100000:3.0:1789305055.512975:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00100000:3.0:1789305055.512984:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785763200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305055.513123:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785763200:12345-0@lo:400:kworker.0 Request processed in 139us (6155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305055.513130:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00000100:00100000:3.0:1789305055.513150:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:3.0:1789305055.513155:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785762816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305055.513190:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785762816:12345-0@lo:400:kworker.0 Request processed in 35us (4898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305055.513195:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00100000:3.0:1789305055.513204:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:3.0:1789305055.513211:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785763072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305055.513244:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785763072:12345-0@lo:400:kworker.0 Request processed in 33us (4788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305055.513250:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00100000:3.0:1789305055.513321:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785763072:0@lo:400:kworker.0 00000100:00100000:3.0:1789305055.513386:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785763200:0@lo:400:kworker.0 00000100:00080000:0.0:1789305055.513580:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305055.513704:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785762816:0@lo:400:kworker.0 00010000:00010000:2.0:1789305055.572397:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305055.848846:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305055.849019:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765702144 00000100:00100000:0.0:1789305055.849035:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765702144 00000100:00100000:0.0:1789305055.849150:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1235 00000100:00100000:0.0:1789305055.849164:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+11:59140:x1876219765702144:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1789305055.849198:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305055.849227:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ed8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009ca expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.849314:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297edf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.849333:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.849358:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789305055.849409:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:0.0:1789305055.849414:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789305055.849439:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.849476:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ed8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ca expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.849496:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297edf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ca expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.849505:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:0.0:1789305055.849508:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789305055.849513:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb400, rc 0) 00000100:00100000:0.0:1789305055.849590:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+12:59140:x1876219765702144:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 428us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305055.849598:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1235 00000100:00100000:3.0:1789305055.856978:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305055.857139:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765702400 00000100:00100000:0.0:1789305055.857159:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765702400 00000100:00100000:0.0:1789305055.857249:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1236 00000100:00100000:0.0:1789305055.857263:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+12:59140:x1876219765702400:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789305055.857342:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789305055.857393:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb400/0xefc0bb7231297edf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ca expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.857423:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e400/0xefc0bb7231297e61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009a7 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.857436:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19200) 00010000:00010000:0.0:1789305055.857449:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789305055.857486:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.857502:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.857514:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789305055.941716:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967771 is committed 00000004:00080000:0.0:1789305055.941831:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 102 committed 00000100:00100000:0.0:1789305055.945362:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785763456:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789305055.945477:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1789305055.946063:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000022c81b2 reply state 0000000033d94ea9 transno 4294967771 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305055.946080:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789305055.946122:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00080000:0.0:1789305055.946242:0:5852:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789305055.946266:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:59140:x1876219765702400:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 89002us (89297us total) trans 4294967771 rc 0/0 00000100:00100000:0.0:1789305055.946276:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1236 00010000:00010000:0.0:1789305055.946321:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.946331:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.946339:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.946355:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:0.0:1789305055.946362:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.946372:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.946391:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558d700) 00010000:00010000:0.0:1789305055.946394:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789305055.946407:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.946421:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb7231297ee6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305055.946467:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785763456 00000100:00100000:3.0:1789305055.946485:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785763456 00000100:00100000:3.0:1789305055.946575:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1789305055.946589:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785763456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789305055.946630:0:17212:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:39 count 1 00010000:00010000:3.0:1789305055.946734:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305055.946763:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297eb5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009c3 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305055.946774:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789305055.946779:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789305055.946783:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 4/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305055.946825:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297eb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009c3 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305055.946841:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297eb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009c3 expref: 6 pid: 6692 timeout: 2605 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305055.946933:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785763584:192.168.202.29@tcp:104: 00000100:00100000:3.0:1789305055.947030:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13d74780 going to sleep for 11 seconds 00000100:00100000:0.0:1789305055.970412:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:17212:1876219785763584:192.168.202.29@tcp:104: 00010000:00010000:0.0:1789305055.970468:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305055.973545:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305055.974959:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765702528 00000100:00100000:2.0:1789305055.974977:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765702528 00010000:00010000:2.0:1789305055.975055:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297eb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009c3 expref: 7 pid: 6692 timeout: 2605 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305055.975123:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 457 00000100:00100000:2.0:1789305055.975135:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2354:x1876219765702528:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789305055.975166:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305055.975173:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297eb5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009c3 expref: 7 pid: 6692 timeout: 2605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305055.975197:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297eb5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009c3 expref: 7 pid: 6692 timeout: 2605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305055.975228:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168c40ef/0xefc0bb7231297eb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009c3 expref: 7 pid: 6692 timeout: 2605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305055.975248:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789305055.975253:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789305055.975260:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305055.975272:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305055.975312:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789305055.975387:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.975399:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305055.975409:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765702528:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 277us (1881us total) trans 0 rc 0/0 00010000:00010000:0.0:1789305055.975412:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.975422:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.975454:0:17212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789305055.976067:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 457 00000100:00100000:0.0:1789305055.976375:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876219785763456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29788us (30896us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789305055.976385:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00010000:00010000:0.0:1789305055.976414:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305055.976423:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.976435:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305055.976440:0:8464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.976452:0:8464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.976470:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.976478:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f301e24f/0xefc0bb7231297eed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305055.976501:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305055.976503:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305055.976506:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789305055.976962:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2b02d82300/2, rc 0, transno 4294967375 00000100:00100000:2.0:1789305055.976972:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785763456:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789305056.018492:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785763712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305056.018601:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305056.018692:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785763712 00000100:00100000:1.0:1789305056.018779:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785763712 00000100:00100000:1.0:1789305056.018862:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1789305056.018874:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785763712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305056.018925:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305056.018997:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785763712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305056.019004:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1789305056.019153:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785763712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305056.038038:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305056.038255:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765702656 00000100:00100000:2.0:1789305056.038269:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765702656 00000100:00100000:2.0:1789305056.038433:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1237 00000100:00100000:2.0:1789305056.038446:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:59144:x1876219765702656:12345-192.168.202.29@tcp:101:touch.60003 00010000:00010000:2.0:1789305056.038483:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305056.038511:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231297ef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009d1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.038596:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297efb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.038616:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.038631:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.038648:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.038655:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.038661:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.040397:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.040600:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.040617:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789305056.040661:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:2.0:1789305056.040666:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789305056.040694:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.040710:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.040718:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297efb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.040726:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297efb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.040733:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305056.040738:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297efb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041276:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297efb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041293:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:2.0:1789305056.041296:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305056.041302:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297efb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041310:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297efb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041330:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041342:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041359:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041365:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305056.041368:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041375:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041382:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c421d2900) 00010000:00010000:2.0:1789305056.041384:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305056.041388:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041400:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041706:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd000/0xefc0bb7231297ef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009d1 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041726:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009d1 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305056.041734:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:2.0:1789305056.041737:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789305056.041815:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40eccc00, rc 0) 00000100:00080000:0.0:1789305056.043576:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305056.044034:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:59144:x1876219765702656:12345-192.168.202.29@tcp:101:touch.60003 Request processed in 5577us (5997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305056.044049:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1237 00010000:00010000:2.0:1789305056.596621:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789305057.170152:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00000001:00080000:2.0:1789305057.170185:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00000100:00100000:0.0:1789305057.180442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305057.180759:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765702784 00000100:00100000:3.0:1789305057.180772:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765702784 00000100:00100000:3.0:1789305057.181011:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1238 00000100:00100000:3.0:1789305057.181025:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:59158:x1876219765702784:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:3.0:1789305057.181064:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305057.181112:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009d8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.181209:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.181228:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.181242:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789305057.181290:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:3.0:1789305057.181295:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789305057.181319:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.181362:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009d8 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.181382:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009d8 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.181392:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:3.0:1789305057.181395:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789305057.181400:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f800, rc 0) 00000100:00100000:3.0:1789305057.181488:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:59158:x1876219765702784:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 466us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305057.181497:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1238 00000100:00100000:2.0:1789305057.187130:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305057.187237:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765703040 00000100:00100000:0.0:1789305057.187252:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765703040 00000100:00100000:0.0:1789305057.187349:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1239 00000100:00100000:0.0:1789305057.187363:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:59158:x1876219765703040:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:0.0:1789305057.187437:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789305057.187476:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f800/0xefc0bb7231297f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009d8 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305057.187502:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40eccc00/0xefc0bb7231297f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009d1 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305057.187518:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c421d2000) 00010000:00010000:0.0:1789305057.187532:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789305057.187569:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305057.187585:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305057.187596:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789305057.188184:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dac08237 reply state 00000000de437947 transno 4294967772 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305057.188199:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789305057.188210:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000100:00100000:0.0:1789305057.188321:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:59158:x1876219765703040:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 959us (1235us total) trans 4294967772 rc 0/0 00000100:00100000:0.0:1789305057.188331:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1239 00010000:00010000:1.0:1789305057.197454:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.197481:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.197491:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.197499:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305057.197505:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.197514:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.197536:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c0558de00) 00010000:00010000:1.0:1789305057.197539:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789305057.197546:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.197553:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa800/0xefc0bb7231297f1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305057.400721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305057.400831:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765703168 00000100:00100000:3.0:1789305057.400851:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765703168 00000100:00100000:3.0:1789305057.400936:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1240 00000100:00100000:3.0:1789305057.400952:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:59170:x1876219765703168:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789305057.401074:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:59170:x1876219765703168:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 125us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305057.401082:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1240 00000100:00100000:0.0:1789305057.403459:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305057.403693:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765703296 00000100:00100000:1.0:1789305057.403710:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765703296 00000100:00100000:1.0:1789305057.403825:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 676 00000100:00100000:1.0:1789305057.403838:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:59170:x1876219765703296:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789305057.404620:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:59170:x1876219765703296:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 781us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305057.404632:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 676 00000100:00080000:0.0:1789305057.404899:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305057.407396:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305057.407850:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765703424 00000100:00100000:3.0:1789305057.407865:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765703424 00000100:00100000:3.0:1789305057.407970:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 677 00000100:00100000:3.0:1789305057.407983:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:59170:x1876219765703424:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00080000:0.0:1789305057.408087:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305057.409682:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:59170:x1876219765703424:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1687us (2283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305057.409698:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 677 00000100:00100000:2.0:1789305057.415565:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305057.415688:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765703552 00000100:00100000:3.0:1789305057.415709:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765703552 00000100:00100000:3.0:1789305057.415877:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1241 00000100:00100000:3.0:1789305057.415892:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:59170:x1876219765703552:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789305057.416582:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:59170:x1876219765703552:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 690us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305057.416592:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1241 00000100:00100000:0.0:1789305057.422273:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305057.422403:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765703680 00000100:00100000:2.0:1789305057.422760:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765703680 00000100:00100000:2.0:1789305057.422921:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1242 00000100:00100000:2.0:1789305057.422934:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:59170:x1876219765703680:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789305057.423058:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:59170:x1876219765703680:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 127us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305057.423066:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1242 00000100:00100000:1.0:1789305057.425371:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305057.428691:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765703808 00000100:00100000:2.0:1789305057.428709:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765703808 00000100:00100000:2.0:1789305057.428797:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 678 00000100:00100000:2.0:1789305057.428811:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:59170:x1876219765703808:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:2.0:1789305057.429246:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:59170:x1876219765703808:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 438us (3890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305057.429256:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 678 00000100:00100000:1.0:1789305057.431667:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305057.431824:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765703936 00000100:00100000:0.0:1789305057.431839:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765703936 00000100:00100000:0.0:1789305057.431918:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 679 00000100:00100000:0.0:1789305057.431930:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:59170:x1876219765703936:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789305057.432667:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:59170:x1876219765703936:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 735us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305057.432677:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 679 00000100:00100000:0.0:1789305057.435231:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305057.435373:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765704064 00000100:00100000:2.0:1789305057.435543:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765704064 00000100:00100000:2.0:1789305057.435658:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1243 00000100:00100000:2.0:1789305057.435671:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:59170:x1876219765704064:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789305057.436264:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:59170:x1876219765704064:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 594us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305057.436277:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1243 00000100:00100000:1.0:1789305057.518968:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305057.519269:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765704192 00000100:00100000:3.0:1789305057.519285:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765704192 00000100:00100000:3.0:1789305057.519495:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1244 00000100:00100000:3.0:1789305057.519509:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:59174:x1876219765704192:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:3.0:1789305057.519536:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305057.519567:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009df expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.519665:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.519686:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.519702:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.519721:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.519729:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.519736:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520393:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297f3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520405:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520415:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789305057.520444:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:3.0:1789305057.520449:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789305057.520477:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520491:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520499:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f2c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520506:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520513:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305057.520518:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520527:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520542:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789305057.520546:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305057.520553:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520560:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520577:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520582:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520587:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520592:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305057.520595:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520601:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520607:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789305057.520610:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305057.520612:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520622:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520662:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009df expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520678:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297f3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009df expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305057.520685:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789305057.520688:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789305057.520691:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f000, rc 0) 00000100:00100000:3.0:1789305057.520796:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:59174:x1876219765704192:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 1289us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305057.521444:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1244 00000100:00100000:1.0:1789305057.526475:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305057.528055:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765704448 00000100:00100000:2.0:1789305057.528077:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765704448 00000100:00100000:2.0:1789305057.528456:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1245 00000100:00100000:2.0:1789305057.528470:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:59174:x1876219765704448:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:2.0:1789305057.528500:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305057.528531:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297f41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009e6 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.529223:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231297f48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.529244:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231297f48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.529260:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231297f48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.529278:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.529285:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.529292:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789305057.532027:0:7654:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27:0x0], index 1: 0 00010000:00010000:2.0:1789305057.532657:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.532685:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.532699:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.532771:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231297f48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.532779:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231297f48 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.532786:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231297f48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.532793:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:2.0:1789305057.532797:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231297f48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.532805:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231297f48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.532816:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:2.0:1789305057.532820:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789305057.532825:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231297f48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.532833:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecda00/0xefc0bb7231297f48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789305057.532853:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000836edd79 reply state 0000000091d1881f transno 4294967773 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305057.532864:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789305057.533769:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc600/0xefc0bb7231297f41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009e6 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.533796:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009e6 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305057.533804:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff9e2c421d2300) 00010000:00010000:2.0:1789305057.533807:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789305057.533811:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc800, rc 0) 00000100:00100000:2.0:1789305057.534132:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+11:59174:x1876219765704448:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 5663us (7671us total) trans 4294967773 rc 0/0 00000100:00100000:2.0:1789305057.534143:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1245 00010000:00010000:1.0:1789305057.540589:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.540616:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.540625:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.540632:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd400 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305057.540639:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.540653:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.540677:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c421d2e00) 00010000:00010000:1.0:1789305057.540680:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789305057.540687:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305057.540693:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd400/0xefc0bb7231297f4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305057.544348:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305057.545244:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765704576 00000100:00100000:0.0:1789305057.545266:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765704576 00000100:00100000:0.0:1789305057.545439:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 680 00000100:00100000:0.0:1789305057.545455:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:59174:x1876219765704576:12345-192.168.202.29@tcp:101:dd.60003 00010000:00010000:0.0:1789305057.545484:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305057.545516:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231297f64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009ed expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789305057.545560:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789305057.545596:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=2507s v=(0 0) 00010000:00010000:0.0:1789305057.545601:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789305057.545616:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231297f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ed expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305057.545643:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231297f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ed expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305057.545659:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afaa00, rc 0) 00000100:00100000:0.0:1789305057.545967:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:59174:x1876219765704576:12345-192.168.202.29@tcp:101:dd.60003 Request processed in 515us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305057.545976:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 680 00000100:00100000:0.0:1789305057.577086:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305057.577261:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765704704 00000100:00100000:2.0:1789305057.577277:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765704704 00002000:00100000:2.0:1789305057.577563:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x27:0x0] (0->1048575) req@ffff9e2b02d80700 x1876219765704704/t0(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:368/0 lens 488/0 e 0 to 0 dl 1789305068 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789305057.577578:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b02d80700 with x1876219765704704 ext(0->1048575) 00002000:00010000:2.0:1789305057.577586:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b02d80700 00000100:00100000:2.0:1789305057.577739:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 31 00000100:00100000:2.0:1789305057.577753:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765704704:12345-192.168.202.29@tcp:4:dd.60003 00000100:00100000:2.0:1789305057.613959:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2354:x1876219765704704:12345-192.168.202.29@tcp:4:dd.60003 Request processed in 36189us (36870us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789305057.613981:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 31 00002000:00100000:2.0:1789305057.614001:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x27:0x0] (0->1048575) req@ffff9e2b02d80700 x1876219765704704/t4294967374(0) o4->99087288-e673-4cc7-b2df-ca113c20dacd@192.168.202.29@tcp:368/0 lens 488/448 e 0 to 0 dl 1789305068 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789305057.614014:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9e2b02d80700 with x1876219765704704 ext(0->1048575) 00002000:00010000:2.0:1789305057.614021:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9e2b02d80700 00010000:00010000:2.0:1789305057.618816:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305057.618924:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305057.619013:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765704832 00000100:00100000:2.0:1789305057.619027:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765704832 00000100:00100000:2.0:1789305057.619149:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1246 00000100:00100000:2.0:1789305057.619161:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+10:59174:x1876219765704832:12345-192.168.202.29@tcp:44:dd.60003 00000001:00080000:1.0:1789305057.662131:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967772 is committed 00000001:00080000:1.0:1789305057.662163:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967773 is committed 00000100:00100000:0.0:1789305057.662415:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:59174:x1876219765704832:12345-192.168.202.29@tcp:44:dd.60003 Request processed in 43247us (43489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305057.662429:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1246 00000100:00100000:0.0:1789305057.665610:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305057.665893:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765704960 00000100:00100000:3.0:1789305057.665911:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765704960 00000100:00100000:3.0:1789305057.666027:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 681 00000100:00100000:3.0:1789305057.666041:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765704960:12345-192.168.202.29@tcp:16:dd.60003 00000100:00100000:0.0:1789305057.706673:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:2356:x1876219765704960:12345-192.168.202.29@tcp:16:dd.60003 Request processed in 40617us (41063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305057.706693:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 681 00000001:00080000:1.0:1789305057.708080:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967374 is committed 00000100:00100000:1.0:1789305057.711829:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305057.711957:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765705216 00000100:00100000:0.0:1789305057.711971:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765705216 00000100:00100000:0.0:1789305057.712048:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 125 00000100:00100000:0.0:1789305057.712062:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:59174:x1876219765705216:12345-192.168.202.29@tcp:35:dd.60003 00000100:00100000:0.0:1789305057.712740:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:59174:x1876219765705216:12345-192.168.202.29@tcp:35:dd.60003 Request processed in 677us (921us total) trans 4294967774 rc 0/0 00000100:00100000:0.0:1789305057.712751:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 125 00010000:00010000:0.0:1789305058.642364:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789305058.970525:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967774 is committed 00010000:00010000:2.0:1789305059.667333:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305060.115728:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789305060.115759:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785763840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305060.115849:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305060.115942:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785763840 00000100:00100000:1.0:1789305060.115952:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785763840 00000100:00100000:1.0:1789305060.116025:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1789305060.116036:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785763840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305060.116079:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789305060.116152:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785763840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305060.116160:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00080000:1.0:1789305060.116183:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305060.116225:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785763840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305060.194516:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305060.195566:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765705344 00000100:00100000:1.0:1789305060.195587:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765705344 00000100:00100000:1.0:1789305060.195678:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1393 00000100:00100000:1.0:1789305060.195690:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765705344:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305060.195803:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765705344:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 115us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305060.195812:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1393 00000100:00100000:1.0:1789305060.201714:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305060.201761:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305060.201803:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305060.201971:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765705728 00000100:00100000:2.0:1789305060.201986:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765705728 00000100:00100000:2.0:1789305060.202081:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765705600 00000100:00100000:2.0:1789305060.202085:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765705600 00000100:00100000:2.0:1789305060.202144:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1401 00000100:00100000:2.0:1789305060.202157:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765705728:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305060.202261:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2355:x1876219765705728:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 107us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305060.202270:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1401 00000100:00100000:2.0:1789305060.202289:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1402 00000100:00100000:2.0:1789305060.202296:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765705600:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305060.202336:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765705600:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305060.202344:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1402 00000100:00080000:1.0:1789305060.202882:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789305060.202888:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789305060.203553:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765705472 00000100:00100000:0.0:1789305060.203567:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765705472 00000100:00100000:0.0:1789305060.203684:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1806 00000100:00100000:0.0:1789305060.203696:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765705472:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305060.203782:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:2355:x1876219765705472:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 90us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305060.203790:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1806 00000100:00080000:1.0:1789305060.205891:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789305060.324744:0:100840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2510002649121ns, next at 2505402836339ns, rc = 0 00000004:00080000:2.0:1789305060.324958:0:100840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2510002866521ns, next at 2487355408764ns, rc = 0 00000004:00080000:1.0:1789305060.327065:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 110 committed 00000004:00080000:1.0:1789305060.327114:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 103 committed 00000100:00100000:1.0:1789305060.628676:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785764096:0@lo:400:kworker.0 00000100:00100000:0.0:1789305060.628681:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785764224:0@lo:400:kworker.0 00000100:00100000:2.0:1789305060.628773:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785763968:0@lo:400:kworker.0 00000100:00100000:3.0:1789305060.628823:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785764352:0@lo:400:kworker.0 00000100:00100000:0.0:1789305060.635799:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305060.635911:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789305060.635928:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785764608:0@lo:400:kworker.0 00000100:00100000:0.0:1789305060.635966:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305060.636019:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785764224 00000100:00100000:0.0:1789305060.636030:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785764224 00000100:00100000:0.0:1789305060.636127:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785764608 00000100:00100000:0.0:1789305060.636131:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785764608 00000100:00100000:0.0:1789305060.638525:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1789305060.638560:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785764224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305060.638689:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785764224:12345-0@lo:400:kworker.0 Request processed in 146us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305060.638698:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1789305060.638739:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1789305060.638747:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785764608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305060.638783:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785764608:12345-0@lo:400:kworker.0 Request processed in 38us (2816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305060.638789:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00080000:0.0:1789305060.638824:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305060.638906:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785764608:0@lo:400:kworker.0 00000100:00100000:0.0:1789305060.638921:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:0.0:1789305060.638927:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2b02d82300, transno 4294967375 00000100:00100000:0.0:1789305060.638944:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785764224:0@lo:400:kworker.0 00000100:00100000:1.0:1789305060.639334:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305060.639486:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785764096 00000100:00100000:1.0:1789305060.639494:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785764096 00000100:00100000:1.0:1789305060.639541:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:1.0:1789305060.639548:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785764096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305060.639591:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785764096:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305060.639597:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:1.0:1789305060.639717:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785764096:0@lo:400:kworker.0 00000100:00100000:2.0:1789305060.640237:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305060.640287:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785764480:0@lo:400:kworker.0 00000100:00100000:2.0:1789305060.640335:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305060.641197:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785763968 00000100:00100000:2.0:1789305060.641210:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785763968 00000100:00100000:2.0:1789305060.641265:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1789305060.641273:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785763968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305060.641493:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305060.643545:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785763968:12345-0@lo:400:kworker.0 Request processed in 2261us (3298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305060.643562:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1789305060.643958:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785763968:0@lo:400:kworker.0 00000100:00100000:0.0:1789305060.645603:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785764480 00000100:00100000:0.0:1789305060.645620:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785764480 00000100:00100000:0.0:1789305060.645701:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785764352 00000100:00100000:0.0:1789305060.645705:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785764352 00000100:00080000:2.0:1789305060.645709:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305060.645739:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:0.0:1789305060.645750:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785764480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305060.645829:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:2.0:1789305060.645839:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785764352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305060.645858:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785764480:12345-0@lo:400:kworker.0 Request processed in 110us (5522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305060.645866:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00100000:2.0:1789305060.645880:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785764352:12345-0@lo:400:kworker.0 Request processed in 44us (4387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305060.645886:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00100000:0.0:1789305060.645924:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785764480:0@lo:400:kworker.0 00000100:00100000:3.0:1789305060.646366:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785764352:0@lo:400:kworker.0 00010000:00010000:2.0:1789305060.691398:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305061.141168:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305061.141201:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785764736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305061.141323:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305061.141553:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785764736 00000100:00100000:0.0:1789305061.141564:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785764736 00000100:00100000:0.0:1789305061.141630:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1789305061.141648:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785764736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305061.141695:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305061.141760:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785764736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305061.141877:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785764736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305061.141948:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1789305061.697641:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305061.697789:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765705856 00000100:00100000:2.0:1789305061.697804:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765705856 00000100:00100000:2.0:1789305061.697900:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1247 00000100:00100000:2.0:1789305061.697914:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:59367:x1876219765705856:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:2.0:1789305061.698060:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+8:59367:x1876219765705856:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 148us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305061.698069:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1247 00000100:00100000:2.0:1789305061.703862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305061.704011:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765705984 00000100:00100000:3.0:1789305061.704027:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765705984 00000100:00100000:3.0:1789305061.704148:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 682 00000100:00100000:3.0:1789305061.704161:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:59367:x1876219765705984:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789305061.705664:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:59367:x1876219765705984:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1497us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305061.705678:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 682 00000100:00100000:3.0:1789305061.709524:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305061.710072:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765706112 00000100:00100000:0.0:1789305061.710108:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765706112 00000100:00100000:0.0:1789305061.710187:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 683 00000100:00100000:0.0:1789305061.710201:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:59367:x1876219765706112:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789305061.710975:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:59367:x1876219765706112:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 773us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305061.710985:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 683 00000100:00100000:2.0:1789305061.720060:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305061.720193:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765706240 00000100:00100000:1.0:1789305061.720208:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765706240 00000100:00100000:1.0:1789305061.720283:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1248 00000100:00100000:1.0:1789305061.720318:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:59367:x1876219765706240:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789305061.720811:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+8:59367:x1876219765706240:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 517us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305061.720822:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1248 00010000:00010000:0.0:1789305061.723083:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305061.731560:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305061.739498:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765706368 00000100:00100000:3.0:1789305061.739520:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765706368 00000100:00100000:3.0:1789305061.739611:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1249 00000100:00100000:3.0:1789305061.739623:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:59367:x1876219765706368:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789305061.739771:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:59367:x1876219765706368:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 150us (8226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305061.739779:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1249 00000100:00100000:1.0:1789305061.749611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305061.749669:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765706496 00000100:00100000:1.0:1789305061.749683:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765706496 00000100:00100000:1.0:1789305061.749752:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 684 00000100:00100000:1.0:1789305061.749763:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:59367:x1876219765706496:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789305061.751864:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:59367:x1876219765706496:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 2092us (2259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305061.755495:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 684 00000100:00100000:2.0:1789305061.756403:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305061.756996:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765706624 00000100:00100000:1.0:1789305061.757012:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765706624 00000100:00100000:1.0:1789305061.757115:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 685 00000100:00100000:1.0:1789305061.757128:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:59367:x1876219765706624:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789305061.758672:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+6:59367:x1876219765706624:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 1537us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305061.758686:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 685 00000100:00100000:1.0:1789305061.768963:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305061.769144:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765706752 00000100:00100000:0.0:1789305061.769158:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765706752 00000100:00100000:0.0:1789305061.769227:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1250 00000100:00100000:0.0:1789305061.769238:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:59367:x1876219765706752:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:0.0:1789305061.769802:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:59367:x1876219765706752:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 563us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305061.769811:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1250 00000100:00100000:2.0:1789305061.878802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305061.878981:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765707008 00000100:00100000:3.0:1789305061.878999:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765707008 00000100:00100000:3.0:1789305061.879247:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1251 00000100:00100000:3.0:1789305061.879263:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+8:59371:x1876219765707008:12345-192.168.202.29@tcp:36:rm.60003 00010000:00010000:3.0:1789305061.879372:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305061.879411:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc800/0xefc0bb7231297f56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009e6 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.879443:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff9e2c421d2300) 00010000:00010000:3.0:1789305061.879457:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789305061.879490:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.879508:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.879521:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.879539:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.879547:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.879554:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.880279:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.880303:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.880313:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789305061.881713:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].39, 64 off10688 00000004:00080000:3.0:1789305061.881731:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2511559639906ns, next at 2512559636111ns, rc = 0 00010000:00010000:3.0:1789305061.881858:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882043:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882059:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882071:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882079:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882112:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882515:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789305061.882562:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882570:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882577:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882583:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305061.882589:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882598:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882615:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:3.0:1789305061.882618:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789305061.882624:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882630:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297f79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882657:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882663:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f6b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882668:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882674:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305061.882676:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882682:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882688:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789305061.882690:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305061.882693:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305061.882698:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789305061.882713:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006555b6f6 reply state 000000006092a63a transno 4294967775 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305061.882724:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789305061.882857:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:59371:x1876219765707008:12345-192.168.202.29@tcp:36:rm.60003 Request processed in 3594us (4066us total) trans 4294967775 rc 0/0 00000100:00100000:3.0:1789305061.882868:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1251 00010000:00010000:1.0:1789305061.887240:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305061.887264:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305061.887274:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305061.887282:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:1.0:1789305061.887289:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305061.887309:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305061.887332:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff9e2c2ea19800) 00010000:00010000:1.0:1789305061.887336:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789305061.887344:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305061.887358:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e200/0xefc0bb7231297f72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305061.888339:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305061.888361:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305061.888371:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305061.888375:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305061.888385:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305061.888402:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff9e2c2ea19e00) 00010000:00010000:2.0:1789305061.888405:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789305061.888410:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305061.888416:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f600/0xefc0bb7231297f80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305061.889777:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305061.889785:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305061.889788:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305062.740408:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305063.762574:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789305064.042377:0:100985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2513720281493ns, next at 2505402836339ns, rc = 0 00000004:00080000:2.0:1789305064.042569:0:100985:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2513720477806ns, next at 2512559636111ns, rc = 0 00000004:00080000:1.0:1789305064.110257:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 112 committed 00000004:00080000:1.0:1789305064.110292:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 104 committed 00000001:00080000:1.0:1789305064.110312:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967775 is committed 00000004:00080000:1.0:1789305064.110584:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 111 committed 00000100:00100000:3.0:1789305064.110850:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785764864:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789305064.110967:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305064.111309:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785764864 00000100:00100000:1.0:1789305064.111331:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785764864 00000100:00080000:2.0:1789305064.111528:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305064.111633:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1789305064.111649:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785764864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789305064.111939:0:17212:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:39 count 1 00010000:00010000:1.0:1789305064.111991:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305064.112027:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231297f64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ed expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305064.112040:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x27:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1789305064.112046:0:17212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789305064.112052:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305064.113678:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231297f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ed expref: 5 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305064.113703:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231297f64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ed expref: 5 pid: 6691 timeout: 2613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305064.113724:0:17212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17212:1876219785764992:192.168.202.29@tcp:104: 00000100:00100000:1.0:1789305064.113843:0:17212:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789305064.117236:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305064.117446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765707136 00000100:00100000:3.0:1789305064.117460:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765707136 00010000:00010000:3.0:1789305064.117538:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231297f64 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ed expref: 6 pid: 6691 timeout: 2613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305064.117589:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 458 00000100:00100000:3.0:1789305064.117602:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765707136:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789305064.117621:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305064.117628:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231297f64 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ed expref: 6 pid: 6691 timeout: 2613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305064.117645:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231297f64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ed expref: 6 pid: 6691 timeout: 2613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305064.117678:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789305064.117684:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789305064.117691:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305064.117704:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305064.117732:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305064.117798:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:2354:x1876219765707136:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 198us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305064.117806:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 458 00010000:00010000:2.0:1789305064.118033:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c02497b5/0xefc0bb7231297f64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009ed expref: 5 pid: 6691 timeout: 2613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305064.118053:0:17212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:17212:1876219785764992:192.168.202.29@tcp:104: 00010000:00010000:2.0:1789305064.118083:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305064.118217:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305064.118224:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305064.118236:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305064.118245:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305064.118264:0:17212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1789305064.119908:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305064.120060:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785764864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8410us (9088us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789305064.120075:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000004:00080000:3.0:1789305064.120386:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e2c03618a80/2, rc 0, transno 4294967375 00000100:00100000:3.0:1789305064.120412:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785764864:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789305064.120896:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305064.120910:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305064.120932:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305064.120938:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305064.120952:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305064.121969:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305064.121986:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce78f918/0xefc0bb7231297f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305064.122014:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305064.122017:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305064.122019:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305064.787663:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305065.235537:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789305065.235567:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785765120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305065.235662:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305065.235741:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785765120 00000100:00100000:1.0:1789305065.237014:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785765120 00000100:00100000:1.0:1789305065.237132:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1789305065.237146:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785765120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305065.237199:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789305065.237306:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876219785765120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305065.237314:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1789305065.237382:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785765120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305065.319495:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305065.319545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305065.319580:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305065.319633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305065.319667:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765707392 00000100:00100000:1.0:1789305065.319679:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765707392 00000100:00100000:1.0:1789305065.319772:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1810 00000100:00100000:1.0:1789305065.319785:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765707392:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305065.319906:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765707392:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 123us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305065.319915:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1810 00000100:00100000:1.0:1789305065.319945:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765707520 00000100:00100000:1.0:1789305065.319950:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765707520 00000100:00100000:0.0:1789305065.319966:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765707264 00000100:00100000:0.0:1789305065.319970:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765707264 00000100:00100000:1.0:1789305065.319978:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765707648 00000100:00100000:1.0:1789305065.319981:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765707648 00000100:00100000:1.0:1789305065.319999:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1405 00000100:00100000:0.0:1789305065.320000:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1395 00000100:00100000:1.0:1789305065.320006:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765707520:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305065.320006:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765707264:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305065.320035:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765707520:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305065.320042:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1405 00000100:00100000:1.0:1789305065.320054:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1406 00000100:00100000:1.0:1789305065.320060:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765707648:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:2.0:1789305065.320135:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789305065.320142:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305065.328427:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765707264:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 8399us (8924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305065.328449:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1395 00000100:00100000:1.0:1789305065.330348:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765707648:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 10268us (10695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305065.330369:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1406 00000100:00100000:2.0:1789305065.751336:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785765632:0@lo:400:kworker.0 00000100:00100000:2.0:1789305065.751455:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305065.751557:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789305065.751720:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785765376:0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.751757:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305065.751781:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785765888:0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.751814:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305065.751837:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789305065.751844:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785765248:0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.751883:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305065.751910:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785765760:0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.751937:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305065.751970:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785765888 00000100:00100000:0.0:1789305065.751982:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785765888 00000100:00100000:0.0:1789305065.752051:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1789305065.752063:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785765888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.752152:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1876219785765888:12345-0@lo:400:kworker.0 Request processed in 90us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305065.752162:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1789305065.752191:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785765248 00000100:00100000:0.0:1789305065.752195:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785765248 00000100:00100000:0.0:1789305065.752227:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1789305065.752234:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785765248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.752277:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785765248:12345-0@lo:400:kworker.0 Request processed in 43us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305065.752284:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1789305065.752358:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785765248:0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.752372:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785765888:0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.752430:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785765632 00000100:00100000:0.0:1789305065.752434:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785765632 00000100:00100000:0.0:1789305065.752476:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785765376 00000100:00100000:0.0:1789305065.752479:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785765376 00000100:00100000:0.0:1789305065.752496:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785765760 00000100:00100000:0.0:1789305065.752498:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785765760 00000100:00100000:0.0:1789305065.752517:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:0.0:1789305065.752523:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785765632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.752558:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785765632:12345-0@lo:400:kworker.0 Request processed in 36us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305065.752703:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000100:00100000:0.0:1789305065.752718:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1789305065.752724:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785765376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.752759:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785765376:12345-0@lo:400:kworker.0 Request processed in 36us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305065.752765:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1789305065.752777:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:0.0:1789305065.752782:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785765760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.752810:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785765760:12345-0@lo:400:kworker.0 Request processed in 27us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305065.752815:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00080000:0.0:1789305065.752835:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305065.752857:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785765760:0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.752867:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785765376:0@lo:400:kworker.0 00000100:00100000:2.0:1789305065.752998:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785765504:0@lo:400:kworker.0 00000100:00100000:2.0:1789305065.753036:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305065.753077:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785765632:0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.753267:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785765504 00000100:00100000:0.0:1789305065.753274:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785765504 00000100:00100000:0.0:1789305065.753418:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1789305065.753425:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785765504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305065.753465:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785765504:12345-0@lo:400:kworker.0 Request processed in 41us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305065.753472:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00080000:2.0:1789305065.753757:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789305065.753781:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785765504:0@lo:400:kworker.0 00010000:00010000:0.0:1789305065.811667:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305066.259038:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785766016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305066.259147:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305066.259290:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785766016 00000100:00100000:2.0:1789305066.259314:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785766016 00000100:00100000:2.0:1789305066.259381:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1789305066.259394:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785766016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789305066.259441:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305066.260519:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785766016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1114us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305066.260531:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1789305066.260664:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785766016:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789305066.836497:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967375 is committed 00010000:00010000:2.0:1789305066.848578:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305067.866443:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305068.882305:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305069.913193:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305070.354572:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789305070.354601:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785766144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789305070.354690:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305070.354898:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785766144 00000100:00100000:0.0:1789305070.354907:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785766144 00000100:00100000:0.0:1789305070.354974:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1789305070.354995:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785766144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789305070.355030:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305070.355083:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785766144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305070.355113:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00080000:2.0:1789305070.357377:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305070.357431:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:2.0:1789305070.357439:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e2c03618a80, transno 4294967375 00000100:00100000:2.0:1789305070.357478:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785766144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305070.443273:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305070.443331:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305070.443429:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765707904 00000100:00100000:0.0:1789305070.443441:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765707904 00000100:00100000:0.0:1789305070.443520:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1814 00000100:00100000:0.0:1789305070.443532:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765707904:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305070.443611:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:2356:x1876219765707904:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305070.443619:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1814 00000100:00080000:3.0:1789305070.443716:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305070.443867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305070.443900:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305070.444158:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765708032 00000100:00100000:0.0:1789305070.444170:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765708160 00000100:00100000:3.0:1789305070.444172:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765708032 00000100:00100000:0.0:1789305070.444183:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765708160 00000100:00080000:1.0:1789305070.444273:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789305070.444277:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305070.444396:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1409 00000100:00100000:0.0:1789305070.444407:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765708160:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305070.444455:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765708160:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 51us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305070.444462:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1409 00000100:00100000:2.0:1789305070.447487:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765707776 00000100:00100000:2.0:1789305070.447508:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765707776 00000100:00100000:2.0:1789305070.447638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1397 00000100:00100000:2.0:1789305070.447649:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765707776:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305070.447731:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765707776:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (4399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305070.447742:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1397 00000100:00100000:3.0:1789305070.449937:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1410 00000100:00100000:3.0:1789305070.449964:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765708032:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305070.450173:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765708032:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 220us (6305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305070.450182:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1410 00000100:00100000:0.0:1789305070.868464:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785766656:0@lo:400:kworker.0 00000100:00100000:0.0:1789305070.868535:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305070.868611:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789305070.868617:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785766528:0@lo:400:kworker.0 00000100:00100000:0.0:1789305070.868643:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305070.868674:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785766656 00000100:00100000:0.0:1789305070.868681:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785766656 00000100:00100000:0.0:1789305070.868736:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:0.0:1789305070.868745:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785766656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305070.868794:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785766656:12345-0@lo:400:kworker.0 Request processed in 50us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305070.868801:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00100000:0.0:1789305070.868845:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785766656:0@lo:400:kworker.0 00000100:00100000:1.0:1789305070.869022:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785766400:0@lo:400:kworker.0 00000100:00100000:1.0:1789305070.869058:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305070.869079:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785766272:0@lo:400:kworker.0 00000100:00100000:1.0:1789305070.869173:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785766400 00000100:00100000:1.0:1789305070.869180:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785766400 00000100:00100000:1.0:1789305070.869229:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:3.0:1789305070.869240:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305070.869248:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785766400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305070.869413:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785766272 00000100:00100000:2.0:1789305070.869418:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785766272 00000100:00100000:2.0:1789305070.869454:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:2.0:1789305070.869462:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785766272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305070.869524:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785766528 00000100:00100000:0.0:1789305070.869533:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785766528 00000100:00100000:0.0:1789305070.869590:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:0.0:1789305070.869600:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785766528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305070.870550:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785766784:0@lo:400:kworker.0 00000100:00100000:2.0:1789305070.877863:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785766272:12345-0@lo:400:kworker.0 Request processed in 8385us (8615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305070.877877:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785766528:12345-0@lo:400:kworker.0 Request processed in 8267us (9221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305070.877889:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1789305070.877904:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00080000:0.0:1789305070.877978:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789305070.877986:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305070.878052:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785766528:0@lo:400:kworker.0 00000100:00100000:1.0:1789305070.888246:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785766400:12345-0@lo:400:kworker.0 Request processed in 18993us (19178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305070.888266:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1789305070.888481:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785766400:0@lo:400:kworker.0 00000100:00100000:3.0:1789305070.889620:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305070.889848:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785766272:0@lo:400:kworker.0 00000100:00100000:0.0:1789305070.894873:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785766784 00000100:00100000:0.0:1789305070.894900:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785766784 00000100:00100000:0.0:1789305070.895137:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:0.0:1789305070.895152:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785766784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305070.896124:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785766784:12345-0@lo:400:kworker.0 Request processed in 938us (6539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305070.896136:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:3.0:1789305070.896299:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785766784:0@lo:400:kworker.0 00000100:00080000:1.0:1789305070.897225:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789305070.932190:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305071.378780:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305071.378817:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785766912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305071.378925:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305071.380189:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785766912 00000100:00100000:2.0:1789305071.380221:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785766912 00000100:00100000:2.0:1789305071.380342:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:2.0:1789305071.380355:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785766912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789305071.380411:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305071.380537:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785766912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305071.380545:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:3.0:1789305071.382298:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785766912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789305071.954305:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305072.982014:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305074.004035:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305075.026284:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305075.474839:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785767040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789305075.474947:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305075.475158:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785767040 00000100:00100000:1.0:1789305075.475180:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785767040 00000100:00100000:1.0:1789305075.475262:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:1.0:1789305075.475275:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785767040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305075.475324:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305075.475398:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785767040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305075.475407:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:3.0:1789305075.475449:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785767040:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789305075.475473:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305075.556633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305075.557772:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305075.557823:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305075.557845:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305075.557910:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765708544 00000100:00100000:2.0:1789305075.557917:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765708416 00000100:00100000:2.0:1789305075.557922:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765708416 00000100:00100000:1.0:1789305075.557922:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765708544 00000100:00100000:3.0:1789305075.558045:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765708672 00000100:00100000:3.0:1789305075.558050:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765708672 00000100:00100000:2.0:1789305075.558050:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1818 00000100:00100000:2.0:1789305075.558063:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765708416:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305075.558109:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1412 00000100:00100000:3.0:1789305075.558117:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765708672:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305075.558191:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:2355:x1876219765708416:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 130us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305075.558200:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1818 00000100:00100000:1.0:1789305075.558313:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1413 00000100:00100000:1.0:1789305075.558321:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765708544:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305075.558617:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765708672:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 498us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305075.558624:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1412 00000100:00080000:3.0:1789305075.558663:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789305075.558669:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789305075.558671:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305075.558762:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765708288 00000100:00100000:0.0:1789305075.558769:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765708288 00000100:00100000:0.0:1789305075.559118:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1399 00000100:00100000:0.0:1789305075.559129:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765708288:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305075.559181:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765708288:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 54us (2679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305075.559188:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1399 00000100:00100000:1.0:1789305075.561000:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765708544:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 2657us (3211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305075.561018:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1413 00000100:00100000:3.0:1789305075.986631:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785767424:0@lo:400:kworker.0 00000100:00100000:1.0:1789305075.986642:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785767296:0@lo:400:kworker.0 00000100:00100000:0.0:1789305075.986704:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785767168:0@lo:400:kworker.0 00000100:00100000:2.0:1789305075.986712:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785767552:0@lo:400:kworker.0 00000100:00100000:3.0:1789305075.987050:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305075.987197:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785767424 00000100:00100000:3.0:1789305075.987208:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785767424 00000100:00100000:3.0:1789305075.987300:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1789305075.987311:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785767424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305075.987374:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785767424:12345-0@lo:400:kworker.0 Request processed in 66us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305075.987382:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00080000:3.0:1789305075.987410:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305075.987449:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785767424:0@lo:400:kworker.0 00000100:00100000:0.0:1789305075.991363:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305075.991467:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785767680:0@lo:400:kworker.0 00000100:00100000:0.0:1789305075.991516:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305075.991634:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785767680 00000100:00100000:0.0:1789305075.991647:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785767680 00000100:00100000:0.0:1789305075.991728:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819 00000100:00100000:0.0:1789305075.991738:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785767680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305075.991807:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785767680:12345-0@lo:400:kworker.0 Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305075.991814:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819 00000100:00100000:0.0:1789305075.991869:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785767680:0@lo:400:kworker.0 00000100:00100000:3.0:1789305075.993243:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785767168 00000100:00100000:3.0:1789305075.993269:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785767168 00000100:00100000:3.0:1789305075.993341:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1789305075.993352:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785767168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305075.993448:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785767168:12345-0@lo:400:kworker.0 Request processed in 99us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305075.993456:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00080000:3.0:1789305075.993503:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305075.993702:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785767168:0@lo:400:kworker.0 00000100:00100000:2.0:1789305075.994107:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305075.994275:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785767552 00000100:00100000:0.0:1789305075.994281:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785767552 00000100:00100000:0.0:1789305075.994343:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:0.0:1789305075.994352:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785767552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305075.994401:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785767552:12345-0@lo:400:kworker.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305075.994407:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00000100:00100000:2.0:1789305075.994484:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785767552:0@lo:400:kworker.0 00000100:00100000:1.0:1789305075.994934:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305075.995033:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785767296 00000100:00100000:2.0:1789305075.995038:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785767296 00000100:00100000:2.0:1789305075.995075:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:2.0:1789305075.995083:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785767296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305075.995175:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785767296:12345-0@lo:400:kworker.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00080000:3.0:1789305075.995177:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305075.995182:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00100000:1.0:1789305075.995352:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785767296:0@lo:400:kworker.0 00010000:00010000:2.0:1789305076.050509:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305076.498656:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785767808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305076.498749:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305076.499010:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785767808 00000100:00100000:0.0:1789305076.499022:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785767808 00000100:00100000:0.0:1789305076.499126:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:0.0:1789305076.499138:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785767808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305076.499195:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305076.499467:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785767808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 331us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305076.499474:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1789305076.501347:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785767808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789305077.074735:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305078.098680:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305079.122465:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305080.146773:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305080.594582:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785767936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305080.594692:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305080.594918:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785767936 00000100:00100000:1.0:1789305080.594930:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785767936 00000100:00100000:1.0:1789305080.595010:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:1.0:1789305080.595024:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785767936:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789305080.595172:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789305080.595248:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305080.596391:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785767936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1364us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305080.596406:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1789305080.600304:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785767936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789305080.683162:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305080.683209:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305080.683236:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305080.683279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305080.683358:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765708928 00000100:00100000:1.0:1789305080.683372:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765708928 00000100:00100000:3.0:1789305080.683387:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765708800 00000100:00100000:3.0:1789305080.683392:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765708800 00000100:00100000:3.0:1789305080.683449:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1401 00000100:00100000:1.0:1789305080.683457:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1822 00000100:00100000:3.0:1789305080.683459:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765708800:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305080.683465:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765708928:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305080.683553:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765708800:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 95us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305080.683561:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1401 00000100:00100000:0.0:1789305080.683583:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765709056 00000100:00100000:0.0:1789305080.683590:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765709056 00000100:00100000:0.0:1789305080.683634:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765709184 00000100:00100000:0.0:1789305080.683638:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765709184 00000100:00100000:0.0:1789305080.683672:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1415 00000100:00100000:0.0:1789305080.683681:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765709056:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:2.0:1789305080.683751:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789305080.683756:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789305080.683764:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305080.683787:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1416 00000100:00100000:2.0:1789305080.683796:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765709184:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305080.687720:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+7:2357:x1876219765708928:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 4234us (4461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305080.687720:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765709056:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 4020us (4489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305080.687748:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1822 00000100:00100000:0.0:1789305080.687749:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1415 00000100:00100000:2.0:1789305080.692242:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765709184:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 8418us (8933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305080.692264:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1416 00000100:00100000:3.0:1789305081.107439:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785768320:0@lo:400:kworker.0 00000100:00100000:3.0:1789305081.107556:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305081.107674:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305081.107681:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785768448:0@lo:400:kworker.0 00000100:00100000:3.0:1789305081.107710:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305081.107773:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785768448 00000100:00100000:3.0:1789305081.107785:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785768448 00000100:00100000:3.0:1789305081.107868:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:3.0:1789305081.107882:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785768448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305081.107953:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785768448:12345-0@lo:400:kworker.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305081.107961:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00080000:3.0:1789305081.107987:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305081.108031:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785768448:0@lo:400:kworker.0 00000100:00100000:2.0:1789305081.108438:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785768320 00000100:00100000:2.0:1789305081.108446:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785768320 00000100:00100000:2.0:1789305081.108498:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:2.0:1789305081.108507:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785768320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305081.108562:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785768320:12345-0@lo:400:kworker.0 Request processed in 51us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305081.108569:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1789305081.109504:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785768064:0@lo:400:kworker.0 00000100:00100000:0.0:1789305081.109573:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305081.109647:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785768576:0@lo:400:kworker.0 00000100:00100000:0.0:1789305081.109679:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305081.109718:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789305081.109728:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785768192:0@lo:400:kworker.0 00000100:00100000:0.0:1789305081.109753:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305081.109799:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785768576 00000100:00100000:0.0:1789305081.109807:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785768576 00000100:00100000:0.0:1789305081.109849:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785768192 00000100:00100000:0.0:1789305081.109852:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785768192 00000100:00100000:0.0:1789305081.109874:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:0.0:1789305081.109883:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785768576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305081.109936:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785768576:12345-0@lo:400:kworker.0 Request processed in 54us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305081.109943:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:0.0:1789305081.109961:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:0.0:1789305081.109967:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785768192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305081.109994:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785768192:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305081.110000:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:0.0:1789305081.110035:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785768192:0@lo:400:kworker.0 00000100:00100000:0.0:1789305081.110043:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785768576:0@lo:400:kworker.0 00000100:00100000:2.0:1789305081.110428:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785768064 00000100:00100000:2.0:1789305081.110435:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785768064 00000100:00100000:2.0:1789305081.110480:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:2.0:1789305081.110488:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785768064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305081.110541:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785768064:12345-0@lo:400:kworker.0 Request processed in 55us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305081.110548:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1789305081.110643:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785768064:0@lo:400:kworker.0 00000100:00080000:3.0:1789305081.110814:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789305081.110822:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305081.110866:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785768320:0@lo:400:kworker.0 00010000:00010000:0.0:1789305081.170448:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305081.622766:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785768704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305081.622852:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305081.635618:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785768704 00000100:00100000:3.0:1789305081.635637:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785768704 00000100:00100000:3.0:1789305081.635730:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:3.0:1789305081.635742:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785768704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789305081.635781:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305081.636343:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785768704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 602us (13490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305081.636351:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:1.0:1789305081.636531:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785768704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789305082.199577:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305082.689399:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305082.689854:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765709312 00000100:00100000:1.0:1789305082.689869:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765709312 00000100:00100000:1.0:1789305082.690029:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1252 00000100:00100000:1.0:1789305082.690044:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:59628:x1876219765709312:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789305082.690223:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+7:59628:x1876219765709312:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 183us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305082.690233:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1252 00000100:00080000:0.0:1789305082.696427:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305082.702691:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305082.706363:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765709440 00000100:00100000:0.0:1789305082.706389:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765709440 00000100:00080000:2.0:1789305082.706586:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305082.706636:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 687 00000100:00100000:0.0:1789305082.706651:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:59628:x1876219765709440:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789305082.707282:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:59628:x1876219765709440:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 630us (4607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305082.716184:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305082.716251:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765709568 00000100:00100000:1.0:1789305082.716267:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765709568 00000100:00080000:2.0:1789305082.721432:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789305082.723875:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 687 00000100:00100000:1.0:1789305082.725048:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 688 00000100:00100000:1.0:1789305082.725129:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:59628:x1876219765709568:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:1.0:1789305082.725849:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:59628:x1876219765709568:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 777us (9677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305082.725860:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 688 00000100:00100000:0.0:1789305082.733895:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305082.734032:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765709696 00000100:00100000:1.0:1789305082.734054:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765709696 00000100:00100000:1.0:1789305082.734306:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1253 00000100:00100000:1.0:1789305082.734321:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:59628:x1876219765709696:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:1.0:1789305082.735126:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:59628:x1876219765709696:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 770us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305082.735138:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1253 00000100:00100000:0.0:1789305082.743744:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305082.751168:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765709824 00000100:00100000:3.0:1789305082.751210:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765709824 00000100:00100000:3.0:1789305082.751302:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1254 00000100:00100000:3.0:1789305082.751319:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:59628:x1876219765709824:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789305082.751478:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+7:59628:x1876219765709824:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 162us (7752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305082.751490:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1254 00000100:00100000:1.0:1789305082.757773:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305082.757872:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765709952 00000100:00100000:0.0:1789305082.757887:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765709952 00000100:00100000:0.0:1789305082.757965:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 689 00000100:00100000:0.0:1789305082.757977:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:59628:x1876219765709952:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:0.0:1789305082.758826:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:59628:x1876219765709952:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 846us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305082.758839:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 689 00000100:00100000:3.0:1789305082.776921:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305082.776966:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765710080 00000100:00100000:3.0:1789305082.776980:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765710080 00000100:00100000:3.0:1789305082.777053:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 690 00000100:00100000:3.0:1789305082.777066:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:59628:x1876219765710080:12345-192.168.202.29@tcp:19:lfs.60003 00000100:00100000:3.0:1789305082.777971:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:59628:x1876219765710080:12345-192.168.202.29@tcp:19:lfs.60003 Request processed in 904us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305082.777982:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 690 00000100:00100000:3.0:1789305082.793669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305082.793717:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765710208 00000100:00100000:3.0:1789305082.793731:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765710208 00000100:00100000:3.0:1789305082.793817:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1255 00000100:00100000:3.0:1789305082.793831:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:59628:x1876219765710208:12345-192.168.202.29@tcp:48:lfs.60003 00000100:00100000:3.0:1789305082.794591:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+7:59628:x1876219765710208:12345-192.168.202.29@tcp:48:lfs.60003 Request processed in 759us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305082.794602:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1255 00000100:00100000:2.0:1789305082.841397:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305082.841470:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765710336 00000100:00100000:2.0:1789305082.841489:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765710336 00000100:00100000:2.0:1789305082.841569:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1256 00000100:00100000:2.0:1789305082.841583:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+7:59630:x1876219765710336:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1789305082.841614:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305082.841645:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231297f8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009f4 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305082.841755:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231297f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305082.841775:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231297f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305082.841794:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231297f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789305082.841853:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:2.0:1789305082.841858:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789305082.841888:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231297f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305082.841924:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecd200/0xefc0bb7231297f8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009f4 expref: 9 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305082.841949:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231297f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009f4 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305082.841958:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:2.0:1789305082.841962:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789305082.841967:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecce00, rc 0) 00000100:00100000:2.0:1789305082.842037:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+8:59630:x1876219765710336:12345-192.168.202.29@tcp:101:rm.0 Request processed in 458us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305082.842045:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1256 00000100:00100000:3.0:1789305082.848499:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305082.848548:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765710592 00000100:00100000:3.0:1789305082.848562:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765710592 00000100:00100000:3.0:1789305082.848632:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1257 00000100:00100000:3.0:1789305082.848644:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+8:59630:x1876219765710592:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:3.0:1789305082.848673:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305082.848700:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d861009fb expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789305082.848835:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00010000:3.0:1789305082.849192:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009fb expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.849210:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789305082.849214:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789305082.849220:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ea00/0xefc0bb7231297f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009fb expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.849237:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ea00, rc 0) 00000100:00100000:3.0:1789305082.849322:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+9:59630:x1876219765710592:12345-192.168.202.29@tcp:101:rm.0 Request processed in 681us (842us total) trans 4294967776 rc 301/301 00000100:00100000:3.0:1789305082.849331:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1257 00000100:00100000:0.0:1789305082.866559:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305082.866621:0:79662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765710720 00000100:00100000:0.0:1789305082.866637:0:79662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765710720 00000100:00100000:0.0:1789305082.866705:0:79662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 126 00000100:00100000:0.0:1789305082.866719:0:79662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:59630:x1876219765710720:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:1.0:1789305082.875436:0:79662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:99087288-e673-4cc7-b2df-ca113c20dacd+9:59630:x1876219765710720:12345-192.168.202.29@tcp:37:rm.0 Request processed in 8702us (8872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305082.875455:0:79662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 126 00000100:00100000:0.0:1789305082.879976:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305082.880061:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765710976 00000100:00100000:3.0:1789305082.880076:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765710976 00000100:00100000:3.0:1789305082.880199:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 127 00000100:00100000:3.0:1789305082.880212:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+9:59630:x1876219765710976:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:3.0:1789305082.880545:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:99087288-e673-4cc7-b2df-ca113c20dacd+10:59630:x1876219765710976:12345-192.168.202.29@tcp:35:rm.0 Request processed in 334us (578us total) trans 4294967777 rc 0/0 00000100:00100000:3.0:1789305082.880554:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 127 00000100:00100000:2.0:1789305082.887050:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305082.887136:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765711232 00000100:00100000:3.0:1789305082.887162:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765711232 00000100:00100000:3.0:1789305082.887357:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1258 00000100:00100000:3.0:1789305082.887370:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+10:59630:x1876219765711232:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:3.0:1789305082.887444:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789305082.887482:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecce00/0xefc0bb7231297f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009f4 expref: 10 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.887509:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860f000/0xefc0bb7231297f3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d861009df expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.887524:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19600) 00010000:00010000:3.0:1789305082.887546:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ec00/0xefc0bb7231297c54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100929 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.887558:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19d00) 00010000:00010000:3.0:1789305082.887566:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789305082.887598:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297faa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.887615:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297faa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.887626:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297faa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.887639:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.887647:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.887653:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.888008:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297fb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.888019:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297fb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.888026:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297fb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789305082.889652:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00010000:3.0:1789305082.889910:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297fb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.889925:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297fb8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.889934:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297fb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.889942:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305082.889948:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297fb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.889957:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297fb8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.889973:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9e2c2ea19900) 00010000:00010000:3.0:1789305082.889977:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789305082.889984:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297fb8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.889992:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860fc00/0xefc0bb7231297fb8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.890024:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297faa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.890031:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297faa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.890038:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297faa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.890044:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305082.890048:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297faa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.890054:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297faa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.890062:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c2ea19100) 00010000:00010000:3.0:1789305082.890065:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305082.890068:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297faa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.890074:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860ee00/0xefc0bb7231297faa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789305082.890133:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c099b7d6 reply state 00000000dda1b732 transno 4294967778 ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305082.890145:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789305082.890272:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+9:59630:x1876219765711232:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2900us (3227us total) trans 4294967778 rc 0/0 00000100:00100000:3.0:1789305082.890283:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1258 00010000:00010000:3.0:1789305082.896327:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.896359:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.896369:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.896376:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e000 already unused, calling callback (ffffffffc21aa4f0) 00010000:00010000:3.0:1789305082.896383:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.896391:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.896411:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9e2c2ea19000) 00010000:00010000:3.0:1789305082.896415:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789305082.896420:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305082.896427:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c3860e000/0xefc0bb7231297fb1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305083.219437:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305084.246638:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789305084.634446:0:101253:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe309fd240 20000000:00000080:0.0:1789305084.634548:0:101253:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02070c00 uarg=0000000000000000 00010000:00010000:1.0:1789305084.650822:0:101253:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789305084.650856:0:101253:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789305084.650939:0:101253:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305084.650969:0:101253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305084.650991:0:101253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c46 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297c3f expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305084.651000:0:101253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305084.651052:0:101253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297c3f expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305084.651070:0:101253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c46 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297c3f expref: 18 pid: 5845 timeout: 2634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305084.651246:0:101253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101253:1876219785768832:0@lo:104: 00000100:00100000:1.0:1789305084.651410:0:101253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305084.651595:0:101253:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789305084.651663:0:52683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789305084.651681:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785768832 00000100:00100000:0.0:1789305084.651690:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785768832 00000100:00100000:0.0:1789305084.651820:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1789305084.651832:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:101253:x1876219785768832:12345-0@lo:104: 00010000:00010000:0.0:1789305084.651861:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305084.651942:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305084.651949:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f7c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:101253:x1876219785768832:12345-0@lo:104: Request processed in 120us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305084.651956:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789305084.652088:0:101253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101253:1876219785768832:0@lo:104: 00010000:00010000:1.0:1789305084.652137:0:101253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652201:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305084.652211:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652220:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789305084.652225:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652236:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789305084.652244:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305084.652250:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789305084.652297:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652303:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789305084.652329:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652337:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afac00/0xefc0bb7231297c3f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297c46 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652355:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305084.652357:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305084.652358:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305084.652371:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785768960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789305084.652410:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305084.652474:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785768960 00000100:00100000:2.0:1789305084.652479:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785768960 00010000:00010000:2.0:1789305084.652502:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c46 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297c3f expref: 19 pid: 5845 timeout: 2634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305084.652527:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1789305084.652534:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785768960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305084.652547:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305084.652552:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c46 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297c3f expref: 19 pid: 5845 timeout: 2634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652563:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297c3f expref: 19 pid: 5845 timeout: 2634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652577:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231297c46 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297c3f expref: 19 pid: 5845 timeout: 2634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652593:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652603:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652620:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652628:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652635:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652646:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652651:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371c00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305084.652657:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652664:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652675:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305084.652684:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789305084.652709:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785768960:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305084.652715:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1789305084.652746:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785768960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305084.652874:0:101253:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305084.652883:0:101253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305084.652889:0:101253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297fbf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789305084.803007:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967778 is committed 00010000:00010000:2.0:1789305085.275299:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305085.714992:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305085.715022:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785769088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305085.715168:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305085.715857:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785769088 00000100:00100000:2.0:1789305085.715876:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785769088 00000100:00100000:2.0:1789305085.715959:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1789305085.715970:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785769088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305085.716016:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305085.716118:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785769088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305085.716127:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00080000:3.0:1789305085.716277:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305085.716330:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785769088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305085.797796:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305085.797849:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305085.797907:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765711744 00000100:00100000:1.0:1789305085.797923:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765711744 00000100:00100000:2.0:1789305085.797996:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765711488 00000100:00100000:2.0:1789305085.798002:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765711488 00000100:00100000:1.0:1789305085.798015:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1418 00000100:00100000:1.0:1789305085.798026:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765711744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305085.798041:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1826 00000100:00100000:2.0:1789305085.798049:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765711488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305085.798159:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765711744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 135us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305085.798169:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1418 00000100:00080000:1.0:1789305085.798194:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789305085.798200:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305085.798275:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765711488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 225us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305085.798282:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1826 00000100:00100000:3.0:1789305085.810793:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305085.810846:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305085.810934:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765711360 00000100:00100000:1.0:1789305085.810947:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765711360 00000100:00100000:1.0:1789305085.811020:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1403 00000100:00100000:1.0:1789305085.811032:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765711360:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305085.811169:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765711360:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 140us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305085.811178:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1403 00000100:00100000:2.0:1789305085.811611:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765711616 00000100:00100000:2.0:1789305085.811617:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765711616 00000100:00100000:2.0:1789305085.811674:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1419 00000100:00100000:2.0:1789305085.811682:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765711616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305085.811727:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765711616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 47us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305085.811734:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1419 00000100:00080000:1.0:1789305085.812326:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789305085.840976:0:101302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe1910c790 20000000:00000080:2.0:1789305085.840995:0:101302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f665400 uarg=0000000000000000 00010000:00010000:2.0:1789305085.841653:0:101302:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789305085.841668:0:101302:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789305085.841689:0:101302:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305085.841711:0:101302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305085.841728:0:101302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305085.841739:0:101302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305085.841748:0:101302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305085.841754:0:101302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305085.841759:0:101302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305085.841763:0:101302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305085.841767:0:101302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305085.841773:0:101302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305085.841786:0:101302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305085.841792:0:101302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305085.841797:0:101302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231297fc6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305086.163571:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789305086.163584:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789305086.163590:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789305086.163663:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305086.163679:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305086.163703:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305086.163742:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785769216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789305086.163841:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305086.163912:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789305086.164971:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785769216 00000100:00100000:0.0:1789305086.164988:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785769216 00000100:00100000:0.0:1789305086.165270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1789305086.165284:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785769216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305086.165303:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305086.165329:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231297fd4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297fcd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.165365:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231297fd4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297fcd expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.165378:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231297fd4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297fcd expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.165389:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa200, rc 0) 00000100:00100000:0.0:1789305086.165488:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785769216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305086.165496:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1789305086.165840:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785769216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305086.165864:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305086.165882:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305086.165911:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789305086.165917:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305086.165925:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305086.226881:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785769344:0@lo:400:kworker.0 00000100:00100000:2.0:1789305086.226987:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305086.227042:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789305086.227049:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785769472:0@lo:400:kworker.0 00000100:00100000:2.0:1789305086.227087:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305086.227142:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785769600:0@lo:400:kworker.0 00000100:00100000:2.0:1789305086.227168:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305086.227191:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789305086.227196:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785769728:0@lo:400:kworker.0 00000100:00100000:2.0:1789305086.227222:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305086.227262:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785769344 00000100:00100000:2.0:1789305086.227272:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785769344 00000100:00100000:2.0:1789305086.227327:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785769600 00000100:00100000:2.0:1789305086.227330:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785769600 00000100:00100000:2.0:1789305086.227355:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785769728 00000100:00100000:2.0:1789305086.227357:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785769728 00000100:00100000:2.0:1789305086.227377:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:2.0:1789305086.227386:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785769344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305086.227450:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785769344:12345-0@lo:400:kworker.0 Request processed in 64us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305086.227458:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:2.0:1789305086.227479:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:2.0:1789305086.227485:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785769600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305086.227516:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785769600:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305086.227522:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:2.0:1789305086.227533:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:2.0:1789305086.227540:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785769728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305086.228199:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785769472 00000100:00100000:1.0:1789305086.228208:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785769472 00000100:00100000:1.0:1789305086.228259:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1789305086.228268:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785769472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305086.228320:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785769472:12345-0@lo:400:kworker.0 Request processed in 54us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305086.228326:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00080000:1.0:1789305086.228347:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789305086.228352:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305086.229657:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785769728:12345-0@lo:400:kworker.0 Request processed in 2109us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305086.229671:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:2.0:1789305086.229763:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785769472:0@lo:400:kworker.0 00000100:00100000:2.0:1789305086.229779:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785769344:0@lo:400:kworker.0 00000100:00100000:2.0:1789305086.229829:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785769728:0@lo:400:kworker.0 00000100:00100000:2.0:1789305086.229842:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785769600:0@lo:400:kworker.0 00010000:00010000:1.0:1789305086.290942:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305086.744570:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789305086.745275:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785769856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305086.749206:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305086.752592:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785769856 00000100:00100000:3.0:1789305086.752611:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785769856 00000100:00100000:3.0:1789305086.752726:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:3.0:1789305086.752739:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785769856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789305086.752792:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305086.752916:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785769856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (3723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305086.752925:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1789305086.753019:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785769856:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789305086.909037:0:101351:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec322b330 20000000:00000080:1.0:1789305086.909073:0:101351:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02056400 uarg=0000000000000000 00010000:00010000:1.0:1789305086.909766:0:101351:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789305086.909785:0:101351:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789305086.909810:0:101351:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305086.909837:0:101351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305086.909859:0:101351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231297fd4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297fcd expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305086.909869:0:101351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305086.909927:0:101351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231297fd4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297fcd expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305086.909948:0:101351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231297fd4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297fcd expref: 18 pid: 5847 timeout: 2636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305086.909966:0:101351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101351:1876219785769984:0@lo:104: 00000100:00100000:1.0:1789305086.910067:0:101351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305086.910325:0:101351:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0112fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789305086.911086:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785769984 00000100:00100000:2.0:1789305086.911344:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785769984 00000100:00100000:2.0:1789305086.911469:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789305086.911481:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:101351:x1876219785769984:12345-0@lo:104: 00010000:00010000:2.0:1789305086.911501:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305086.911614:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789305086.911621:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:101351:x1876219785769984:12345-0@lo:104: Request processed in 143us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305086.911628:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00010000:00010000:0.0:1789305086.911678:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305086.911688:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.911697:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305086.911702:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.911712:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305086.911721:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305086.911729:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789305086.911778:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.911785:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305086.911813:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.911821:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41370400/0xefc0bb7231297fcd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297fd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.911844:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305086.911845:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305086.911847:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305086.911874:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785770112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305086.911923:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305086.911985:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785770112 00000100:00100000:0.0:1789305086.911989:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785770112 00010000:00010000:0.0:1789305086.912013:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231297fd4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297fcd expref: 19 pid: 5847 timeout: 2636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305086.912037:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1789305086.912044:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785770112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305086.912068:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305086.912075:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231297fd4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297fcd expref: 19 pid: 5847 timeout: 2636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912088:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231297fd4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297fcd expref: 19 pid: 5847 timeout: 2636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912135:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912146:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912177:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912194:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912202:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912209:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912220:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305086.912226:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912235:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912245:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305086.912255:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305086.912285:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785770112:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305086.912292:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1789305086.912338:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785770112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305086.912567:0:101351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231297fd4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297fcd expref: 18 pid: 5847 timeout: 2636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305086.912580:0:101351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101351:1876219785769984:0@lo:104: 00010000:00010000:1.0:1789305086.912599:0:101351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305086.912608:0:101351:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305086.912614:0:101351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305086.912621:0:101351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370000/0xefc0bb7231297fdb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305087.317575:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305088.154188:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305088.154196:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305088.154201:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305088.154263:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305088.154278:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305088.154292:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305088.154325:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38651180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785770240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305088.154403:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305088.154462:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c014f2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789305088.154510:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785770240 00000100:00100000:1.0:1789305088.154520:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785770240 00000100:00100000:1.0:1789305088.154576:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1789305088.154585:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785770240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305088.154600:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305088.154613:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370200/0xefc0bb7231297fe9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297fe2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305088.154652:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370200/0xefc0bb7231297fe9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297fe2 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305088.154662:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370200/0xefc0bb7231297fe9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297fe2 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305088.154670:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370200, rc 0) 00000100:00100000:1.0:1789305088.154721:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785770240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305088.154728:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:2.0:1789305088.155043:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38651180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785770240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305088.155072:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305088.155082:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305088.155144:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789305088.155150:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305088.155159:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305088.340596:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305089.363065:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305090.386314:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305090.834317:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789305090.834343:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785770368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305090.834429:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305090.834511:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785770368 00000100:00100000:3.0:1789305090.834522:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785770368 00000100:00100000:3.0:1789305090.834588:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1789305090.834598:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785770368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789305090.834640:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305090.834692:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785770368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305090.834699:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00080000:3.0:1789305090.834720:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305090.834762:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785770368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305090.915398:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305090.915442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305090.915473:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305090.915500:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305090.915531:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765712256 00000100:00100000:0.0:1789305090.915542:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765712256 00000100:00100000:0.0:1789305090.915604:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765712128 00000100:00100000:0.0:1789305090.915607:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765712128 00000100:00100000:0.0:1789305090.915629:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1421 00000100:00100000:0.0:1789305090.915639:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765712256:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305090.915714:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765712256:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305090.915722:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1421 00000100:00100000:0.0:1789305090.915739:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1422 00000100:00100000:0.0:1789305090.915746:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765712128:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305090.915771:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765712128:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305090.915776:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1422 00000100:00100000:0.0:1789305090.915797:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765711872 00000100:00100000:0.0:1789305090.915801:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765711872 00000100:00100000:0.0:1789305090.915839:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1406 00000100:00100000:0.0:1789305090.915845:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765711872:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305090.915869:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765711872:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305090.915876:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1406 00000100:00080000:0.0:1789305090.915906:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789305090.915910:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305090.916640:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765712000 00000100:00100000:3.0:1789305090.916646:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765712000 00000100:00100000:3.0:1789305090.916705:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1830 00000100:00100000:3.0:1789305090.916723:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765712000:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305090.916771:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765712000:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 59us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305090.916781:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1830 00000100:00080000:0.0:1789305090.921338:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1789305090.975728:0:101549:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff8ab07990 20000000:00000080:3.0:1789305090.975747:0:101549:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b0208f400 uarg=0000000000000000 00010000:00010000:3.0:1789305090.977002:0:101549:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789305090.977033:0:101549:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789305090.977056:0:101549:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305090.977122:0:101549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305090.977143:0:101549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370200/0xefc0bb7231297fe9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297fe2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305090.977151:0:101549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305090.977193:0:101549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370200/0xefc0bb7231297fe9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297fe2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305090.977210:0:101549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c41370200/0xefc0bb7231297fe9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297fe2 expref: 18 pid: 5846 timeout: 2640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305090.977227:0:101549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101549:1876219785770496:0@lo:104: 00000100:00100000:3.0:1789305090.977301:0:101549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305090.977433:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785770496 00000100:00100000:0.0:1789305090.977442:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785770496 00000100:00100000:0.0:1789305090.977499:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789305090.977509:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:101549:x1876219785770496:12345-0@lo:104: 00010000:00010000:0.0:1789305090.977524:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305090.977582:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305090.977588:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:101549:x1876219785770496:12345-0@lo:104: Request processed in 82us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305090.977596:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789305090.977664:0:101549:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c36e549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789305090.977694:0:101549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:101549:1876219785770496:0@lo:104: 00010000:00010000:3.0:1789305090.977713:0:101549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305090.980160:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789305090.980175:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305090.980187:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789305090.980192:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305090.980203:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789305090.980210:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305090.980215:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789305090.980281:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305090.980288:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305090.980317:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305090.980323:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231297fe2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297fe9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305090.980346:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305090.980348:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305090.980350:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305090.980373:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785770624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305090.980435:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305090.983850:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785770624 00000100:00100000:2.0:1789305090.983864:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785770624 00010000:00010000:2.0:1789305090.983912:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370200/0xefc0bb7231297fe9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297fe2 expref: 19 pid: 5846 timeout: 2640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305090.983948:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1789305090.983958:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785770624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305090.983973:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305090.983978:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370200/0xefc0bb7231297fe9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297fe2 expref: 19 pid: 5846 timeout: 2640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.983990:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370200/0xefc0bb7231297fe9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297fe2 expref: 19 pid: 5846 timeout: 2640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984008:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370200/0xefc0bb7231297fe9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297fe2 expref: 19 pid: 5846 timeout: 2640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984036:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984046:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984310:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984320:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984327:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984333:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984339:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305090.984344:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984356:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984371:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305090.984383:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789305090.984456:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785770624:12345-0@lo:103:ldlm_bl.0 Request processed in 500us (4021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305090.984464:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00010000:00010000:1.0:1789305090.984562:0:101549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305090.984571:0:101549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305090.984578:0:101549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ee00/0xefc0bb7231297ff0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 101549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305091.002435:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785770624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305091.350564:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785770880:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.350639:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305091.350692:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785771392:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.350715:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305091.350742:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789305091.350748:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785770752:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.350780:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305091.350805:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785771264:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.350826:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305091.350851:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785771008:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.350875:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305091.350893:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789305091.350898:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785771136:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.350919:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305091.350950:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785770880 00000100:00100000:0.0:1789305091.350959:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785770880 00000100:00100000:0.0:1789305091.351010:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785771264 00000100:00100000:0.0:1789305091.351028:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785771264 00000100:00100000:0.0:1789305091.351058:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785771136 00000100:00100000:0.0:1789305091.351452:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785771136 00000100:00100000:0.0:1789305091.351475:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:0.0:1789305091.351482:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785770880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351530:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785770880:12345-0@lo:400:kworker.0 Request processed in 49us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305091.351535:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:0.0:1789305091.351549:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:0.0:1789305091.351552:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785771264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351568:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785771264:12345-0@lo:400:kworker.0 Request processed in 16us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305091.351571:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00100000:0.0:1789305091.351577:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:0.0:1789305091.351580:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785771136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351597:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785771136:12345-0@lo:400:kworker.0 Request processed in 16us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305091.351600:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:0.0:1789305091.351614:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785771392 00000100:00100000:0.0:1789305091.351616:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785771392 00000100:00100000:0.0:1789305091.351630:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785771008 00000100:00100000:0.0:1789305091.351632:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785771008 00000100:00100000:0.0:1789305091.351650:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:0.0:1789305091.351656:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785771392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351686:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785771392:12345-0@lo:400:kworker.0 Request processed in 31us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305091.351692:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:0.0:1789305091.351702:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:0.0:1789305091.351707:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785771008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351729:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785771008:12345-0@lo:400:kworker.0 Request processed in 23us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305091.351734:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:0.0:1789305091.351748:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785770752 00000100:00100000:0.0:1789305091.351751:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785770752 00000100:00100000:0.0:1789305091.351772:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1789305091.351778:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785770752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351807:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785770752:12345-0@lo:400:kworker.0 Request processed in 29us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305091.351813:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00080000:0.0:1789305091.351857:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789305091.351861:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305091.351900:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785771136:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351913:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785771008:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351939:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785770752:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351948:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785771264:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351957:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785770880:0@lo:400:kworker.0 00000100:00100000:0.0:1789305091.351968:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785771392:0@lo:400:kworker.0 00010000:00010000:0.0:1789305091.411455:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305091.865812:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305091.865840:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b01158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785771520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305091.865917:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305091.866006:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785771520 00000100:00100000:1.0:1789305091.866025:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785771520 00000100:00100000:1.0:1789305091.866111:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1789305091.866121:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785771520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305091.866169:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305091.866215:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785771520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305091.866223:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1789305091.866272:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b01158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785771520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789305092.435321:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305092.626312:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305092.626321:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305092.626327:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305092.626379:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305092.626391:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305092.626404:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305092.626429:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785771648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305092.626504:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305092.626572:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03f11000 going to sleep for 11 seconds 00000100:00100000:1.0:1789305092.626651:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785771648 00000100:00100000:1.0:1789305092.626659:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785771648 00000100:00100000:1.0:1789305092.626708:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1789305092.626720:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785771648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305092.626735:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305092.626751:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297ffe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231297ff7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305092.626776:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297ffe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231297ff7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305092.626787:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297ffe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297ff7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305092.626796:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371c00, rc 0) 00000100:00100000:1.0:1789305092.626842:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785771648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305092.626849:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:2.0:1789305092.626946:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785771648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305092.626961:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305092.626970:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305092.626988:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789305092.626993:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305092.627012:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305093.462499:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305094.482287:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305095.513216:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305095.954740:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789305095.954767:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785771776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305095.954870:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305095.955170:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785771776 00000100:00100000:3.0:1789305095.955182:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785771776 00000100:00100000:3.0:1789305095.955259:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:3.0:1789305095.955269:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785771776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789305095.955309:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305095.955365:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785771776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305095.955372:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00080000:0.0:1789305095.957190:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789305095.957253:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785771776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305096.041787:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305096.041845:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305096.041879:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305096.041921:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305096.041955:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765712640 00000100:00100000:0.0:1789305096.041966:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765712640 00000100:00100000:3.0:1789305096.042009:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765712512 00000100:00100000:3.0:1789305096.042014:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765712512 00000100:00100000:0.0:1789305096.042035:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765712768 00000100:00100000:0.0:1789305096.042038:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765712768 00000100:00100000:3.0:1789305096.042061:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1834 00000100:00100000:0.0:1789305096.042061:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1425 00000100:00100000:3.0:1789305096.042070:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765712512:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305096.042070:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765712640:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305096.042178:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765712512:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 108us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305096.042185:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1834 00000100:00100000:1.0:1789305096.042212:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1426 00000100:00100000:1.0:1789305096.042221:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765712768:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:3.0:1789305096.042238:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789305096.042242:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789305096.042244:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789305096.042291:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765712384 00000100:00100000:2.0:1789305096.042296:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765712384 00000100:00100000:2.0:1789305096.042324:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1409 00000100:00100000:2.0:1789305096.042331:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765712384:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305096.049716:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765712640:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 7631us (7854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305096.049735:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1425 00000100:00100000:1.0:1789305096.056274:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765712768:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 14041us (14339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305096.056291:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1426 00000100:00100000:2.0:1789305096.056437:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765712384:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 14104us (14659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305096.056448:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1409 00000100:00100000:1.0:1789305096.467171:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785771904:0@lo:400:kworker.0 00000100:00100000:1.0:1789305096.467255:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305096.467312:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785772416:0@lo:400:kworker.0 00000100:00100000:1.0:1789305096.467343:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305096.467367:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789305096.467373:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785772032:0@lo:400:kworker.0 00000100:00100000:1.0:1789305096.467395:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305096.467411:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785772544:0@lo:400:kworker.0 00000100:00100000:1.0:1789305096.467434:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305096.467465:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785772288:0@lo:400:kworker.0 00000100:00100000:1.0:1789305096.467489:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305096.467505:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305096.467510:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785772160:0@lo:400:kworker.0 00000100:00100000:1.0:1789305096.467531:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305096.467561:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785772544 00000100:00100000:1.0:1789305096.467570:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785772544 00000100:00100000:1.0:1789305096.467618:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785772160 00000100:00100000:1.0:1789305096.467621:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785772160 00000100:00100000:1.0:1789305096.467653:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1789305096.467661:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785772544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305096.467713:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785772544:12345-0@lo:400:kworker.0 Request processed in 53us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305096.467720:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1789305096.467735:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1789305096.467742:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785772160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305096.467776:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785772160:12345-0@lo:400:kworker.0 Request processed in 35us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305096.467782:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00080000:1.0:1789305096.467797:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305096.467830:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785772160:0@lo:400:kworker.0 00000100:00100000:1.0:1789305096.467929:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785772544:0@lo:400:kworker.0 00000100:00100000:0.0:1789305096.468022:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785772416 00000100:00100000:0.0:1789305096.468026:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785772416 00000100:00100000:0.0:1789305096.468065:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785772032 00000100:00100000:0.0:1789305096.468068:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785772032 00000100:00100000:0.0:1789305096.468082:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785772288 00000100:00100000:0.0:1789305096.468084:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785772288 00000100:00100000:0.0:1789305096.468120:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1789305096.468127:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785772416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305096.468161:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785772416:12345-0@lo:400:kworker.0 Request processed in 35us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305096.468166:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1789305096.468177:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:0.0:1789305096.468182:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785772032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305096.468201:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b0115b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785772032:12345-0@lo:400:kworker.0 Request processed in 20us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305096.468206:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00100000:0.0:1789305096.468214:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:0.0:1789305096.468219:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785772288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305096.468241:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785772288:12345-0@lo:400:kworker.0 Request processed in 22us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305096.468247:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00100000:0.0:1789305096.468282:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785772288:0@lo:400:kworker.0 00000100:00100000:0.0:1789305096.468300:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785772032:0@lo:400:kworker.0 00000100:00100000:0.0:1789305096.468307:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785772416:0@lo:400:kworker.0 00000100:00100000:3.0:1789305096.468372:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785771904 00000100:00100000:3.0:1789305096.468376:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785771904 00000100:00100000:3.0:1789305096.468406:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1789305096.468412:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785771904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305096.468449:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785771904:12345-0@lo:400:kworker.0 Request processed in 37us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305096.468454:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:0.0:1789305096.468523:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785771904:0@lo:400:kworker.0 00000100:00080000:1.0:1789305096.468570:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789305096.535551:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305096.980389:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785772672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305096.980488:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305096.982183:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785772672 00000100:00100000:3.0:1789305096.982204:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785772672 00000100:00100000:3.0:1789305096.982295:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:3.0:1789305096.982307:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785772672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789305096.982363:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305096.991820:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785772672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9499us (11316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305096.991841:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:0.0:1789305096.992362:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785772672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789305097.554299:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305098.580220:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305099.603417:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305100.627214:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789305100.865796:0:101893:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 23a: test mapped regular ACLs ========= 09:11:39 (1789305099) 00000100:00100000:0.0:1789305101.075625:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785772800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305101.075710:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305101.078124:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785772800 00000100:00100000:2.0:1789305101.078141:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785772800 00000100:00100000:2.0:1789305101.078226:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1789305101.078236:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785772800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305101.078274:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305101.078354:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785772800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305101.078361:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00080000:2.0:1789305101.078399:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305101.078446:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785772800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305101.155074:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305101.155176:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305101.155201:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305101.155239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305101.155286:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765712896 00000100:00100000:3.0:1789305101.155299:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765712896 00000100:00100000:1.0:1789305101.155322:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765713280 00000100:00100000:1.0:1789305101.155329:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765713280 00000100:00100000:3.0:1789305101.155364:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1411 00000100:00100000:3.0:1789305101.155376:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765712896:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305101.155379:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765713152 00000100:00100000:1.0:1789305101.155384:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765713152 00000100:00100000:1.0:1789305101.155409:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1429 00000100:00100000:1.0:1789305101.155419:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765713280:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305101.155463:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765712896:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305101.155464:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765713280:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305101.155482:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1429 00000100:00100000:3.0:1789305101.155483:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1411 00000100:00100000:1.0:1789305101.155507:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1430 00000100:00100000:1.0:1789305101.155515:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765713152:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305101.155543:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765713152:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305101.155549:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1430 00000100:00080000:1.0:1789305101.155571:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789305101.155576:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305101.155689:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765713024 00000100:00100000:2.0:1789305101.155693:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765713024 00000100:00100000:2.0:1789305101.155737:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1838 00000100:00100000:2.0:1789305101.155744:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765713024:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305101.155776:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2356:x1876219765713024:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305101.155782:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1838 00000100:00080000:1.0:1789305101.155844:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305101.586357:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785773312:0@lo:400:kworker.0 00000100:00100000:1.0:1789305101.586438:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305101.586500:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305101.586506:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785773184:0@lo:400:kworker.0 00000100:00100000:1.0:1789305101.586533:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305101.586570:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785773184 00000100:00100000:1.0:1789305101.586581:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785773184 00000100:00100000:1.0:1789305101.586642:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1789305101.586651:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785773184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305101.586722:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785773184:12345-0@lo:400:kworker.0 Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305101.586730:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00080000:1.0:1789305101.586752:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305101.586876:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785773056:0@lo:400:kworker.0 00000100:00100000:3.0:1789305101.586907:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305101.586942:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785773568:0@lo:400:kworker.0 00000100:00100000:3.0:1789305101.586962:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305101.586991:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789305101.586998:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785772928:0@lo:400:kworker.0 00000100:00100000:3.0:1789305101.587025:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305101.587044:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785773440:0@lo:400:kworker.0 00000100:00100000:3.0:1789305101.587065:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305101.587318:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785773184:0@lo:400:kworker.0 00000100:00100000:1.0:1789305101.587346:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785773568 00000100:00100000:1.0:1789305101.587351:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785773568 00000100:00100000:1.0:1789305101.587378:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1789305101.587385:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785773568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305101.587427:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785773568:12345-0@lo:400:kworker.0 Request processed in 42us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305101.587433:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1789305101.587467:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785773568:0@lo:400:kworker.0 00000100:00100000:0.0:1789305101.587649:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785773312 00000100:00100000:0.0:1789305101.587654:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785773312 00000100:00100000:0.0:1789305101.587764:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785773056 00000100:00100000:0.0:1789305101.587768:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785773056 00000100:00100000:0.0:1789305101.587940:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785773440 00000100:00100000:0.0:1789305101.587945:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785773440 00000100:00080000:1.0:1789305101.587996:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305101.592593:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1789305101.592614:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785773312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305101.592739:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785773312:12345-0@lo:400:kworker.0 Request processed in 133us (6301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305101.592748:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1789305101.592774:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:3.0:1789305101.592792:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785773056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305101.592831:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785773056:12345-0@lo:400:kworker.0 Request processed in 50us (5923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305101.592838:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00100000:3.0:1789305101.592851:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:3.0:1789305101.592858:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785773440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305101.592889:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785773440:12345-0@lo:400:kworker.0 Request processed in 32us (5822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305101.592894:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00100000:3.0:1789305101.592964:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785772928 00000100:00100000:3.0:1789305101.596516:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785772928 00000100:00100000:3.0:1789305101.596596:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1789305101.596607:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785772928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305101.597199:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785772928:0@lo:400:kworker.0 00000100:00100000:0.0:1789305101.597219:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785773440:0@lo:400:kworker.0 00000100:00100000:0.0:1789305101.597232:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785773056:0@lo:400:kworker.0 00000100:00100000:0.0:1789305101.597290:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785773312:0@lo:400:kworker.0 00000100:00100000:3.0:1789305101.597397:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785772928:12345-0@lo:400:kworker.0 Request processed in 792us (10370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305101.597406:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00010000:00010000:1.0:1789305101.650352:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305102.101015:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785773696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305102.101129:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305102.101239:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785773696 00000100:00100000:2.0:1789305102.101249:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785773696 00000100:00100000:2.0:1789305102.101303:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:2.0:1789305102.101313:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785773696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789305102.101349:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305102.104532:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785773696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3210us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305102.104560:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:0.0:1789305102.104924:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785773696:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789305102.278721:0:101941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_23a Need 2 clients at least 00010000:00010000:2.0:1789305102.674336:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305103.713640:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789305104.201990:0:101989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 23b: test mapped default ACLs ========= 09:11:42 (1789305102) 00010000:00010000:1.0:1789305104.724738:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789305105.418779:0:102038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_23b Need 2 clients at least 00010000:00010000:2.0:1789305105.746600:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305106.194408:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785773824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305106.194486:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305106.194628:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785773824 00000100:00100000:3.0:1789305106.194638:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785773824 00000100:00100000:3.0:1789305106.194706:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1789305106.194716:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785773824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789305106.194758:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305106.194820:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785773824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305106.194827:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:0.0:1789305106.194956:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785773824:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789305106.195023:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305106.295652:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305106.295700:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305106.295728:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765713408 00000100:00100000:0.0:1789305106.295740:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765713408 00000100:00100000:1.0:1789305106.295796:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765713536 00000100:00100000:1.0:1789305106.295801:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765713536 00000100:00100000:0.0:1789305106.295814:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1413 00000100:00100000:0.0:1789305106.295826:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765713408:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305106.295882:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1842 00000100:00100000:1.0:1789305106.295892:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765713536:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305106.295906:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765713408:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 81us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305106.295915:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1413 00000100:00100000:1.0:1789305106.295929:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2355:x1876219765713536:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305106.295936:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1842 00000100:00080000:2.0:1789305106.296019:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305106.303501:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305106.303536:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305106.303608:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765713664 00000100:00100000:1.0:1789305106.303618:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765713664 00000100:00100000:1.0:1789305106.303675:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765713792 00000100:00100000:1.0:1789305106.303678:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765713792 00000100:00100000:1.0:1789305106.303698:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 691 00000100:00100000:1.0:1789305106.303706:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765713664:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:1.0:1789305106.303737:0:17212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb72312978b1 00000100:00080000:1.0:1789305106.303755:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2c04ebf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789305106.303793:0:17212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1789305106.304132:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765713664:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 424us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305106.304140:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 691 00000100:00100000:1.0:1789305106.304353:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 692 00000100:00100000:1.0:1789305106.304362:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2353:x1876219765713792:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:1.0:1789305106.304377:0:17212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231297960 00000100:00080000:1.0:1789305106.304383:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2c20272800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789305106.304405:0:17212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1789305106.304554:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:99087288-e673-4cc7-b2df-ca113c20dacd+2:2353:x1876219765713792:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 193us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305106.304561:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 692 00010000:00010000:1.0:1789305106.304593:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305106.304600:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789305106.304905:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789305106.304910:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305106.706349:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785774208:0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.706425:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305106.706484:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789305106.706490:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785774336:0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.706515:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305106.706553:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785774208 00000100:00100000:1.0:1789305106.706561:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785774208 00000100:00100000:1.0:1789305106.706615:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1789305106.706625:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785774208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.706677:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785774208:12345-0@lo:400:kworker.0 Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305106.706685:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1789305106.706709:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785774336 00000100:00100000:1.0:1789305106.706712:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785774336 00000100:00100000:1.0:1789305106.706739:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:1.0:1789305106.706745:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785774336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.706774:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785774336:12345-0@lo:400:kworker.0 Request processed in 30us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305106.706780:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00080000:1.0:1789305106.706796:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789305106.706801:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305106.706833:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785774336:0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.706844:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785774208:0@lo:400:kworker.0 00000100:00100000:2.0:1789305106.707117:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785773952:0@lo:400:kworker.0 00000100:00100000:2.0:1789305106.707172:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305106.707203:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785774464:0@lo:400:kworker.0 00000100:00100000:2.0:1789305106.707226:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305106.707242:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789305106.707247:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785774080:0@lo:400:kworker.0 00000100:00100000:2.0:1789305106.707266:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305106.707279:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785774592:0@lo:400:kworker.0 00000100:00100000:2.0:1789305106.707297:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305106.707998:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785773952 00000100:00100000:1.0:1789305106.708006:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785773952 00000100:00100000:1.0:1789305106.708055:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1789305106.708063:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785773952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.708308:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785773952:12345-0@lo:400:kworker.0 Request processed in 245us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305106.708315:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1789305106.708351:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785774464 00000100:00100000:1.0:1789305106.708355:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785774464 00000100:00100000:1.0:1789305106.708383:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785774080 00000100:00100000:1.0:1789305106.708385:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785774080 00000100:00100000:1.0:1789305106.708401:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:1.0:1789305106.708406:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785774464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.708437:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785774464:12345-0@lo:400:kworker.0 Request processed in 31us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305106.708443:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:1.0:1789305106.708454:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845 00000100:00100000:1.0:1789305106.708460:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785774080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.708486:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785774080:12345-0@lo:400:kworker.0 Request processed in 26us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305106.708490:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845 00000100:00100000:1.0:1789305106.708510:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785774592 00000100:00100000:1.0:1789305106.708513:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785774592 00000100:00100000:1.0:1789305106.708542:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1789305106.708548:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785774592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.708575:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785774592:12345-0@lo:400:kworker.0 Request processed in 28us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305106.708581:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00080000:1.0:1789305106.708599:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305106.708629:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785774080:0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.708639:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785774592:0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.708647:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785773952:0@lo:400:kworker.0 00000100:00100000:1.0:1789305106.708656:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785774464:0@lo:400:kworker.0 00010000:00010000:3.0:1789305106.779439:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789305107.063316:0:102086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 24: check nodemap proc files for LBUGs and Oopses ========================================================== 09:11:45 (1789305105) 00000100:00100000:2.0:1789305107.225766:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789305107.225789:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785774720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305107.225863:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305107.225935:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785774720 00000100:00100000:2.0:1789305107.225943:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785774720 00000100:00100000:2.0:1789305107.225993:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1789305107.226002:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785774720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789305107.226039:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305107.226084:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785774720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305107.226128:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1789305107.226178:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785774720:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789305107.765752:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789305107.765762:0:6723:0:(genops.c:885:class_export_put()) final put ffff9e2c04ebd800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789305107.765955:0:490:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c04ebd800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0000 00000020:00000080:0.0:1789305107.766009:0:490:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c04ebf800 for lustre-OST0000 00000001:00100000:2.0:1789305107.772768:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:2.0:1789305107.772778:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2c20271000/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:0.0:1789305107.772850:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c20271000/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-OST0001 00000020:00000080:0.0:1789305107.773011:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c20272800 for lustre-OST0001 00010000:00010000:1.0:1789305107.796770:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:3.0:1789305107.944485:0:102137:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:3.0:1789305107.950663:0:102137:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:3.0:1789305108.818235:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789305108.835742:0:102185:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd77be9020 20000000:00000080:3.0:1789305108.835761:0:102185:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412ab800 uarg=0000000000000000 10000000:01000000:3.0:1789305108.836402:0:102185:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305108.836419:0:102185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305108.836434:0:102185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297ffe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231297ff7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305108.836440:0:102185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305108.836472:0:102185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297ffe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231297ff7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305108.836486:0:102185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297ffe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231297ff7 expref: 18 pid: 5846 timeout: 2658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305108.836502:0:102185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102185:1876219785774848:0@lo:104: 00000100:00100000:3.0:1789305108.836560:0:102185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305108.836606:0:102185:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789305108.836679:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785774848 00000100:00100000:0.0:1789305108.836685:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785774848 00000100:00100000:0.0:1789305108.836726:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789305108.836735:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:102185:x1876219785774848:12345-0@lo:104: 00010000:00010000:0.0:1789305108.836748:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.836807:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305108.836814:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:102185:x1876219785774848:12345-0@lo:104: Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305108.836820:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789305108.836824:0:102185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102185:1876219785774848:0@lo:104: 00010000:00010000:1.0:1789305108.836840:0:102185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305108.836895:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305108.836902:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305108.836909:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789305108.836912:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305108.836922:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789305108.836928:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305108.836933:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789305108.836974:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305108.836981:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789305108.837010:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305108.837023:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231297ff7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231297ffe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305108.837039:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305108.837040:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305108.837042:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305108.837053:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785774976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789305108.837081:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305108.837132:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785774976 00000100:00100000:0.0:1789305108.837136:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785774976 00010000:00010000:0.0:1789305108.837153:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297ffe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297ff7 expref: 19 pid: 5846 timeout: 2658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305108.837185:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1789305108.837192:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785774976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305108.837203:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305108.837208:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297ffe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231297ff7 expref: 19 pid: 5846 timeout: 2658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837220:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297ffe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231297ff7 expref: 19 pid: 5846 timeout: 2658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837232:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231297ffe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231297ff7 expref: 19 pid: 5846 timeout: 2658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837244:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837255:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837267:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837274:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837282:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837288:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837293:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305108.837297:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837305:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837314:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305108.837322:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305108.837349:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785774976:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305108.837355:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:2.0:1789305108.837411:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785774976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305108.837451:0:102185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305108.837459:0:102185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305108.837466:0:102185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e000/0xefc0bb7231298005 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789305109.503713:0:102233:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff016115a0 20000000:00000080:3.0:1789305109.503731:0:102233:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02056400 uarg=0000000000000000 10000000:01000000:3.0:1789305109.504633:0:102233:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305109.504661:0:102233:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.504678:0:102233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.504688:0:102233:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.504694:0:102233:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.504701:0:102233:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.504708:0:102233:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.504714:0:102233:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305109.504717:0:102233:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.504725:0:102233:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.504738:0:102233:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.504749:0:102233:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.504755:0:102233:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129800c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.842334:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305109.907258:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305109.907267:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305109.907272:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305109.907328:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305109.907341:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305109.907354:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305109.907384:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785775104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305109.907472:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305109.907528:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38835c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789305109.907580:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785775104 00000100:00100000:3.0:1789305109.907590:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785775104 00000100:00100000:3.0:1789305109.907651:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1789305109.907662:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785775104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305109.907675:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305109.907688:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129801a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298013 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.907711:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129801a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298013 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.907722:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129801a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298013 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.907731:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fc00, rc 0) 00000100:00100000:3.0:1789305109.907776:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785775104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305109.907782:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1789305109.907828:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785775104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305109.907855:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.907865:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305109.907884:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789305109.907903:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305109.907911:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789305110.166070:0:102281:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce8f8e1e0 20000000:00000080:1.0:1789305110.166085:0:102281:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f657c00 uarg=0000000000000000 10000000:01000000:1.0:1789305110.166414:0:102281:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305110.166434:0:102281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305110.166453:0:102281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129801a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298013 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305110.166462:0:102281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305110.166498:0:102281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129801a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231298013 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305110.166512:0:102281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129801a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231298013 expref: 18 pid: 5845 timeout: 2659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305110.166525:0:102281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102281:1876219785775232:0@lo:104: 00000100:00100000:1.0:1789305110.166588:0:102281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305110.166698:0:102281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f6a5780 going to sleep for 11 seconds 00000100:00100000:3.0:1789305110.166850:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785775232 00000100:00100000:3.0:1789305110.166858:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785775232 00000100:00100000:3.0:1789305110.167013:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789305110.167021:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:102281:x1876219785775232:12345-0@lo:104: 00010000:00010000:3.0:1789305110.167031:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305110.167169:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305110.167175:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305110.167180:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afba00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305110.167183:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305110.167189:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305110.167194:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305110.167197:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789305110.167222:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305110.167229:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305110.167243:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305110.167248:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afba00/0xefc0bb7231298013 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129801a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305110.167259:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305110.167260:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305110.167261:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305110.167274:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785775360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305110.167300:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789305110.167349:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789305110.167354:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:102281:x1876219785775232:12345-0@lo:104: Request processed in 335us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305110.167359:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789305110.167400:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785775360 00000100:00100000:2.0:1789305110.167403:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785775360 00010000:00010000:2.0:1789305110.167418:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129801a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298013 expref: 19 pid: 5845 timeout: 2659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305110.167438:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1789305110.167442:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c200d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785775360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305110.167450:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305110.167454:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129801a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298013 expref: 19 pid: 5845 timeout: 2659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167461:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129801a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231298013 expref: 19 pid: 5845 timeout: 2659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167472:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167481:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167495:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167501:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167509:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167515:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167520:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305110.167523:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167529:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167537:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167546:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789305110.167575:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c200d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785775360:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305110.167581:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00010000:00010000:2.0:1789305110.167647:0:102281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fc00/0xefc0bb723129801a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231298013 expref: 18 pid: 5845 timeout: 2659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305110.167658:0:102281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102281:1876219785775232:0@lo:104: 00010000:00010000:2.0:1789305110.167675:0:102281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167684:0:102281:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167691:0:102281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305110.167697:0:102281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370400/0xefc0bb7231298021 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305110.168370:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785775360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305110.866254:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789305110.974158:0:102330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde4c90c90 20000000:00000080:3.0:1789305110.974175:0:102330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412aac00 uarg=0000000000000000 10000000:01000000:3.0:1789305110.974562:0:102330:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305110.974589:0:102330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305110.974609:0:102330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305110.974621:0:102330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305110.974628:0:102330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305110.974636:0:102330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305110.974643:0:102330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305110.974650:0:102330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ec00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305110.974655:0:102330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305110.974665:0:102330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305110.974679:0:102330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305110.974688:0:102330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305110.974694:0:102330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb7231298028 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305111.314292:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305111.316477:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785775488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305111.316540:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305111.320269:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785775488 00000100:00100000:2.0:1789305111.320285:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785775488 00000100:00100000:2.0:1789305111.320404:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1789305111.320415:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785775488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305111.320456:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305111.320546:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785775488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305111.320554:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1789305111.320919:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785775488:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789305111.321913:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305111.397138:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305111.397187:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305111.397275:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765714048 00000100:00100000:0.0:1789305111.397285:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765714048 00000100:00100000:0.0:1789305111.397366:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1846 00000100:00100000:0.0:1789305111.397377:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765714048:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305111.397454:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765714048:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305111.397462:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1846 00000100:00080000:3.0:1789305111.397604:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305111.397985:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765713920 00000100:00100000:2.0:1789305111.397991:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765713920 00000100:00100000:2.0:1789305111.398031:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1416 00000100:00100000:2.0:1789305111.398040:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765713920:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305111.398074:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2355:x1876219765713920:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 36us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305111.398081:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1416 00000020:00000080:0.0:1789305111.611399:0:102378:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc97d122a0 20000000:00000080:0.0:1789305111.611414:0:102378:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f763400 uarg=0000000000000000 10000000:01000000:0.0:1789305111.611604:0:102378:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789305111.611626:0:102378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.611641:0:102378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.611653:0:102378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.611659:0:102378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.611666:0:102378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.611672:0:102378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.611678:0:102378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305111.611683:0:102378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.611690:0:102378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.611703:0:102378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.611710:0:102378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.611717:0:102378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129802f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305111.831444:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785775616:0@lo:400:kworker.0 00000100:00100000:1.0:1789305111.831524:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305111.831659:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785775616 00000100:00100000:0.0:1789305111.831668:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785775616 00000100:00100000:0.0:1789305111.831719:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1789305111.831728:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785775616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.831919:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785775744:0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.831952:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305111.831987:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785776256:0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.832011:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305111.832031:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789305111.832037:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785776128:0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.832059:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305111.832085:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785775872:0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.832128:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305111.832147:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789305111.832152:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785776000:0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.832172:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305111.832200:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785775744 00000100:00100000:2.0:1789305111.832204:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785775744 00000100:00100000:2.0:1789305111.836143:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785776128 00000100:00100000:2.0:1789305111.836161:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785776128 00000100:00100000:2.0:1789305111.836241:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785776000 00000100:00100000:2.0:1789305111.836244:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785776000 00000100:00100000:2.0:1789305111.836268:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:2.0:1789305111.836277:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785775744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.836372:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785775744:12345-0@lo:400:kworker.0 Request processed in 96us (4419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305111.836379:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:2.0:1789305111.836397:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:2.0:1789305111.836403:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785776128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.836432:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785776128:12345-0@lo:400:kworker.0 Request processed in 30us (4372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305111.836440:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00100000:2.0:1789305111.836452:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:2.0:1789305111.836457:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785776000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.836489:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785776000:12345-0@lo:400:kworker.0 Request processed in 32us (4315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305111.836495:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00100000:2.0:1789305111.836522:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785776256 00000100:00100000:2.0:1789305111.836526:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785776256 00000100:00100000:2.0:1789305111.836551:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785775872 00000100:00100000:2.0:1789305111.836554:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785775872 00000100:00100000:2.0:1789305111.836573:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1789305111.836579:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785776256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.836609:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785776256:12345-0@lo:400:kworker.0 Request processed in 31us (4597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305111.836616:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1789305111.836627:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1789305111.836632:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785775872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.836658:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785775872:12345-0@lo:400:kworker.0 Request processed in 26us (4529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305111.836663:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00080000:2.0:1789305111.836693:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789305111.836697:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305111.836743:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785776000:0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.836756:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785775872:0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.836792:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785776128:0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.836804:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785775744:0@lo:400:kworker.0 00000100:00100000:2.0:1789305111.836813:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785776256:0@lo:400:kworker.0 00000100:00100000:0.0:1789305111.837348:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785775616:12345-0@lo:400:kworker.0 Request processed in 5618us (5820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305111.837359:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1789305111.839512:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785775616:0@lo:400:kworker.0 00010000:00010000:2.0:1789305111.899315:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305111.955324:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305111.955333:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305111.955339:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305111.955384:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.955398:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305111.955411:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305111.955437:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785776384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305111.955508:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305111.955560:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c2ea1eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789305111.955615:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785776384 00000100:00100000:3.0:1789305111.955624:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785776384 00000100:00100000:3.0:1789305111.955676:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1789305111.955684:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785776384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305111.955697:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305111.955709:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ec00/0xefc0bb723129803d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298036 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305111.955731:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ec00/0xefc0bb723129803d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298036 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305111.955740:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb723129803d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298036 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305111.955749:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ec00, rc 0) 00000100:00100000:3.0:1789305111.955800:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785776384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305111.955806:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:2.0:1789305111.955945:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785776384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305111.955960:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305111.956059:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305111.956082:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789305111.956087:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305111.956119:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305112.338282:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789305112.338305:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785776512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305112.338375:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305112.338532:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785776512 00000100:00100000:1.0:1789305112.338541:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785776512 00000100:00100000:1.0:1789305112.338636:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:1.0:1789305112.338647:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785776512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305112.338684:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305112.338785:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785776512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305112.338792:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:0.0:1789305112.338915:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785776512:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789305112.524839:0:102426:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff94338870 20000000:00000080:1.0:1789305112.524858:0:102426:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c38747000 uarg=0000000000000000 10000000:01000000:1.0:1789305112.525367:0:102426:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305112.525389:0:102426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305112.525408:0:102426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb723129803d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298036 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305112.525416:0:102426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305112.525452:0:102426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860ec00/0xefc0bb723129803d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231298036 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305112.525466:0:102426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb723129803d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231298036 expref: 18 pid: 5847 timeout: 2662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305112.525479:0:102426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102426:1876219785776640:0@lo:104: 00000100:00100000:1.0:1789305112.525542:0:102426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305112.525632:0:102426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b024b50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305112.525680:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785776640 00000100:00100000:0.0:1789305112.525800:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785776640 00000100:00100000:0.0:1789305112.525957:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789305112.525967:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:102426:x1876219785776640:12345-0@lo:104: 00010000:00010000:0.0:1789305112.525982:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.526056:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305112.526062:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:102426:x1876219785776640:12345-0@lo:104: Request processed in 97us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305112.526069:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789305112.526202:0:102426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102426:1876219785776640:0@lo:104: 00010000:00010000:2.0:1789305112.526219:0:102426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305112.526301:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789305112.526309:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305112.526317:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789305112.526323:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305112.526337:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789305112.526345:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305112.526352:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789305112.526382:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305112.526388:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305112.526413:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305112.526420:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb7231298036 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305112.526435:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305112.526437:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305112.526439:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305112.526447:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305112.526458:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785776768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305112.526493:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305112.526969:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785776768 00000100:00100000:0.0:1789305112.526976:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785776768 00010000:00010000:0.0:1789305112.527002:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860ec00/0xefc0bb723129803d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298036 expref: 19 pid: 5847 timeout: 2662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305112.527081:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1789305112.527116:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785776768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305112.527129:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305112.527135:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860ec00/0xefc0bb723129803d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298036 expref: 19 pid: 5847 timeout: 2662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527146:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860ec00/0xefc0bb723129803d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231298036 expref: 19 pid: 5847 timeout: 2662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527159:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb723129803d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231298036 expref: 19 pid: 5847 timeout: 2662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527173:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527181:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527197:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527205:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527217:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527225:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527231:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371c00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305112.527236:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527243:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527262:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305112.527272:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305112.527314:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785776768:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305112.527321:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00010000:00010000:1.0:1789305112.527384:0:102426:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305112.527406:0:102426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305112.527413:0:102426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371c00/0xefc0bb7231298044 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305112.529077:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785776768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305112.917547:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305113.938566:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305114.323244:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305114.323258:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305114.323266:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305114.323333:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305114.323351:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305114.323366:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305114.323401:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785776896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305114.323499:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305114.323568:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388c8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789305114.323628:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785776896 00000100:00100000:3.0:1789305114.323639:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785776896 00000100:00100000:3.0:1789305114.323707:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1789305114.323718:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785776896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305114.323736:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305114.323754:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231298052 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129804b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305114.323785:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231298052 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129804b expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305114.323807:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231298052 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129804b expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305114.323819:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f000, rc 0) 00000100:00100000:3.0:1789305114.323894:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785776896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305114.323902:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:2.0:1789305114.324070:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785776896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305114.324136:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305114.324148:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305114.324174:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789305114.324180:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305114.324189:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305114.962287:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789305115.697044:0:102576:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdccc60360 20000000:00000080:0.0:1789305115.697071:0:102576:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c413e3400 uarg=0000000000000000 10000000:01000000:0.0:1789305115.699565:0:102576:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789305115.699605:0:102576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305115.699632:0:102576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231298052 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129804b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305115.699642:0:102576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305115.699702:0:102576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231298052 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129804b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305115.699738:0:102576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231298052 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129804b expref: 18 pid: 5845 timeout: 2665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305115.699756:0:102576:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1876219785777024:0@lo:104: 00000100:00100000:0.0:1789305115.700047:0:102576:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305115.700479:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785777024 00000100:00100000:3.0:1789305115.700492:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785777024 00000100:00100000:3.0:1789305115.700651:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789305115.700663:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:102576:x1876219785777024:12345-0@lo:104: 00010000:00010000:3.0:1789305115.700681:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305115.701084:0:102576:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0621f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789305115.701153:0:102576:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102576:1876219785777024:0@lo:104: 00010000:00010000:2.0:1789305115.701181:0:102576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305115.701357:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305115.701367:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:102576:x1876219785777024:12345-0@lo:104: Request processed in 705us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305115.701376:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00010000:00010000:2.0:1789305115.701616:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305115.701625:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.701634:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789305115.701639:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.701650:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789305115.701663:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305115.701669:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789305115.701762:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.701769:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789305115.701814:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.701821:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb723129804b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298052 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.701853:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305115.701855:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305115.701857:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305115.701910:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785777152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789305115.701974:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305115.705586:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785777152 00000100:00100000:2.0:1789305115.705607:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785777152 00010000:00010000:2.0:1789305115.705685:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231298052 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129804b expref: 19 pid: 5845 timeout: 2665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305115.705742:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1789305115.705752:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785777152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305115.705771:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305115.705777:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231298052 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129804b expref: 19 pid: 5845 timeout: 2665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705804:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231298052 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129804b expref: 19 pid: 5845 timeout: 2665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705827:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f000/0xefc0bb7231298052 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129804b expref: 19 pid: 5845 timeout: 2665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705864:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705875:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705897:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705906:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705913:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705919:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705926:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305115.705932:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705942:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705963:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.705982:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789305115.706108:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785777152:12345-0@lo:103:ldlm_bl.0 Request processed in 336us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305115.706117:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1789305115.706180:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785777152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305115.706222:0:102576:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.706231:0:102576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305115.706238:0:102576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb400/0xefc0bb7231298059 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305115.987564:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305116.457422:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785777280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305116.457521:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305116.457638:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785777280 00000100:00100000:2.0:1789305116.457665:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785777280 00000100:00100000:2.0:1789305116.457750:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1789305116.457762:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785777280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305116.457816:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789305116.457867:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305116.457888:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785777280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305116.457897:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1789305116.457959:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785777280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305116.516310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305116.516380:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305116.516425:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765714304 00000100:00100000:3.0:1789305116.516439:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765714304 00000100:00100000:3.0:1789305116.516546:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1850 00000100:00100000:3.0:1789305116.516558:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765714304:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1789305116.516606:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305116.516662:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765714304:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 107us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305116.516672:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1850 00000100:00100000:3.0:1789305116.516706:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765714176 00000100:00100000:3.0:1789305116.516711:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765714176 00000100:00100000:3.0:1789305116.516740:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1420 00000100:00100000:3.0:1789305116.516750:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765714176:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305116.516792:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765714176:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305116.516800:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1420 00000020:00000080:1.0:1789305116.534325:0:102624:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde2fa0a50 20000000:00000080:1.0:1789305116.534355:0:102624:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c149a3800 uarg=0000000000000000 10000000:01000000:1.0:1789305116.534647:0:102624:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305116.534679:0:102624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305116.534700:0:102624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305116.534713:0:102624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305116.534721:0:102624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305116.534729:0:102624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305116.534737:0:102624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305116.534744:0:102624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789305116.534750:0:102624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305116.534759:0:102624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305116.534775:0:102624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305116.539855:0:102624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305116.539866:0:102624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370600/0xefc0bb7231298060 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305116.818167:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789305116.818174:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789305116.818179:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789305116.818224:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305116.818234:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305116.818243:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305116.818262:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785777408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789305116.818322:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305116.818378:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785777408 00000100:00100000:0.0:1789305116.818388:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785777408 00000100:00100000:3.0:1789305116.818451:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c27dd7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789305116.818451:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1789305116.818466:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785777408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305116.818480:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305116.818494:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129806e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298067 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305116.818517:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129806e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298067 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305116.818528:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129806e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298067 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305116.818537:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbc00, rc 0) 00000100:00100000:0.0:1789305116.818684:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785777408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305116.818691:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1789305116.818764:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785777408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305116.818791:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305116.818804:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305116.818822:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789305116.818829:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305116.818837:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305116.949421:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785777536:0@lo:400:kworker.0 00000100:00100000:0.0:1789305116.949495:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305116.949613:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785777536 00000100:00100000:3.0:1789305116.949621:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785777536 00000100:00100000:3.0:1789305116.949676:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:3.0:1789305116.949686:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785777536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305116.949806:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785777536:12345-0@lo:400:kworker.0 Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305116.949814:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00100000:1.0:1789305116.950497:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785777664:0@lo:400:kworker.0 00000100:00100000:1.0:1789305116.950545:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305116.950587:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785777792:0@lo:400:kworker.0 00000100:00100000:1.0:1789305116.950627:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305116.950651:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789305116.950657:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785777920:0@lo:400:kworker.0 00000100:00100000:1.0:1789305116.950674:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305116.950701:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785777664 00000100:00100000:1.0:1789305116.950810:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785777664 00000100:00100000:1.0:1789305116.950857:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1789305116.950865:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785777664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305116.950907:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785777664:12345-0@lo:400:kworker.0 Request processed in 43us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305116.950914:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1789305116.950940:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785777792 00000100:00100000:1.0:1789305116.950944:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785777792 00000100:00100000:1.0:1789305116.950974:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785777920 00000100:00100000:1.0:1789305116.950978:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785777920 00000100:00100000:1.0:1789305116.951013:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:1.0:1789305116.951021:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785777792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305116.951073:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785777792:12345-0@lo:400:kworker.0 Request processed in 53us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305116.951079:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00100000:0.0:1789305116.951081:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785777536:0@lo:400:kworker.0 00000100:00100000:1.0:1789305116.951136:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:1.0:1789305116.951145:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785777920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305116.951183:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785777920:12345-0@lo:400:kworker.0 Request processed in 40us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305116.951192:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00080000:1.0:1789305116.951215:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789305116.951219:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305116.951248:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785777664:0@lo:400:kworker.0 00000100:00100000:1.0:1789305116.951294:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785777920:0@lo:400:kworker.0 00000100:00100000:1.0:1789305116.951306:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785777792:0@lo:400:kworker.0 00010000:00010000:3.0:1789305117.010520:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305117.458362:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789305117.458383:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785778048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305117.458446:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305117.458518:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785778048 00000100:00100000:0.0:1789305117.458526:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785778048 00000100:00100000:0.0:1789305117.458569:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1789305117.458578:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785778048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305117.458613:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305117.458654:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785778048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305117.458661:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1789305117.458700:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785778048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789305118.034261:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305119.059421:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789305119.308008:0:102820:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff21005940 20000000:00000080:1.0:1789305119.308025:0:102820:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f7dbc00 uarg=0000000000000000 00010000:00010000:1.0:1789305119.308315:0:102820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789305119.308330:0:102820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789305119.308346:0:102820:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305119.308368:0:102820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305119.308386:0:102820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129806e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298067 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305119.308394:0:102820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305119.308434:0:102820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129806e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231298067 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305119.308450:0:102820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129806e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231298067 expref: 18 pid: 5847 timeout: 2668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305119.308463:0:102820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102820:1876219785778176:0@lo:104: 00000100:00100000:1.0:1789305119.308531:0:102820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305119.308631:0:102820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305119.308780:0:52683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789305119.310388:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785778176 00000100:00100000:0.0:1789305119.310397:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785778176 00000100:00100000:0.0:1789305119.310493:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1789305119.310504:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c37032850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:102820:x1876219785778176:12345-0@lo:104: 00010000:00010000:0.0:1789305119.310521:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305119.310609:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305119.310616:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c37032850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:102820:x1876219785778176:12345-0@lo:104: Request processed in 115us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305119.310631:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789305119.310743:0:102820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102820:1876219785778176:0@lo:104: 00010000:00010000:2.0:1789305119.310777:0:102820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.310839:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789305119.310848:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.310856:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789305119.310861:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.310871:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789305119.310879:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305119.310886:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789305119.310934:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.310940:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305119.310968:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.310977:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298067 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129806e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.310999:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305119.311001:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305119.311002:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305119.311012:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305119.311027:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785778304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305119.311063:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305119.311128:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785778304 00000100:00100000:3.0:1789305119.311133:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785778304 00010000:00010000:3.0:1789305119.311156:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129806e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298067 expref: 19 pid: 5847 timeout: 2668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305119.311177:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1789305119.311184:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785778304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305119.311195:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305119.311201:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129806e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298067 expref: 19 pid: 5847 timeout: 2668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311211:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129806e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231298067 expref: 19 pid: 5847 timeout: 2668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311225:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129806e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231298067 expref: 19 pid: 5847 timeout: 2668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311240:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311249:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311269:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311276:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311284:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311291:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311296:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305119.311300:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311309:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311320:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305119.311326:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305119.311351:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785778304:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305119.311357:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1789305119.311381:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785778304:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305119.312686:0:102820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305119.312701:0:102820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305119.312709:0:102820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370a00/0xefc0bb7231298075 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305120.087396:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305121.108275:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789305121.171583:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789305121.171591:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789305121.171597:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789305121.171641:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305121.171654:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305121.171666:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305121.171691:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785778432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789305121.171768:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305121.171822:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c371b2480 going to sleep for 11 seconds 00000100:00100000:1.0:1789305121.172040:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785778432 00000100:00100000:1.0:1789305121.172048:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785778432 00000100:00100000:1.0:1789305121.172124:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1789305121.172133:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785778432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305121.172145:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305121.172158:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231298083 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129807c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305121.172179:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231298083 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129807c expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305121.172189:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231298083 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129807c expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305121.172198:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370e00, rc 0) 00000100:00100000:1.0:1789305121.172239:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785778432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305121.172245:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1789305121.172417:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785778432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305121.172433:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305121.172442:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305121.172461:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789305121.172466:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305121.172473:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305121.555046:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785778560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305121.555539:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305121.555751:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785778560 00000100:00100000:2.0:1789305121.555760:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785778560 00000100:00100000:2.0:1789305121.555844:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1789305121.555855:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785778560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305121.555894:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305121.555951:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785778560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305121.555959:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1789305121.556019:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785778560:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789305121.556403:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305121.637783:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305121.637924:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305121.637975:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765714560 00000100:00100000:2.0:1789305121.637987:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765714560 00000100:00100000:2.0:1789305121.638066:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1854 00000100:00100000:2.0:1789305121.638078:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765714560:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305121.638179:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765714560:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305121.638186:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1854 00000100:00080000:3.0:1789305121.638252:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305121.639304:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765714432 00000100:00100000:1.0:1789305121.639314:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765714432 00000100:00100000:1.0:1789305121.639376:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1423 00000100:00100000:1.0:1789305121.639385:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765714432:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305121.639429:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765714432:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 46us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305121.639436:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1423 00000100:00100000:3.0:1789305122.068556:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785778688:0@lo:400:kworker.0 00000100:00100000:3.0:1789305122.068629:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305122.068676:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785779200:0@lo:400:kworker.0 00000100:00100000:3.0:1789305122.070848:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305122.070898:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789305122.070908:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785779072:0@lo:400:kworker.0 00000100:00100000:3.0:1789305122.070930:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305122.070964:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785778816:0@lo:400:kworker.0 00000100:00100000:3.0:1789305122.071127:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305122.071151:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305122.071158:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785778944:0@lo:400:kworker.0 00000100:00100000:2.0:1789305122.071162:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785778688 00000100:00100000:2.0:1789305122.071170:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785778688 00000100:00100000:3.0:1789305122.071188:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305122.071212:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1789305122.071215:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785779200 00000100:00100000:3.0:1789305122.071218:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785779200 00000100:00100000:2.0:1789305122.071222:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785778688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305122.071251:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785779072 00000100:00100000:3.0:1789305122.071254:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785779072 00000100:00100000:3.0:1789305122.071270:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785778816 00000100:00100000:3.0:1789305122.071272:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785778816 00000100:00100000:3.0:1789305122.071285:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:3.0:1789305122.071291:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785779200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305122.071292:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785778688:12345-0@lo:400:kworker.0 Request processed in 72us (2663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305122.071298:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1789305122.071321:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785779200:12345-0@lo:400:kworker.0 Request processed in 30us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305122.071326:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00100000:3.0:1789305122.071338:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:3.0:1789305122.071344:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785779072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305122.071344:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785778944 00000100:00100000:2.0:1789305122.071347:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785778944 00000100:00100000:3.0:1789305122.071371:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785779072:12345-0@lo:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305122.071376:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:3.0:1789305122.071388:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:3.0:1789305122.071395:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785778816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305122.071426:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785778816:12345-0@lo:400:kworker.0 Request processed in 32us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305122.071431:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00080000:3.0:1789305122.071449:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789305122.071453:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305122.071481:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785778816:0@lo:400:kworker.0 00000100:00100000:3.0:1789305122.071535:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785779072:0@lo:400:kworker.0 00000100:00100000:3.0:1789305122.071548:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785778688:0@lo:400:kworker.0 00000100:00100000:3.0:1789305122.071556:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785779200:0@lo:400:kworker.0 00000100:00100000:2.0:1789305122.071571:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1789305122.071578:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785778944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305122.071620:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785778944:12345-0@lo:400:kworker.0 Request processed in 43us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305122.071626:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1789305122.071844:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785778944:0@lo:400:kworker.0 00010000:00010000:1.0:1789305122.136080:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305122.579588:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785779328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305122.579666:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305122.579824:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785779328 00000100:00100000:0.0:1789305122.579833:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785779328 00000100:00100000:0.0:1789305122.579879:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:0.0:1789305122.579889:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785779328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305122.579925:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305122.579973:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785779328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305122.579980:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:0.0:1789305122.580022:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785779328:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1789305122.842737:0:103066:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd7facd70 20000000:00000080:2.0:1789305122.842755:0:103066:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f5f8c00 uarg=0000000000000000 00010000:00010000:2.0:1789305122.847314:0:103066:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789305122.847336:0:103066:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789305122.847365:0:103066:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305122.847384:0:103066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305122.847404:0:103066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231298083 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129807c expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305122.847412:0:103066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305122.847451:0:103066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231298083 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129807c expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305122.847539:0:103066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231298083 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129807c expref: 18 pid: 5845 timeout: 2672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305122.847557:0:103066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103066:1876219785779456:0@lo:104: 00000100:00100000:2.0:1789305122.847690:0:103066:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305122.847888:0:103066:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c388c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789305122.847987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785779456 00000100:00100000:3.0:1789305122.847995:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785779456 00000100:00100000:3.0:1789305122.848085:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789305122.848121:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:103066:x1876219785779456:12345-0@lo:104: 00010000:00010000:3.0:1789305122.848135:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305122.848212:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305122.848218:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:103066:x1876219785779456:12345-0@lo:104: Request processed in 101us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305122.848225:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789305122.848323:0:103066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103066:1876219785779456:0@lo:104: 00010000:00010000:2.0:1789305122.848344:0:103066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848408:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305122.848416:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848423:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305122.848428:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848435:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305122.848442:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305122.848448:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789305122.848485:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848492:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305122.848515:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848522:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc600/0xefc0bb723129807c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298083 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848538:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305122.848540:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305122.848542:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305122.848552:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785779584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305122.848586:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305122.848640:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785779584 00000100:00100000:0.0:1789305122.848644:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785779584 00010000:00010000:0.0:1789305122.848664:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231298083 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129807c expref: 19 pid: 5845 timeout: 2672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305122.848686:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1789305122.848693:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785779584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305122.848704:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305122.848708:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231298083 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129807c expref: 19 pid: 5845 timeout: 2672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848727:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231298083 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129807c expref: 19 pid: 5845 timeout: 2672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848741:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370e00/0xefc0bb7231298083 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129807c expref: 19 pid: 5845 timeout: 2672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848753:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848761:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848784:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848792:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848799:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848805:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848811:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305122.848815:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848822:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848834:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305122.848842:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305122.848865:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b01158a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785779584:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305122.848870:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1789305122.848896:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785779584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305122.849010:0:103066:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305122.849018:0:103066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305122.849025:0:103066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129808a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305123.156948:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789305123.569839:0:103114:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2536a950 20000000:00000080:2.0:1789305123.569864:0:103114:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3700c400 uarg=0000000000000000 00010000:00010000:2.0:1789305123.570228:0:103114:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789305123.570244:0:103114:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789305123.570263:0:103114:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305123.570286:0:103114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305123.570301:0:103114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305123.570313:0:103114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305123.570320:0:103114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305123.570327:0:103114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305123.570335:0:103114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305123.570342:0:103114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305123.570347:0:103114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305123.570355:0:103114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305123.570368:0:103114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305123.570376:0:103114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305123.570383:0:103114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298091 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305124.179834:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789305124.179844:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789305124.179850:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305124.179857:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305124.179908:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305124.179922:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305124.179937:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305124.179968:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f678380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785779712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789305124.180061:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305124.180139:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c2ea1eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789305124.180667:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785779712 00000100:00100000:0.0:1789305124.180677:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785779712 00000100:00100000:0.0:1789305124.180748:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:0.0:1789305124.180871:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785779712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305124.180887:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305124.180906:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129809f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298098 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305124.180933:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129809f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298098 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305124.180944:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129809f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298098 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305124.180953:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afbc00, rc 0) 00000100:00100000:0.0:1789305124.181004:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785779712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305124.181012:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1789305124.181108:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f678380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785779712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305124.181126:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305124.181136:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305124.181156:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789305124.181161:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305124.181169:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789305124.328593:0:103162:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec99588c0 20000000:00000080:0.0:1789305124.328614:0:103162:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412ea400 uarg=0000000000000000 00010000:00010000:0.0:1789305124.328865:0:103162:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789305124.328882:0:103162:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789305124.328902:0:103162:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789305124.328925:0:103162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305124.328944:0:103162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129809f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298098 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305124.328954:0:103162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305124.328997:0:103162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129809f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231298098 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305124.329011:0:103162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129809f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231298098 expref: 18 pid: 5845 timeout: 2674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305124.329026:0:103162:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103162:1876219785779840:0@lo:104: 00000100:00100000:0.0:1789305124.329118:0:103162:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305124.329256:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785779840 00000100:00100000:2.0:1789305124.329264:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785779840 00000100:00100000:2.0:1789305124.329316:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789305124.329325:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:103162:x1876219785779840:12345-0@lo:104: 00010000:00010000:2.0:1789305124.329338:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329393:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789305124.329399:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:103162:x1876219785779840:12345-0@lo:104: Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305124.329405:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00010000:00010000:2.0:1789305124.329428:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305124.329435:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329442:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ea00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789305124.329446:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329453:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789305124.329460:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305124.329465:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789305124.329499:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329506:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789305124.329525:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329536:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ea00/0xefc0bb7231298098 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129809f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329551:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305124.329554:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305124.329555:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305124.329593:0:103162:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305124.329616:0:103162:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103162:1876219785779840:0@lo:104: 00010000:00010000:0.0:1789305124.329634:0:103162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305124.329732:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785779968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305124.329765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305124.329818:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785779968 00000100:00100000:2.0:1789305124.329822:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785779968 00010000:00010000:2.0:1789305124.329842:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129809f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298098 expref: 19 pid: 5845 timeout: 2674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305124.329872:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1789305124.329879:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785779968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305124.329891:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305124.329896:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129809f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298098 expref: 19 pid: 5845 timeout: 2674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329906:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129809f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231298098 expref: 19 pid: 5845 timeout: 2674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329918:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129809f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231298098 expref: 19 pid: 5845 timeout: 2674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329931:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329939:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329956:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329963:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329970:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329976:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329982:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305124.329987:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.329994:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.330006:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305124.330014:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789305124.330040:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785779968:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305124.330047:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00010000:00010000:0.0:1789305124.330233:0:103162:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305124.330241:0:103162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305124.330247:0:103162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb600/0xefc0bb72312980a6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305124.333915:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785779968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305125.202301:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305125.909603:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305125.909613:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305125.909619:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305125.909673:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305125.909687:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305125.909708:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305125.909736:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785780096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305125.909811:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305125.909865:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0614f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789305125.909920:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785780096 00000100:00100000:3.0:1789305125.909929:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785780096 00000100:00100000:3.0:1789305125.910036:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1789305125.910048:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785780096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305125.910063:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305125.910079:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f000/0xefc0bb72312980b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312980ad expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305125.910154:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f000/0xefc0bb72312980b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312980ad expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305125.910165:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860f000/0xefc0bb72312980b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312980ad expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305125.910174:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f000, rc 0) 00000100:00100000:3.0:1789305125.910222:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785780096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305125.910229:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1789305125.910709:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785780096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305125.910726:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305125.910735:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305125.910755:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789305125.910760:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305125.910767:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305126.226960:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305126.676645:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789305126.676671:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785780224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789305126.676764:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305126.676832:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785780224 00000100:00100000:3.0:1789305126.676842:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785780224 00000100:00080000:2.0:1789305126.676880:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305126.676935:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:3.0:1789305126.676947:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785780224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789305126.676997:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305126.677070:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785780224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305126.677077:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1789305126.677147:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785780224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305126.754910:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305126.754978:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765714816 00000100:00100000:3.0:1789305126.754990:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765714816 00000100:00080000:2.0:1789305126.755057:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305126.755063:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1858 00000100:00100000:3.0:1789305126.755074:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765714816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305126.755251:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:99087288-e673-4cc7-b2df-ca113c20dacd+5:2354:x1876219765714816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 178us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305126.755259:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1858 00000100:00100000:0.0:1789305126.755351:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305126.755455:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765714688 00000100:00100000:2.0:1789305126.755460:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765714688 00000100:00100000:2.0:1789305126.755502:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1427 00000100:00100000:2.0:1789305126.755510:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765714688:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305126.755592:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2354:x1876219765714688:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305126.755600:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1427 00000100:00100000:0.0:1789305127.186348:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785780608:0@lo:400:kworker.0 00000100:00100000:0.0:1789305127.186432:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305127.186495:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789305127.186502:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785780736:0@lo:400:kworker.0 00000100:00100000:0.0:1789305127.186529:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305127.186564:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785780608 00000100:00100000:0.0:1789305127.186573:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785780608 00000100:00100000:0.0:1789305127.186630:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1789305127.186638:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785780608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305127.186699:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785780608:12345-0@lo:400:kworker.0 Request processed in 63us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305127.186705:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1789305127.186728:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785780736 00000100:00100000:0.0:1789305127.186730:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785780736 00000100:00100000:0.0:1789305127.186756:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:0.0:1789305127.186762:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785780736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305127.186792:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785780736:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305127.186798:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00080000:0.0:1789305127.186811:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789305127.186816:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305127.186842:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785780736:0@lo:400:kworker.0 00000100:00100000:0.0:1789305127.186848:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785780608:0@lo:400:kworker.0 00000100:00100000:3.0:1789305127.186902:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785780480:0@lo:400:kworker.0 00000100:00100000:3.0:1789305127.186926:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305127.186950:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789305127.186955:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785780352:0@lo:400:kworker.0 00000100:00100000:3.0:1789305127.186995:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305127.187020:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785780864:0@lo:400:kworker.0 00000100:00100000:3.0:1789305127.187042:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305127.187069:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785780352 00000100:00100000:3.0:1789305127.187072:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785780352 00000100:00100000:3.0:1789305127.187125:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1789305127.187132:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785780352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305127.187158:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785780352:12345-0@lo:400:kworker.0 Request processed in 27us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305127.187161:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1789305127.187185:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785780480 00000100:00100000:3.0:1789305127.187188:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785780480 00000100:00100000:3.0:1789305127.187200:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785780864 00000100:00100000:3.0:1789305127.187201:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785780864 00000100:00100000:3.0:1789305127.187214:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:3.0:1789305127.187217:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785780480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305127.187238:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785780480:12345-0@lo:400:kworker.0 Request processed in 20us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305127.187243:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00000100:00100000:3.0:1789305127.187254:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:3.0:1789305127.187260:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785780864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305127.187284:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785780864:12345-0@lo:400:kworker.0 Request processed in 25us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305127.187289:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00000100:00100000:3.0:1789305127.187315:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785780352:0@lo:400:kworker.0 00000100:00100000:3.0:1789305127.187326:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785780864:0@lo:400:kworker.0 00000100:00100000:3.0:1789305127.187334:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785780480:0@lo:400:kworker.0 00000100:00080000:0.0:1789305127.187777:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789305127.255626:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789305127.281751:0:103358:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff3a48320 20000000:00000080:2.0:1789305127.281768:0:103358:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c371f0c00 uarg=0000000000000000 00010000:00010000:2.0:1789305127.282260:0:103358:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789305127.282277:0:103358:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789305127.282297:0:103358:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305127.282316:0:103358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305127.282335:0:103358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f000/0xefc0bb72312980b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312980ad expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305127.282344:0:103358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305127.282385:0:103358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f000/0xefc0bb72312980b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312980ad expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305127.282401:0:103358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860f000/0xefc0bb72312980b4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312980ad expref: 18 pid: 5847 timeout: 2676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305127.282421:0:103358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103358:1876219785780992:0@lo:104: 00000100:00100000:2.0:1789305127.282490:0:103358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305127.282545:0:103358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c36a09300 going to sleep for 11 seconds 00000100:00100000:3.0:1789305127.282640:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785780992 00000100:00100000:3.0:1789305127.282647:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785780992 00000100:00100000:3.0:1789305127.282728:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789305127.282738:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:103358:x1876219785780992:12345-0@lo:104: 00010000:00010000:3.0:1789305127.282750:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.282819:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305127.282825:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:103358:x1876219785780992:12345-0@lo:104: Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305127.282832:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00010000:00010000:3.0:1789305127.282852:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789305127.282857:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.282865:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789305127.282869:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.282877:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789305127.282884:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305127.282889:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789305127.282917:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.282924:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305127.282942:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.282948:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb72312980ad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312980b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.282963:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305127.282965:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305127.282966:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305127.282983:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785781120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305127.283009:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305127.283043:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785781120 00000100:00100000:3.0:1789305127.283047:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785781120 00010000:00010000:3.0:1789305127.283062:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f000/0xefc0bb72312980b4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312980ad expref: 19 pid: 5847 timeout: 2676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305127.283078:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1789305127.283084:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785781120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305127.283116:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305127.283121:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f000/0xefc0bb72312980b4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312980ad expref: 19 pid: 5847 timeout: 2676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283131:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f000/0xefc0bb72312980b4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312980ad expref: 19 pid: 5847 timeout: 2676 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283146:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283154:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283166:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283173:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283179:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283185:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283191:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305127.283194:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283201:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283209:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305127.283219:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305127.283245:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785781120:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305127.283252:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1789305127.283292:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785781120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305127.283380:0:103358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f000/0xefc0bb72312980b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312980ad expref: 18 pid: 5847 timeout: 2676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305127.283390:0:103358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103358:1876219785780992:0@lo:104: 00010000:00010000:1.0:1789305127.283402:0:103358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305127.283410:0:103358:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305127.283417:0:103358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305127.283422:0:103358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc800/0xefc0bb72312980bb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305127.698417:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789305127.698441:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785781248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305127.698509:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305127.698654:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785781248 00000100:00100000:0.0:1789305127.698664:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785781248 00000100:00100000:0.0:1789305127.698732:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1789305127.698742:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785781248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305127.698776:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305127.698877:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785781248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305127.698885:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:3.0:1789305127.706394:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785781248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789305128.274267:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789305128.595721:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789305128.595729:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789305128.595734:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789305128.595783:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305128.595795:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305128.595812:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305128.595835:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785781376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789305128.595903:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305128.595965:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaa600 going to sleep for 11 seconds 00000100:00100000:2.0:1789305128.595982:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785781376 00000100:00100000:2.0:1789305128.595990:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785781376 00000100:00100000:2.0:1789305128.596044:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1789305128.596053:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785781376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305128.596066:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305128.596079:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312980c9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312980c2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305128.596126:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312980c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312980c2 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305128.596137:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312980c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312980c2 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305128.596145:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd000, rc 0) 00000100:00100000:2.0:1789305128.596181:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785781376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305128.596187:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1789305128.596812:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785781376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305128.596830:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305128.596840:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305128.596859:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789305128.596864:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305128.596871:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305129.298314:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305130.322611:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305131.346238:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305131.795045:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785781504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305131.795136:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305131.795266:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785781504 00000100:00100000:3.0:1789305131.795275:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785781504 00000100:00100000:3.0:1789305131.795340:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:3.0:1789305131.795351:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785781504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789305131.795399:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305131.795466:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785781504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305131.795474:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00080000:0.0:1789305131.795761:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789305131.795796:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785781504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305131.877594:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305131.877650:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305131.877733:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765714944 00000100:00100000:3.0:1789305131.877743:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765714944 00000100:00100000:1.0:1789305131.877882:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765715072 00000100:00100000:1.0:1789305131.877887:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765715072 00000100:00100000:3.0:1789305131.877994:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1430 00000100:00100000:3.0:1789305131.878006:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765714944:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305131.878075:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765714944:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305131.878082:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1430 00000100:00100000:1.0:1789305131.878862:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1862 00000100:00100000:1.0:1789305131.878875:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765715072:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305131.878930:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+5:2357:x1876219765715072:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 59us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305131.878938:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1862 00000100:00080000:0.0:1789305131.879255:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305132.311822:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785781888:0@lo:400:kworker.0 00000100:00100000:1.0:1789305132.311896:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305132.311967:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789305132.311974:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785782016:0@lo:400:kworker.0 00000100:00100000:1.0:1789305132.311999:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305132.312032:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785781888 00000100:00100000:1.0:1789305132.312040:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785781888 00000100:00100000:1.0:1789305132.312132:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1789305132.312142:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785781888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305132.312191:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785781888:12345-0@lo:400:kworker.0 Request processed in 51us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305132.312198:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1789305132.312223:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785782016 00000100:00100000:1.0:1789305132.312238:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785782016 00000100:00100000:1.0:1789305132.312264:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:1.0:1789305132.312271:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785782016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305132.312300:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785782016:12345-0@lo:400:kworker.0 Request processed in 30us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305132.312312:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:1.0:1789305132.312348:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785782016:0@lo:400:kworker.0 00000100:00100000:1.0:1789305132.312360:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785781888:0@lo:400:kworker.0 00000100:00100000:2.0:1789305132.312619:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785781632:0@lo:400:kworker.0 00000100:00100000:2.0:1789305132.312669:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305132.312704:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785782144:0@lo:400:kworker.0 00000100:00100000:2.0:1789305132.312739:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305132.312757:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789305132.312763:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785781760:0@lo:400:kworker.0 00000100:00100000:2.0:1789305132.312783:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305132.312812:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785782144 00000100:00100000:2.0:1789305132.312817:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785782144 00000100:00100000:2.0:1789305132.312843:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785781760 00000100:00100000:2.0:1789305132.312846:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785781760 00000100:00100000:2.0:1789305132.312864:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1789305132.312870:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785782144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305132.312903:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785782144:12345-0@lo:400:kworker.0 Request processed in 33us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305132.312909:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1789305132.312921:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1789305132.312927:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785781760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305132.312951:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785781760:12345-0@lo:400:kworker.0 Request processed in 25us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305132.312957:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1789305132.312984:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785781760:0@lo:400:kworker.0 00000100:00100000:2.0:1789305132.312992:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785782144:0@lo:400:kworker.0 00000100:00080000:0.0:1789305132.313576:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789305132.313583:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305132.313737:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785781632 00000100:00100000:1.0:1789305132.313744:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785781632 00000100:00100000:1.0:1789305132.313787:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1789305132.313793:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785781632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305132.313841:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785781632:12345-0@lo:400:kworker.0 Request processed in 48us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305132.313846:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1789305132.313912:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785781632:0@lo:400:kworker.0 00010000:00010000:1.0:1789305132.370358:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305132.818548:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785782272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305132.818658:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305132.818794:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785782272 00000100:00100000:0.0:1789305132.818803:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785782272 00000100:00100000:0.0:1789305132.818858:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1789305132.818868:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785782272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305132.818906:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305132.818960:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785782272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305132.819006:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785782272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305132.819034:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00010000:00010000:3.0:1789305133.394546:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305134.419789:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305135.443333:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789305135.541880:0:103701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25a: test save and reload nodemap config ========================================================== 09:12:14 (1789305134) 00000100:00100000:0.0:1789305136.433205:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305136.433316:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765715200 00000100:00100000:2.0:1789305136.433326:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765715200 00000100:00100000:2.0:1789305136.433411:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1259 00000100:00100000:2.0:1789305136.433422:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+5:62149:x1876219765715200:12345-192.168.202.29@tcp:101:lsof.0 00010000:00010000:2.0:1789305136.433443:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305136.433469:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312980d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100a02 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305136.433534:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312980d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305136.433548:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312980d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305136.433561:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312980d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789305136.433608:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789305136.433612:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789305136.433680:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312980d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305136.433703:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecdc00/0xefc0bb72312980d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a02 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305136.433719:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312980d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a02 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305136.433727:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:2.0:1789305136.433729:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789305136.433742:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc400, rc 0) 00000100:00080000:0.0:1789305136.433971:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305136.433999:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:99087288-e673-4cc7-b2df-ca113c20dacd+6:62149:x1876219765715200:12345-192.168.202.29@tcp:101:lsof.0 Request processed in 579us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305136.434004:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1259 00010000:00010000:3.0:1789305136.466393:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305136.914451:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785782400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305136.914532:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305136.914736:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785782400 00000100:00100000:2.0:1789305136.914756:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785782400 00000100:00100000:2.0:1789305136.914833:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1789305136.914843:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785782400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305136.914878:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305136.914922:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785782400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305136.914930:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1789305136.915233:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785782400:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789305136.915567:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305136.993303:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305136.993434:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765715328 00000100:00100000:2.0:1789305136.993447:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765715328 00000100:00100000:2.0:1789305136.993598:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1432 00000100:00100000:2.0:1789305136.993609:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765715328:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305136.993693:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765715328:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 85us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305136.993700:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1432 00000100:00100000:1.0:1789305137.426401:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785782784:0@lo:400:kworker.0 00000100:00100000:3.0:1789305137.426405:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785782656:0@lo:400:kworker.0 00000100:00100000:2.0:1789305137.426427:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785782912:0@lo:400:kworker.0 00000100:00100000:0.0:1789305137.426478:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785782528:0@lo:400:kworker.0 00000100:00100000:1.0:1789305137.430325:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305137.430559:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785782784 00000100:00100000:1.0:1789305137.430570:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785782784 00000100:00100000:1.0:1789305137.430653:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1789305137.430664:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785782784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305137.430750:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785782784:12345-0@lo:400:kworker.0 Request processed in 88us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305137.430757:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1789305137.430809:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785782784:0@lo:400:kworker.0 00000100:00080000:1.0:1789305137.430845:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305137.433050:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305137.433196:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785783168:0@lo:400:kworker.0 00000100:00100000:3.0:1789305137.433239:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305137.433305:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785783168 00000100:00100000:3.0:1789305137.433315:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785783168 00000100:00100000:3.0:1789305137.433360:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:3.0:1789305137.433368:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785783168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305137.433434:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785783168:12345-0@lo:400:kworker.0 Request processed in 65us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305137.433444:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:3.0:1789305137.433489:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785783168:0@lo:400:kworker.0 00000100:00100000:2.0:1789305137.434992:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305137.434992:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305137.435196:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785783040:0@lo:400:kworker.0 00000100:00100000:3.0:1789305137.435274:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785782528 00000100:00100000:3.0:1789305137.435281:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785782528 00000100:00100000:3.0:1789305137.435431:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1789305137.435441:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785782528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305137.435495:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785782528:12345-0@lo:400:kworker.0 Request processed in 56us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305137.435502:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1789305137.438907:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305137.441229:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785782656 00000100:00100000:1.0:1789305137.441247:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785782656 00000100:00100000:1.0:1789305137.441343:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785782912 00000100:00100000:1.0:1789305137.441347:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785782912 00000100:00100000:1.0:1789305137.441385:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:1.0:1789305137.441396:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785782656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305137.441512:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785782656:12345-0@lo:400:kworker.0 Request processed in 117us (8466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305137.441520:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:1.0:1789305137.441538:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:1.0:1789305137.441545:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785782912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305137.441578:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785782912:12345-0@lo:400:kworker.0 Request processed in 35us (6594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305137.441613:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00080000:1.0:1789305137.441640:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305137.441679:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785782912:0@lo:400:kworker.0 00000100:00100000:2.0:1789305137.442146:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785782656:0@lo:400:kworker.0 00000100:00100000:3.0:1789305137.444226:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785782528:0@lo:400:kworker.0 00000100:00100000:2.0:1789305137.444347:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785783040 00000100:00100000:2.0:1789305137.444356:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785783040 00000100:00100000:2.0:1789305137.444433:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:2.0:1789305137.444443:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785783040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305137.444514:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785783040:12345-0@lo:400:kworker.0 Request processed in 73us (5614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305137.444521:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00080000:1.0:1789305137.444648:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305137.444851:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785783040:0@lo:400:kworker.0 00010000:00010000:0.0:1789305137.490552:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305137.700345:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305137.700489:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765715456 00000100:00100000:0.0:1789305137.700510:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765715456 00000100:00100000:0.0:1789305137.700596:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:0.0:1789305137.700607:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2eb4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2356:x1876219765715456:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789305137.700625:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305137.700646:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c01682e00/0xefc0bb7231291a7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ff95b expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305137.700667:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305137.700737:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2eb4f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e9c4fc0-738a-427d-b1fe-000225be7c2e+9:2356:x1876219765715456:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 132us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305137.700745:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:0.0:1789305137.705732:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305137.705779:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305137.705919:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765715584 00000100:00100000:3.0:1789305137.705931:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765715584 00000100:00100000:3.0:1789305137.705989:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765715712 00000100:00100000:3.0:1789305137.705993:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765715712 00000100:00100000:3.0:1789305137.706030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:3.0:1789305137.706041:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+10:2357:x1876219765715584:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789305137.706063:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305137.706083:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c0152b400/0xefc0bb7231291a46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ff923 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305137.706135:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305137.706206:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+9:2357:x1876219765715584:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 166us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305137.706214:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:3.0:1789305137.706231:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:3.0:1789305137.706237:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+8:2357:x1876219765715712:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789305137.706244:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305137.706254:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c10e8f200/0xefc0bb7231291b57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ff970 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305137.706263:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305137.706281:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e9c4fc0-738a-427d-b1fe-000225be7c2e+7:2357:x1876219765715712:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 44us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305137.706288:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:1.0:1789305137.715345:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305137.717079:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765715968 00000100:00100000:2.0:1789305137.717117:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765715968 00000100:00100000:2.0:1789305137.717361:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1260 00000100:00100000:2.0:1789305137.717375:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+6:2353:x1876219765715968:12345-192.168.202.29@tcp:39:umount.0 00000020:00000080:2.0:1789305137.717430:0:5853:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231291a54 00000020:00010000:2.0:1789305137.717443:0:5853:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9e2c384be800: total 0 00000100:00080000:2.0:1789305137.717449:0:5853:0:(import.c:65:import_set_state_nolock()) ffff9e2c20034000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789305137.717491:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967778 00000020:00010000:1.0:1789305137.718140:0:8464:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9e2c384be800: total 0 00010000:00010000:1.0:1789305137.718208:0:8464:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789305137.718245:0:8464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c421d2d00) 00010000:00010000:1.0:1789305137.718249:0:8464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789305137.718259:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c40ecc400/0xefc0bb72312980d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a02 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305137.718284:0:8464:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384be800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789305137.718296:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305137.718298:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305137.718300:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305137.718381:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:99087288-e673-4cc7-b2df-ca113c20dacd+3:2353:x1876219765715968:12345-192.168.202.29@tcp:39:umount.0 Request processed in 1007us (3045us total) trans 4294967779 rc 0/0 00000100:00100000:2.0:1789305137.718390:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1260 00000100:00100000:3.0:1789305137.744676:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305137.744807:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765716224 00000100:00100000:1.0:1789305137.744819:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765716224 00000100:00100000:1.0:1789305137.744878:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1434 00000100:00100000:1.0:1789305137.744889:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+7:2353:x1876219765716224:12345-192.168.202.29@tcp:251:umount.0 00000020:00000080:1.0:1789305137.744945:0:5847:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231291a31 00000020:00010000:1.0:1789305137.744954:0:5847:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9e2c384c3800: total 0 00000100:00080000:1.0:1789305137.744961:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9e2c384c3000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789305137.745071:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e9c4fc0-738a-427d-b1fe-000225be7c2e+3:2353:x1876219765716224:12345-192.168.202.29@tcp:251:umount.0 Request processed in 183us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305137.745080:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1434 00000020:00010000:3.0:1789305137.745765:0:5840:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9e2c384c3800: total 0 00010000:00010000:3.0:1789305137.745837:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384c3800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789305137.745883:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c01485000/0xefc0bb7231291a85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d860ff962 expref: 2 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305137.745904:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384c3800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789305137.745915:0:5840:0:(genops.c:885:class_export_put()) final put ffff9e2c384c3800/3e9c4fc0-738a-427d-b1fe-000225be7c2e 00010000:00010000:3.0:1789305137.745938:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305137.745941:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305137.745943:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789305137.746037:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c384c3800/3e9c4fc0-738a-427d-b1fe-000225be7c2e for MGS 00000020:00000080:1.0:1789305137.779909:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c384c3000 for MGS 00000100:00100000:1.0:1789305137.938484:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785783296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305137.938559:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305137.938705:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785783296 00000100:00100000:2.0:1789305137.938716:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785783296 00000100:00100000:2.0:1789305137.938768:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:2.0:1789305137.938776:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785783296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789305137.938808:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305137.939961:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785783296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1181us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305137.939971:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:1.0:1789305137.940058:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785783296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789305138.514213:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:1.0:1789305138.683670:0:103750:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1789305138.683678:0:103750:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:2.0:1789305139.540134:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789305139.637991:0:103798:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcdc63fb90 20000000:00000080:0.0:1789305139.638010:0:103798:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412e8c00 uarg=0000000000000000 10000000:01000000:0.0:1789305139.639113:0:103798:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789305139.639136:0:103798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305139.639155:0:103798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312980c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312980c2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305139.639165:0:103798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305139.639284:0:103798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312980c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312980c2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305139.639303:0:103798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312980c9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312980c2 expref: 18 pid: 5846 timeout: 2689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305139.639322:0:103798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103798:1876219785783424:0@lo:104: 00000100:00100000:0.0:1789305139.639410:0:103798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305139.639531:0:103798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c11b8b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789305139.639850:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785783424 00000100:00100000:3.0:1789305139.639860:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785783424 00000100:00100000:3.0:1789305139.640031:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789305139.640042:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:103798:x1876219785783424:12345-0@lo:104: 00010000:00010000:3.0:1789305139.640055:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305139.640171:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305139.640177:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:103798:x1876219785783424:12345-0@lo:104: Request processed in 138us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305139.640184:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789305139.640282:0:103798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103798:1876219785783424:0@lo:104: 00010000:00010000:0.0:1789305139.640306:0:103798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641072:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305139.641083:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641121:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789305139.641125:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641134:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789305139.641147:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305139.641153:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789305139.641344:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641352:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789305139.641409:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785783552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305139.641472:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789305139.641699:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641709:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860fc00/0xefc0bb72312980c2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312980c9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641732:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305139.641734:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305139.641736:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305139.641764:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785783552 00000100:00100000:2.0:1789305139.641772:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785783552 00010000:00010000:2.0:1789305139.641800:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312980c9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312980c2 expref: 19 pid: 5846 timeout: 2689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305139.641840:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1789305139.641848:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785783552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305139.641863:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305139.641868:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312980c9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312980c2 expref: 19 pid: 5846 timeout: 2689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641880:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312980c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312980c2 expref: 19 pid: 5846 timeout: 2689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641894:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb72312980c9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312980c2 expref: 19 pid: 5846 timeout: 2689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641921:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641930:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641946:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641954:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641962:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641969:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641975:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305139.641980:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.641987:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.642003:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305139.642016:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789305139.642123:0:103798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305139.642133:0:103798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305139.642139:0:103798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afaa00/0xefc0bb72312980de lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305139.644268:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785783552:12345-0@lo:103:ldlm_bl.0 Request processed in 2413us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305139.644283:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1789305139.645777:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785783552:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789305140.549759:0:103846:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf4e3ba60 20000000:00000080:0.0:1789305140.549784:0:103846:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f5f9c00 uarg=0000000000000000 10000000:01000000:0.0:1789305140.550078:0:103846:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789305140.550140:0:103846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305140.550159:0:103846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305140.550171:0:103846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305140.550178:0:103846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305140.550186:0:103846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305140.550194:0:103846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305140.550200:0:103846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305140.550205:0:103846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305140.550214:0:103846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305140.550228:0:103846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305140.550236:0:103846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305140.550244:0:103846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa800/0xefc0bb72312980e5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305140.575192:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789305141.049412:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 99087288-e673-4cc7-b2df-ca113c20dacd 00000001:00080000:1.0:1789305141.049427:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967779 is committed 00000020:00000080:1.0:1789305141.049434:0:5874:0:(genops.c:885:class_export_put()) final put ffff9e2c384be800/99087288-e673-4cc7-b2df-ca113c20dacd 00000020:00000080:3.0:1789305141.050030:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c384be800/99087288-e673-4cc7-b2df-ca113c20dacd for lustre-MDT0000 00000020:00000080:3.0:1789305141.050140:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c20034000 for lustre-MDT0000 10000000:01000000:3.0:1789305141.397413:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789305141.397422:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789305141.397428:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789305141.397479:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305141.397504:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305141.397523:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305141.397558:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785783680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789305141.397652:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305141.397722:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110ea0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789305141.397944:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785783680 00000100:00100000:2.0:1789305141.397953:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785783680 00000100:00100000:2.0:1789305141.398031:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1789305141.398041:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785783680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305141.398054:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305141.398069:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312980f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312980ec expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305141.398130:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312980f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312980ec expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305141.398143:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312980f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312980ec expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305141.398153:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd600, rc 0) 00000100:00100000:2.0:1789305141.398195:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785783680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305141.398202:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1789305141.398415:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785783680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305141.398432:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305141.398441:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305141.398467:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789305141.398473:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305141.398480:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789305141.480343:0:103896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9700f600 20000000:00000080:1.0:1789305141.480361:0:103896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c10cea000 uarg=0000000000000000 10000000:01000000:1.0:1789305141.481724:0:103896:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305141.481751:0:103896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305141.481771:0:103896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312980f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312980ec expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305141.481778:0:103896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305141.481823:0:103896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312980f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312980ec expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305141.481838:0:103896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312980f3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312980ec expref: 18 pid: 5845 timeout: 2691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305141.481850:0:103896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103896:1876219785783808:0@lo:104: 00000100:00100000:1.0:1789305141.481917:0:103896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305141.482301:0:103896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b04091e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789305141.482956:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785783808 00000100:00100000:3.0:1789305141.482967:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785783808 00000100:00100000:3.0:1789305141.483045:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789305141.483056:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:103896:x1876219785783808:12345-0@lo:104: 00010000:00010000:3.0:1789305141.483075:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305141.483193:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305141.483199:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:103896:x1876219785783808:12345-0@lo:104: Request processed in 146us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305141.483207:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00010000:0.0:1789305141.483350:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305141.483359:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483368:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305141.483372:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483382:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305141.483389:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305141.483394:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789305141.483431:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483437:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305141.483468:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483475:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e000/0xefc0bb72312980ec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312980f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483495:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305141.483497:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305141.483499:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305141.483507:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789305141.483519:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785783936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305141.483570:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305141.483627:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785783936 00000100:00100000:0.0:1789305141.483632:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785783936 00010000:00010000:0.0:1789305141.483659:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312980f3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312980ec expref: 19 pid: 5845 timeout: 2691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305141.483691:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:0.0:1789305141.483698:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785783936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305141.483711:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305141.483718:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312980f3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312980ec expref: 19 pid: 5845 timeout: 2691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483729:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312980f3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312980ec expref: 19 pid: 5845 timeout: 2691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483747:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483756:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483773:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483781:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483793:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483800:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483805:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370c00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305141.483809:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483817:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483826:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305141.483836:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305141.483874:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785783936:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305141.483881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:2.0:1789305141.484013:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785783936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305141.484169:0:103896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd600/0xefc0bb72312980f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312980ec expref: 18 pid: 5845 timeout: 2691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305141.484182:0:103896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103896:1876219785783808:0@lo:104: 00010000:00010000:1.0:1789305141.484196:0:103896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305141.484204:0:103896:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305141.484215:0:103896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305141.484223:0:103896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370c00/0xefc0bb72312980fa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305141.586858:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305142.034260:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789305142.034284:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785784064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305142.034365:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305142.034439:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785784064 00000100:00100000:1.0:1789305142.034447:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785784064 00000100:00100000:1.0:1789305142.034504:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1789305142.034514:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785784064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305142.034562:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305142.034679:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785784064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305142.034687:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00080000:1.0:1789305142.034709:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305142.034774:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785784064:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1789305142.134998:0:103944:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc89955900 20000000:00000080:2.0:1789305142.135015:0:103944:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c27df7000 uarg=0000000000000000 10000000:01000000:2.0:1789305142.135447:0:103944:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305142.135470:0:103944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.135487:0:103944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.135498:0:103944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.135505:0:103944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.135513:0:103944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.135521:0:103944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.135527:0:103944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305142.135532:0:103944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.135549:0:103944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.135563:0:103944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.135570:0:103944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.135577:0:103944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298101 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305142.547737:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785784320:0@lo:400:kworker.0 00000100:00100000:3.0:1789305142.547819:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305142.547882:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785784832:0@lo:400:kworker.0 00000100:00100000:3.0:1789305142.547909:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305142.547940:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305142.547946:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785784448:0@lo:400:kworker.0 00000100:00100000:3.0:1789305142.547970:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305142.548007:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785784320 00000100:00100000:3.0:1789305142.548016:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785784320 00000100:00100000:3.0:1789305142.548067:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:3.0:1789305142.548076:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785784320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305142.548242:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785784192:0@lo:400:kworker.0 00000100:00100000:1.0:1789305142.548281:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305142.548306:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785784704:0@lo:400:kworker.0 00000100:00100000:1.0:1789305142.548327:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305142.548345:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789305142.548350:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785784576:0@lo:400:kworker.0 00000100:00100000:1.0:1789305142.548374:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305142.548400:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785784832 00000100:00100000:1.0:1789305142.548404:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785784832 00000100:00100000:1.0:1789305142.548433:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785784448 00000100:00100000:1.0:1789305142.548435:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785784448 00000100:00100000:1.0:1789305142.548461:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1789305142.548468:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785784832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305142.548509:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785784832:12345-0@lo:400:kworker.0 Request processed in 42us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305142.548517:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1789305142.548544:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1789305142.548551:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785784448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305142.548578:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785784448:12345-0@lo:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305142.548584:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00080000:1.0:1789305142.548606:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305142.548638:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785784448:0@lo:400:kworker.0 00000100:00100000:1.0:1789305142.548647:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785784832:0@lo:400:kworker.0 00000100:00100000:0.0:1789305142.548731:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785784192 00000100:00100000:0.0:1789305142.548736:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785784192 00000100:00100000:0.0:1789305142.548770:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1789305142.548777:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785784192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305142.548814:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785784192:12345-0@lo:400:kworker.0 Request processed in 37us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305142.548820:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1789305142.548843:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785784704 00000100:00100000:0.0:1789305142.548846:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785784704 00000100:00100000:0.0:1789305142.548869:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785784576 00000100:00100000:0.0:1789305142.548871:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785784576 00000100:00100000:0.0:1789305142.548883:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:0.0:1789305142.548888:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785784704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305142.548911:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785784704:12345-0@lo:400:kworker.0 Request processed in 24us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305142.548916:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00100000:0.0:1789305142.548925:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:0.0:1789305142.548929:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785784576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305142.548950:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785784576:12345-0@lo:400:kworker.0 Request processed in 21us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305142.548955:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00080000:0.0:1789305142.548972:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305142.548989:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785784576:0@lo:400:kworker.0 00000100:00100000:0.0:1789305142.548996:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785784192:0@lo:400:kworker.0 00000100:00100000:0.0:1789305142.549003:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785784704:0@lo:400:kworker.0 00000100:00100000:3.0:1789305142.549080:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785784320:12345-0@lo:400:kworker.0 Request processed in 1004us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305142.549086:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:0.0:1789305142.549434:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785784320:0@lo:400:kworker.0 00010000:00010000:0.0:1789305142.615326:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789305142.855782:0:103992:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcea008ea0 20000000:00000080:2.0:1789305142.855799:0:103992:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c27df4400 uarg=0000000000000000 10000000:01000000:2.0:1789305142.855992:0:103992:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305142.856016:0:103992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.856032:0:103992:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.856044:0:103992:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.856051:0:103992:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.856059:0:103992:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.856067:0:103992:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.856073:0:103992:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305142.856078:0:103992:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.856087:0:103992:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.856251:0:103992:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.856263:0:103992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305142.856270:0:103992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298108 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305143.062424:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785784960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305143.062502:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305143.062594:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785784960 00000100:00100000:2.0:1789305143.062601:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785784960 00000100:00100000:2.0:1789305143.062650:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1789305143.062659:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785784960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789305143.062701:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305143.062746:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785784960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305143.062754:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1789305143.062806:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785784960:0@lo:13:osp-pre-0-0.0 10000000:01000000:0.0:1789305143.188781:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305143.188790:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305143.188796:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305143.188845:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.188858:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.188871:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305143.188899:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785785088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305143.188976:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305143.189038:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0172ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789305143.189246:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785785088 00000100:00100000:2.0:1789305143.189254:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785785088 00000100:00100000:2.0:1789305143.189305:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1789305143.189315:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785785088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305143.189328:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305143.189342:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298116 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129810f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305143.189367:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298116 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129810f expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305143.189379:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298116 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129810f expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305143.189388:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc200, rc 0) 00000100:00100000:2.0:1789305143.189428:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785785088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305143.189435:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1789305143.190021:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785785088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305143.190046:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.190056:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305143.190077:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789305143.190082:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.190116:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789305143.626686:0:104041:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc0805020 20000000:00000080:0.0:1789305143.626707:0:104041:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02ec6800 uarg=0000000000000000 10000000:01000000:0.0:1789305143.626936:0:104041:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789305143.626962:0:104041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.626983:0:104041:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298116 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129810f expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.626992:0:104041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.627045:0:104041:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298116 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129810f expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.627063:0:104041:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298116 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129810f expref: 18 pid: 5847 timeout: 2693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305143.627081:0:104041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104041:1876219785785216:0@lo:104: 00000100:00100000:0.0:1789305143.627187:0:104041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305143.627248:0:104041:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f709240 going to sleep for 11 seconds 00000100:00100000:1.0:1789305143.627554:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785785216 00000100:00100000:1.0:1789305143.627563:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785785216 00000100:00100000:1.0:1789305143.627627:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1789305143.627637:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104041:x1876219785785216:12345-0@lo:104: 00010000:00010000:1.0:1789305143.627651:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.627721:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789305143.627727:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104041:x1876219785785216:12345-0@lo:104: Request processed in 93us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305143.627734:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00010000:00010000:1.0:1789305143.627757:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789305143.627763:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.627771:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789305143.627775:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.627784:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789305143.627791:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305143.627796:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789305143.627828:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.627835:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789305143.627855:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.627862:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb723129810f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298116 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.627882:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305143.627884:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305143.627885:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305143.627909:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785785344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789305143.627943:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305143.627986:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785785344 00000100:00100000:1.0:1789305143.627990:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785785344 00010000:00010000:1.0:1789305143.628010:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298116 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129810f expref: 19 pid: 5847 timeout: 2693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305143.628036:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1789305143.628043:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785785344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305143.628056:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305143.628061:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298116 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129810f expref: 19 pid: 5847 timeout: 2693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628072:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298116 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129810f expref: 19 pid: 5847 timeout: 2693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628116:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628126:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628143:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628152:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628161:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628174:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628180:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789305143.628185:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628193:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628202:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.628213:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789305143.628245:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785785344:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305143.628252:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1789305143.628297:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785785344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305143.631561:0:104041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298116 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129810f expref: 18 pid: 5847 timeout: 2693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305143.631645:0:104041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104041:1876219785785216:0@lo:104: 00010000:00010000:0.0:1789305143.631671:0:104041:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.631681:0:104041:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.631688:0:104041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305143.631694:0:104041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afbc00/0xefc0bb723129811d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305143.634671:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305144.659424:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305144.794798:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305144.794817:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305144.794822:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305144.794866:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305144.794878:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305144.794889:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305144.794916:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785785472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305144.794988:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305144.795052:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3874ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789305144.795183:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785785472 00000100:00100000:2.0:1789305144.795192:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785785472 00000100:00100000:2.0:1789305144.795252:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1789305144.795262:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785785472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305144.795276:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305144.795290:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb723129812b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298124 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305144.795314:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb723129812b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298124 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305144.795327:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb723129812b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298124 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305144.795336:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecde00, rc 0) 00000100:00100000:2.0:1789305144.795394:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785785472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305144.795401:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1789305144.795460:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785785472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305144.795478:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305144.795488:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305144.795507:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789305144.795523:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305144.795532:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305145.682415:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789305146.343400:0:104190:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff27bd080 20000000:00000080:1.0:1789305146.343416:0:104190:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3846b400 uarg=0000000000000000 10000000:01000000:1.0:1789305146.344366:0:104190:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305146.344387:0:104190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305146.344404:0:104190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb723129812b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298124 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305146.344411:0:104190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305146.344450:0:104190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecde00/0xefc0bb723129812b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231298124 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305146.344465:0:104190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb723129812b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231298124 expref: 18 pid: 5845 timeout: 2696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305146.344480:0:104190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f678a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104190:1876219785785600:0@lo:104: 00000100:00100000:1.0:1789305146.344626:0:104190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305146.344783:0:104190:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b027e80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789305146.344890:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789305146.344904:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785785600 00000100:00100000:3.0:1789305146.344910:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785785600 00000100:00100000:3.0:1789305146.344993:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789305146.345002:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c412e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104190:x1876219785785600:12345-0@lo:104: 00010000:00010000:3.0:1789305146.345014:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305146.345124:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305146.345130:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c412e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104190:x1876219785785600:12345-0@lo:104: Request processed in 131us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305146.345137:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1789305146.345244:0:104190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f678a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104190:1876219785785600:0@lo:104: 00010000:00010000:2.0:1789305146.345263:0:104190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305146.345424:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305146.345432:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305146.345438:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbe00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305146.345442:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305146.345450:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305146.345457:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305146.345462:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789305146.345491:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305146.345497:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305146.345529:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305146.345536:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbe00/0xefc0bb7231298124 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129812b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305146.345551:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305146.345561:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305146.345563:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305146.345589:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785785728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305146.345622:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305146.345782:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785785728 00000100:00100000:2.0:1789305146.345786:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785785728 00010000:00010000:2.0:1789305146.345809:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb723129812b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298124 expref: 19 pid: 5845 timeout: 2696 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305146.345837:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1789305146.345844:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785785728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305146.345856:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305146.345861:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecde00/0xefc0bb723129812b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298124 expref: 19 pid: 5845 timeout: 2696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345872:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecde00/0xefc0bb723129812b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231298124 expref: 19 pid: 5845 timeout: 2696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345886:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb723129812b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231298124 expref: 19 pid: 5845 timeout: 2696 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345899:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345908:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345922:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345931:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345943:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345949:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345954:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305146.345958:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345964:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345977:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.345986:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789305146.346021:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785785728:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305146.346027:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1789305146.346054:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785785728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305146.346074:0:104190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.346081:0:104190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305146.346087:0:104190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298132 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305146.710696:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305147.155329:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785785856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305147.155401:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305147.155475:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785785856 00000100:00100000:1.0:1789305147.155482:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785785856 00000100:00100000:1.0:1789305147.155549:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1789305147.155558:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785785856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305147.155591:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305147.155635:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3f679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785785856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305147.155641:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00080000:1.0:1789305147.155661:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305147.155693:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785785856:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1789305147.212675:0:104238:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffad9b4f60 20000000:00000080:2.0:1789305147.212693:0:104238:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3700d800 uarg=0000000000000000 10000000:01000000:2.0:1789305147.212895:0:104238:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305147.212917:0:104238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305147.212933:0:104238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305147.212943:0:104238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305147.212950:0:104238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305147.212957:0:104238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305147.212964:0:104238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305147.212970:0:104238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305147.212974:0:104238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305147.212982:0:104238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305147.212995:0:104238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305147.213007:0:104238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305147.213013:0:104238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd000/0xefc0bb7231298139 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305147.668879:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785785984:0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.668962:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305147.669045:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785785984 00000100:00100000:3.0:1789305147.669053:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785785984 00000100:00100000:3.0:1789305147.669130:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:3.0:1789305147.669139:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785785984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.669193:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785785984:12345-0@lo:400:kworker.0 Request processed in 56us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305147.669200:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:3.0:1789305147.669257:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785785984:0@lo:400:kworker.0 00000100:00100000:0.0:1789305147.670553:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785786112:0@lo:400:kworker.0 00000100:00100000:0.0:1789305147.670608:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305147.670837:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785786112 00000100:00100000:3.0:1789305147.670844:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785786112 00000100:00100000:3.0:1789305147.670895:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:3.0:1789305147.670902:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785786112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.670961:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785786112:12345-0@lo:400:kworker.0 Request processed in 59us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305147.670968:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00100000:3.0:1789305147.671004:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785786112:0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.678450:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305147.678473:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785786240:0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.678559:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305147.678622:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785786240 00000100:00100000:3.0:1789305147.678629:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785786240 00000100:00100000:3.0:1789305147.678682:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:3.0:1789305147.678690:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785786240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.678738:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785786240:12345-0@lo:400:kworker.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305147.678745:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00080000:3.0:1789305147.678766:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305147.678799:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785786240:0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.678836:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789305147.678844:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785786368:0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.678870:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305147.678906:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785786496:0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.678927:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305147.678952:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785786368 00000100:00100000:3.0:1789305147.678956:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785786368 00000100:00100000:3.0:1789305147.678981:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785786496 00000100:00100000:3.0:1789305147.678983:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785786496 00000100:00100000:3.0:1789305147.679001:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:3.0:1789305147.679007:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785786368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.679038:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785786368:12345-0@lo:400:kworker.0 Request processed in 31us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305147.679045:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:3.0:1789305147.679056:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874 00000100:00100000:3.0:1789305147.679062:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785786496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.679110:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785786496:12345-0@lo:400:kworker.0 Request processed in 27us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305147.679116:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874 00000100:00080000:3.0:1789305147.679134:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305147.679153:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785786496:0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.679162:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785786368:0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.679192:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785786624:0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.679214:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305147.679240:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785786624 00000100:00100000:3.0:1789305147.679243:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785786624 00000100:00100000:3.0:1789305147.679263:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1789305147.679269:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785786624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305147.679301:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785786624:12345-0@lo:400:kworker.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305147.679306:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1789305147.679332:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b011c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785786624:0@lo:400:kworker.0 00010000:00010000:2.0:1789305147.730806:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305148.116304:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305148.116312:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305148.116317:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305148.116368:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305148.116382:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305148.116394:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305148.116421:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785786752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305148.116508:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305148.116568:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3874c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789305148.116682:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785786752 00000100:00100000:2.0:1789305148.116692:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785786752 00000100:00100000:2.0:1789305148.116759:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1789305148.116769:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785786752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305148.116783:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305148.116797:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231298147 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298140 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305148.116821:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231298147 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298140 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305148.116832:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231298147 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298140 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305148.116841:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecda00, rc 0) 00000100:00100000:2.0:1789305148.116908:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785786752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305148.116915:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1789305148.119073:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785786752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305148.119116:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305148.119137:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305148.119160:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789305148.119166:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305148.119175:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305148.178397:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305148.178422:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785786880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305148.178567:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305148.180079:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785786880 00000100:00100000:0.0:1789305148.180112:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785786880 00000100:00100000:1.0:1789305148.180240:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1789305148.180254:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785786880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305148.180304:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305148.180390:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b011c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785786880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305148.180398:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:2.0:1789305148.180504:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785786880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789305148.756657:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305149.778541:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305150.803934:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789305151.600197:0:104436:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffffcc38120 20000000:00000080:0.0:1789305151.600213:0:104436:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02ec4400 uarg=0000000000000000 10000000:01000000:0.0:1789305151.601843:0:104436:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789305151.601999:0:104436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305151.602293:0:104436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231298147 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298140 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305151.602421:0:104436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305151.602474:0:104436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231298147 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231298140 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305151.602493:0:104436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231298147 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231298140 expref: 18 pid: 5847 timeout: 2701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305151.602509:0:104436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104436:1876219785787008:0@lo:104: 00000100:00100000:0.0:1789305151.602582:0:104436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305151.602709:0:104436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0246db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789305151.602847:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785787008 00000100:00100000:3.0:1789305151.602857:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785787008 00000100:00100000:3.0:1789305151.603014:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789305151.603025:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104436:x1876219785787008:12345-0@lo:104: 00010000:00010000:3.0:1789305151.603041:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305151.603152:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305151.603159:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104436:x1876219785787008:12345-0@lo:104: Request processed in 136us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305151.603165:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789305151.603362:0:104436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104436:1876219785787008:0@lo:104: 00010000:00010000:0.0:1789305151.603381:0:104436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603441:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305151.603458:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603465:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789305151.603469:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603476:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789305151.603484:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305151.603490:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789305151.603527:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603534:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789305151.603558:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603565:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb400/0xefc0bb7231298140 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298147 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603581:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305151.603583:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305151.603585:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305151.603597:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785787136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789305151.603632:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305151.603690:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785787136 00000100:00100000:2.0:1789305151.603695:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785787136 00010000:00010000:2.0:1789305151.603717:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231298147 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298140 expref: 19 pid: 5847 timeout: 2701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305151.603741:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1789305151.603747:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2eb4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785787136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305151.603758:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305151.603763:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231298147 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298140 expref: 19 pid: 5847 timeout: 2701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603773:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231298147 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231298140 expref: 19 pid: 5847 timeout: 2701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603785:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecda00/0xefc0bb7231298147 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231298140 expref: 19 pid: 5847 timeout: 2701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603798:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603807:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603822:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603830:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603837:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603844:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603849:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305151.603854:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603861:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603885:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305151.603896:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789305151.603929:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2eb4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785787136:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305151.603935:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1789305151.603992:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785787136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305151.604312:0:104436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305151.604337:0:104436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305151.604343:0:104436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa200/0xefc0bb723129814e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305151.832686:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305152.277478:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789305152.277512:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785787264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305152.277577:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305152.277639:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785787264 00000100:00100000:0.0:1789305152.277648:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785787264 00000100:00100000:0.0:1789305152.277698:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1789305152.277705:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785787264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789305152.277736:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305152.277775:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785787264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305152.277782:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00080000:0.0:1789305152.277800:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789305152.277829:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785787264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305152.787044:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785787776:0@lo:400:kworker.0 00000100:00100000:1.0:1789305152.787137:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305152.787206:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305152.787212:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785787648:0@lo:400:kworker.0 00000100:00100000:1.0:1789305152.787238:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305152.787331:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785787776 00000100:00100000:0.0:1789305152.787339:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785787776 00000100:00100000:0.0:1789305152.787404:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875 00000100:00100000:0.0:1789305152.787422:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785787776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305152.787511:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785787776:12345-0@lo:400:kworker.0 Request processed in 93us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305152.787522:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875 00000100:00100000:0.0:1789305152.787570:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785787776:0@lo:400:kworker.0 00000100:00080000:1.0:1789305152.787856:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305152.787914:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785787392:0@lo:400:kworker.0 00000100:00100000:2.0:1789305152.787951:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305152.787988:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785787904:0@lo:400:kworker.0 00000100:00100000:2.0:1789305152.788011:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305152.788040:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789305152.788046:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785787520:0@lo:400:kworker.0 00000100:00100000:2.0:1789305152.788066:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305152.788081:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785788032:0@lo:400:kworker.0 00000100:00100000:2.0:1789305152.788130:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305152.788207:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785787392 00000100:00100000:0.0:1789305152.788212:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785787392 00000100:00100000:0.0:1789305152.788247:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1789305152.788254:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785787392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305152.788294:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785787392:12345-0@lo:400:kworker.0 Request processed in 41us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305152.788300:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1789305152.788333:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785787392:0@lo:400:kworker.0 00000100:00100000:3.0:1789305152.788450:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785787648 00000100:00100000:3.0:1789305152.788455:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785787648 00000100:00080000:0.0:1789305152.788668:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305152.788691:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785787904 00000100:00100000:0.0:1789305152.788695:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785787904 00000100:00100000:0.0:1789305152.788723:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785787520 00000100:00100000:0.0:1789305152.788726:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785787520 00000100:00100000:0.0:1789305152.788743:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:0.0:1789305152.788749:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785787904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305152.788785:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785787904:12345-0@lo:400:kworker.0 Request processed in 36us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305152.788859:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00100000:0.0:1789305152.788873:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:0.0:1789305152.788880:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785787520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305152.788908:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785787520:12345-0@lo:400:kworker.0 Request processed in 29us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305152.788914:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00080000:0.0:1789305152.788931:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305152.788951:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785787520:0@lo:400:kworker.0 00000100:00100000:0.0:1789305152.788961:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785787904:0@lo:400:kworker.0 00000100:00100000:3.0:1789305152.789155:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785788032 00000100:00100000:3.0:1789305152.789159:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785788032 00000100:00100000:0.0:1789305152.793175:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1789305152.793211:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785787648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305152.793338:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785787648:12345-0@lo:400:kworker.0 Request processed in 142us (6098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305152.793347:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1789305152.793372:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1789305152.793380:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785788032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305152.793422:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785788032:12345-0@lo:400:kworker.0 Request processed in 43us (5292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305152.793428:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1789305152.793680:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3f67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785787648:0@lo:400:kworker.0 00000100:00100000:0.0:1789305152.793794:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785788032:0@lo:400:kworker.0 00010000:00010000:2.0:1789305152.858456:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789305152.979283:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789305152.979292:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789305152.979298:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789305152.979349:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305152.979362:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305152.979374:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305152.979402:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03689880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785788160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789305152.979514:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305152.979584:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b0246d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789305152.980207:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785788160 00000100:00100000:0.0:1789305152.980220:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785788160 00000100:00100000:0.0:1789305152.980283:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1789305152.980294:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785788160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305152.980308:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305152.980325:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa600/0xefc0bb723129815c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298155 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305152.980352:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa600/0xefc0bb723129815c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298155 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305152.980362:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa600/0xefc0bb723129815c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298155 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305152.980371:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa600, rc 0) 00000100:00100000:0.0:1789305152.980423:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785788160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305152.980430:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1789305152.980544:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03689880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785788160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305152.980560:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305152.980569:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305152.980589:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789305152.980594:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305152.980603:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305153.299302:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789305153.299333:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785788288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305153.299411:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305153.299503:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785788288 00000100:00100000:2.0:1789305153.299511:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785788288 00000100:00100000:2.0:1789305153.299565:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1789305153.299575:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785788288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789305153.299622:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305153.299676:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785788288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305153.299684:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1789305153.299732:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785788288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789305153.874494:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305154.898217:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789305155.149438:0:104631:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc6441980 20000000:00000080:2.0:1789305155.149459:0:104631:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36f26c00 uarg=0000000000000000 10000000:01000000:2.0:1789305155.149667:0:104631:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305155.150042:0:104631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305155.150061:0:104631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa600/0xefc0bb723129815c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298155 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305155.150070:0:104631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305155.150373:0:104631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa600/0xefc0bb723129815c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231298155 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305155.150454:0:104631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afa600/0xefc0bb723129815c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231298155 expref: 18 pid: 5846 timeout: 2704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305155.150470:0:104631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104631:1876219785788416:0@lo:104: 00000100:00100000:2.0:1789305155.150537:0:104631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305155.150636:0:104631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c0614f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789305155.150681:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785788416 00000100:00100000:3.0:1789305155.150689:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785788416 00000100:00100000:3.0:1789305155.150894:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1789305155.150905:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104631:x1876219785788416:12345-0@lo:104: 00010000:00010000:3.0:1789305155.150918:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.151023:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305155.151030:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104631:x1876219785788416:12345-0@lo:104: Request processed in 128us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305155.151036:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789305155.151114:0:104631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104631:1876219785788416:0@lo:104: 00010000:00010000:2.0:1789305155.151135:0:104631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305155.151210:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305155.151217:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305155.151224:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370a00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305155.151228:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305155.151236:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305155.151244:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305155.151249:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789305155.151285:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305155.151292:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789305155.151332:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785788544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789305155.151364:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789305155.151490:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305155.151498:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41370a00/0xefc0bb7231298155 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb723129815c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305155.151518:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305155.151520:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305155.151522:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305155.151661:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785788544 00000100:00100000:3.0:1789305155.151667:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785788544 00010000:00010000:3.0:1789305155.151689:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa600/0xefc0bb723129815c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298155 expref: 19 pid: 5846 timeout: 2704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305155.151720:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1789305155.151727:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785788544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305155.151738:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305155.151744:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa600/0xefc0bb723129815c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298155 expref: 19 pid: 5846 timeout: 2704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.151754:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa600/0xefc0bb723129815c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231298155 expref: 19 pid: 5846 timeout: 2704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.151777:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa600/0xefc0bb723129815c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231298155 expref: 19 pid: 5846 timeout: 2704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.151791:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.151799:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.151813:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.151820:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.151993:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.152000:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.152007:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecdc00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305155.152011:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.152017:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.152038:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305155.152047:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789305155.152117:0:104631:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305155.152124:0:104631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305155.152130:0:104631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecdc00/0xefc0bb7231298163 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305155.153320:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785788544:12345-0@lo:103:ldlm_bl.0 Request processed in 1589us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305155.153331:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789305155.153908:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785788544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305155.926986:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789305156.047709:0:104679:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc2868ca40 20000000:00000080:2.0:1789305156.047726:0:104679:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36f25000 uarg=0000000000000000 10000000:01000000:2.0:1789305156.047938:0:104679:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305156.047960:0:104679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.047976:0:104679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.047989:0:104679:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.047995:0:104679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.048003:0:104679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.048010:0:104679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.048017:0:104679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecda00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305156.048022:0:104679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.048031:0:104679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.048045:0:104679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.048053:0:104679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.048060:0:104679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecda00/0xefc0bb723129816a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305156.436807:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305156.436816:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305156.436822:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305156.436873:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305156.436886:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305156.436900:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305156.436926:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785788672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305156.437000:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305156.437055:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b04091e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789305156.437148:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785788672 00000100:00100000:2.0:1789305156.437157:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785788672 00000100:00100000:2.0:1789305156.437208:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:2.0:1789305156.437217:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785788672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305156.437230:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305156.437244:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298178 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298171 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.437273:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298178 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298171 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.437285:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298178 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298171 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305156.437295:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecde00, rc 0) 00000100:00100000:2.0:1789305156.437341:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785788672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305156.437348:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1789305156.437446:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785788672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305156.437462:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305156.437471:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305156.437489:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789305156.437494:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305156.437502:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305156.947676:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305157.395722:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789305157.395749:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785788800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789305157.395823:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305157.396254:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785788800 00000100:00100000:0.0:1789305157.396266:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785788800 00000100:00100000:0.0:1789305157.396335:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1789305157.396346:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785788800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789305157.396383:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789305157.396542:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305157.396588:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785788800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305157.396732:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785788800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 388us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305157.396739:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:1.0:1789305157.910351:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785788928:0@lo:400:kworker.0 00000100:00100000:1.0:1789305157.910444:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305157.910727:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785788928 00000100:00100000:3.0:1789305157.910735:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785788928 00000100:00100000:3.0:1789305157.911006:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:3.0:1789305157.911018:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785788928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305157.911590:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785789184:0@lo:400:kworker.0 00000100:00100000:2.0:1789305157.911631:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305157.911664:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789305157.911670:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785789056:0@lo:400:kworker.0 00000100:00100000:2.0:1789305157.911694:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305157.911722:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785789184 00000100:00100000:2.0:1789305157.911727:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785789184 00000100:00100000:2.0:1789305157.911772:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1789305157.911780:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785789184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305157.911819:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785789184:12345-0@lo:400:kworker.0 Request processed in 40us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305157.911829:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1789305157.911849:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785789056 00000100:00100000:2.0:1789305157.911853:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785789056 00000100:00100000:2.0:1789305157.911876:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:2.0:1789305157.911883:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785789056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305157.911915:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785789056:12345-0@lo:400:kworker.0 Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305157.911921:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000100:00080000:2.0:1789305157.911936:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789305157.911963:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785789056:0@lo:400:kworker.0 00000100:00100000:2.0:1789305157.911974:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785789184:0@lo:400:kworker.0 00000100:00100000:3.0:1789305157.914019:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785788928:12345-0@lo:400:kworker.0 Request processed in 2998us (3569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305157.914031:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1789305157.917222:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785788928:0@lo:400:kworker.0 00000100:00100000:1.0:1789305157.917259:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785789440:0@lo:400:kworker.0 00000100:00100000:1.0:1789305157.917322:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305157.917421:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789305157.917428:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785789312:0@lo:400:kworker.0 00000100:00100000:1.0:1789305157.917452:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305157.921415:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785789440 00000100:00100000:2.0:1789305157.921431:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785789440 00000100:00100000:2.0:1789305157.921502:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785789312 00000100:00080000:0.0:1789305157.921580:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305157.921609:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785789312 00000100:00080000:0.0:1789305157.921717:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305157.921746:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1789305157.921757:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785789440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305157.921937:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785789440:12345-0@lo:400:kworker.0 Request processed in 183us (4614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305157.921945:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1789305157.921965:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1789305157.921972:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785789312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305157.922001:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785789312:12345-0@lo:400:kworker.0 Request processed in 30us (4548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305157.922006:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:0.0:1789305157.923004:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785789440:0@lo:400:kworker.0 00000100:00100000:0.0:1789305157.923032:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785789312:0@lo:400:kworker.0 00010000:00010000:1.0:1789305157.970756:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305158.421940:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785789568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305158.422008:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305158.422077:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785789568 00000100:00100000:2.0:1789305158.422087:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785789568 00000100:00100000:2.0:1789305158.422149:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1789305158.422158:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c385ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785789568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789305158.422192:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305158.422238:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c385ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785789568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305158.422245:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1789305158.422298:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785789568:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789305158.995301:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305160.018225:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789305160.153486:0:104876:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff2df75900 20000000:00000080:1.0:1789305160.153504:0:104876:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c38468000 uarg=0000000000000000 10000000:01000000:1.0:1789305160.154069:0:104876:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305160.154114:0:104876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305160.154134:0:104876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298178 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298171 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305160.154142:0:104876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305160.154180:0:104876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298178 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231298171 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305160.154194:0:104876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298178 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231298171 expref: 18 pid: 5847 timeout: 2709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305160.154208:0:104876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104876:1876219785789696:0@lo:104: 00000100:00100000:1.0:1789305160.154275:0:104876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305160.154333:0:104876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c13d74f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789305160.154894:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785789696 00000100:00100000:3.0:1789305160.154905:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785789696 00000100:00100000:3.0:1789305160.154984:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789305160.154995:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104876:x1876219785789696:12345-0@lo:104: 00010000:00010000:3.0:1789305160.155011:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155161:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305160.155170:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03689180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104876:x1876219785789696:12345-0@lo:104: Request processed in 177us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305160.155178:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00010000:00010000:0.0:1789305160.155202:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305160.155210:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155233:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305160.155238:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155247:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305160.155256:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305160.155262:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1789305160.155281:0:104876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104876:1876219785789696:0@lo:104: 00010000:00010000:0.0:1789305160.155300:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.155306:0:104876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155309:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305160.155343:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155354:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa800/0xefc0bb7231298171 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305160.155356:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785789824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305160.155387:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305160.155390:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305160.155392:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305160.155413:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305160.155447:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785789824 00000100:00100000:0.0:1789305160.155452:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785789824 00010000:00010000:0.0:1789305160.155478:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298178 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298171 expref: 19 pid: 5847 timeout: 2709 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305160.155508:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1789305160.155516:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785789824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305160.155527:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305160.155533:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298178 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298171 expref: 19 pid: 5847 timeout: 2709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155544:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298178 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231298171 expref: 19 pid: 5847 timeout: 2709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155557:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298178 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231298171 expref: 19 pid: 5847 timeout: 2709 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155570:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155577:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155593:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155600:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155606:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155612:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155616:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305160.155620:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155626:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155645:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305160.155654:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305160.155681:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785789824:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (268us total) trans 0 rc 0/0 00010000:00010000:3.0:1789305160.155687:0:104876:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305160.155688:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00010000:00010000:3.0:1789305160.155698:0:104876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.155704:0:104876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371200/0xefc0bb723129817f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305160.155732:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785789824:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789305160.908212:0:104924:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7c185ff0 20000000:00000080:3.0:1789305160.908234:0:104924:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e2c02e79000 uarg=0000000000000000 20000000:01000000:3.0:1789305160.908277:0:104924:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='nodemap..fileset=/c0dir' 20000000:01000000:3.0:1789305160.908283:0:104924:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'nodemap..fileset=/c0dir' 20000000:01000000:3.0:1789305160.908287:0:104924:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/nodemap..fileset=/c0dir del=0 00000040:00080000:0.0:1789305160.909522:0:104925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789305160.909737:0:104924:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.nodemap..fileset=/c0dir in log params 00000040:00080000:2.0:1789305160.913660:0:104924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789305160.913715:0:104924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 112 off9648 00000040:00080000:2.0:1789305160.913773:0:104924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9872 10000000:01000000:2.0:1789305160.913791:0:104924:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789305160.913810:0:104924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.913830:0:104924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c01484600/0xefc0bb7231291b34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231291b2d expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.913838:0:104924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c00030600/0xefc0bb7231291b42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231291b3b expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.913844:0:104924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c00031e00/0xefc0bb7231291b50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231291b49 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.913850:0:104924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 6/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.913895:0:104924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c00031e00/0xefc0bb7231291b50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231291b49 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.913909:0:104924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c00031e00/0xefc0bb7231291b50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231291b49 expref: 17 pid: 5847 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305160.913922:0:104924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104924:1876219785789952:0@lo:104: 00000100:00100000:2.0:1789305160.913994:0:104924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789305160.914209:0:104924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c00030600/0xefc0bb7231291b42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231291b3b expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.914218:0:104924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c00030600/0xefc0bb7231291b42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231291b3b expref: 17 pid: 5846 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305160.914226:0:104924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104924:1876219785790080:0@lo:104: 00000100:00100000:2.0:1789305160.914251:0:104924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789305160.914392:0:104924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c01484600/0xefc0bb7231291b34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231291b2d expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.914401:0:104924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c01484600/0xefc0bb7231291b34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231291b2d expref: 17 pid: 5845 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305160.914410:0:104924:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104924:1876219785790208:0@lo:104: 00000100:00100000:2.0:1789305160.914433:0:104924:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305160.914478:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785789952 00000100:00100000:3.0:1789305160.914486:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785789952 00000100:00100000:3.0:1789305160.914540:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785790080 00000100:00100000:3.0:1789305160.914543:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785790080 00000100:00100000:3.0:1789305160.914558:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1789305160.914567:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+4:104924:x1876219785789952:12345-0@lo:104: 00010000:00010000:3.0:1789305160.914581:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c01683600/0xefc0bb7231291b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231291b50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914634:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305160.914640:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+4:104924:x1876219785789952:12345-0@lo:104: Request processed in 75us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305160.914647:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1789305160.914664:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789305160.914671:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104924:x1876219785790080:12345-0@lo:104: 00010000:00010000:3.0:1789305160.914678:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fc00/0xefc0bb7231291b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231291b42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914711:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789305160.914716:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104924:x1876219785790080:12345-0@lo:104: Request processed in 47us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305160.914722:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00010000:00010000:3.0:1789305160.914740:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789305160.914746:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c01683600/0xefc0bb7231291b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231291b50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914753:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c01683600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789305160.914758:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c01683600/0xefc0bb7231291b49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231291b50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914767:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c01683600/0xefc0bb7231291b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231291b50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789305160.914774:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c01683600/0xefc0bb7231291b49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231291b50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305160.914780:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789305160.914811:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c01683600/0xefc0bb7231291b49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231291b50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914818:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305160.914839:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c01683600/0xefc0bb7231291b49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231291b50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914851:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c01683600/0xefc0bb7231291b49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231291b50 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914863:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789305160.914866:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fc00/0xefc0bb7231291b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231291b42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914872:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c10e8fc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789305160.914875:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fc00/0xefc0bb7231291b3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231291b42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914881:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fc00/0xefc0bb7231291b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231291b42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789305160.914887:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fc00/0xefc0bb7231291b3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231291b42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305160.914892:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789305160.914905:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fc00/0xefc0bb7231291b3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231291b42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914911:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305160.914916:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fc00/0xefc0bb7231291b3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231291b42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914922:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c10e8fc00/0xefc0bb7231291b3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231291b42 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.914931:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305160.914933:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305160.914935:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305160.914942:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305160.914961:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785790336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305160.914989:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305160.915012:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305160.915018:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785790464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305160.915039:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305160.915067:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785790336 00000100:00100000:3.0:1789305160.915070:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785790336 00010000:00010000:3.0:1789305160.915086:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c00031e00/0xefc0bb7231291b50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231291b49 expref: 18 pid: 5847 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305160.915128:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785790464 00000100:00100000:3.0:1789305160.915130:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785790464 00010000:00010000:3.0:1789305160.915140:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c00030600/0xefc0bb7231291b42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231291b3b expref: 19 pid: 5846 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305160.915155:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1789305160.915161:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785790336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305160.915170:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305160.915174:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c00031e00/0xefc0bb7231291b50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231291b49 expref: 19 pid: 5847 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.915184:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c00031e00/0xefc0bb7231291b50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231291b49 expref: 19 pid: 5847 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.915197:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305160.915224:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785790336:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305160.915233:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1789305160.915246:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1789305160.915252:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785790464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305160.915259:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305160.915263:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c00030600/0xefc0bb7231291b42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231291b3b expref: 18 pid: 5846 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.915271:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c00030600/0xefc0bb7231291b42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231291b3b expref: 18 pid: 5846 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.915279:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305160.915300:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785790464:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305160.915304:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1789305160.915348:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785790464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305160.915356:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785790336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789305160.915575:0:104924:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c840 going to sleep for 11 seconds 00010000:00010000:2.0:1789305160.915589:0:104924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c00031e00/0xefc0bb7231291b50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231291b49 expref: 17 pid: 5847 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305160.915600:0:104924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c385e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104924:1876219785789952:0@lo:104: 00010000:00010000:2.0:1789305160.915611:0:104924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c00030600/0xefc0bb7231291b42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231291b3b expref: 16 pid: 5846 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305160.915620:0:104924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104924:1876219785790080:0@lo:104: 00000100:00100000:3.0:1789305160.915666:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785790208 00000100:00100000:3.0:1789305160.915671:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785790208 00000100:00100000:3.0:1789305160.915704:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1789305160.915711:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104924:x1876219785790208:12345-0@lo:104: 00010000:00010000:3.0:1789305160.915719:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c00030800/0xefc0bb7231291b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231291b34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.915859:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789305160.915865:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:104924:x1876219785790208:12345-0@lo:104: Request processed in 155us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305160.915875:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00010000:00010000:1.0:1789305160.915925:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789305160.915932:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c00030800/0xefc0bb7231291b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231291b34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305160.915940:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c00030800 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789305160.915943:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c00030800/0xefc0bb7231291b2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231291b34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305160.915956:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c00030800/0xefc0bb7231291b2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231291b34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789305160.915963:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c00030800/0xefc0bb7231291b2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231291b34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305160.915968:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789305160.915998:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c00030800/0xefc0bb7231291b2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231291b34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305160.916004:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789305160.916022:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c00030800/0xefc0bb7231291b2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231291b34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305160.916030:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c00030800/0xefc0bb7231291b2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231291b34 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305160.916044:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305160.916046:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305160.916048:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305160.916058:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785790592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789305160.916086:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305160.916215:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785790592 00000100:00100000:3.0:1789305160.916219:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785790592 00010000:00010000:3.0:1789305160.916236:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c01484600/0xefc0bb7231291b34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231291b2d expref: 16 pid: 5845 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305160.916263:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1789305160.916270:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:3312:x1876219785790592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305160.916278:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305160.916283:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c01484600/0xefc0bb7231291b34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231291b2d expref: 16 pid: 5845 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916293:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c01484600/0xefc0bb7231291b34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231291b2d expref: 16 pid: 5845 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916306:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916315:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916328:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916336:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916343:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916355:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916361:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305160.916378:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916386:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916395:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305160.916405:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305160.916436:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:3312:x1876219785790592:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305160.916443:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1789305160.916469:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785790592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305160.917176:0:104924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c01484600/0xefc0bb7231291b34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231291b2d expref: 15 pid: 5845 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305160.917194:0:104924:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104924:1876219785790208:0@lo:104: 00010000:00010000:2.0:1789305160.917216:0:104924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.917226:0:104924:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.917233:0:104924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305160.917239:0:104924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb7231298186 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305161.042402:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789305161.816131:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789305161.816140:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2c3fb35000 from 7 10000000:01000000:2.0:1789305161.816146:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789305161.816195:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305161.816208:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305161.816220:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305161.816250:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785790720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.816332:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.816393:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.819620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785790720 00000100:00100000:0.0:1789305161.819638:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785790720 00000100:00100000:0.0:1789305161.819796:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1789305161.819808:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+15:5849:x1876219785790720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305161.819830:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305161.819856:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298194 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129818d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.819884:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129818d expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.819897:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129818d expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.819906:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb800, rc 0) 00000100:00100000:0.0:1789305161.819991:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:5849:x1876219785790720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.819998:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1789305161.820048:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785790720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305161.820066:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305161.820077:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305161.820168:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785790848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.820203:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.820233:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789305161.820247:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785790848 00000100:00100000:2.0:1789305161.820251:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785790848 00000100:00100000:2.0:1789305161.820276:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1789305161.820282:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:5849:x1876219785790848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.820541:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:5849:x1876219785790848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305161.820548:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1789305161.820579:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785790848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.820606:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785790976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.820643:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.820665:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.820678:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785790976 00000100:00100000:0.0:1789305161.820682:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785790976 00000100:00100000:0.0:1789305161.820705:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1789305161.820711:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:5849:x1876219785790976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789305161.820858:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:5849:x1876219785790976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.820865:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1789305161.822241:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785790976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.824447:0:104986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104986:1876219785791104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789305161.824533:0:104986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.824581:0:104986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.824647:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785791104 00000100:00100000:0.0:1789305161.824656:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785791104 00000100:00100000:0.0:1789305161.824706:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1789305161.824715:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:104986:x1876219785791104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789305161.824945:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:104986:x1876219785791104:12345-0@lo:502:llog_process_th.0 Request processed in 230us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.824953:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1789305161.824967:0:104986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104986:1876219785791104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789305161.824997:0:104986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789305161.825006:0:104986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789305161.825008:0:104986:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:3.0:1789305161.825015:0:104986:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2c3fb35000 00000020:00000080:3.0:1789305161.825017:0:104986:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:00020000:0.0:1789305161.825304:0:104986:0:(obd_config.c:1432:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 271us 00000100:00100000:0.0:1789305161.841292:0:104986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104986:1876219785791232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789305161.841406:0:104986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305161.841450:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785791232 00000100:00100000:0.0:1789305161.841460:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785791232 00000100:00100000:0.0:1789305161.841523:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:0.0:1789305161.841534:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:104986:x1876219785791232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789305161.841756:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:104986:x1876219785791232:12345-0@lo:502:llog_process_th.0 Request processed in 223us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.841764:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:0.0:1789305161.841812:0:104986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c19bae9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.841835:0:104986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104986:1876219785791232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789305161.841862:0:104986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789305161.841870:0:104986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789305161.841872:0:104986:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:0.0:1789305161.841877:0:104986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789305161.841940:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789305161.841957:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789305161.841966:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.841978:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305161.841994:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305161.841996:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305161.841999:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305161.842023:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.842031:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.842040:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305161.842054:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785791360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305161.842084:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305161.842118:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaa600 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.842132:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785791360 00000100:00100000:0.0:1789305161.842135:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785791360 00000100:00100000:0.0:1789305161.842157:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:0.0:1789305161.842163:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:5849:x1876219785791360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305161.842172:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305161.842184:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312981a2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129819b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.842205:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312981a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129819b expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.842216:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312981a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129819b expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.842229:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afac00, rc 0) 00000100:00100000:0.0:1789305161.842256:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785791360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.842261:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:0.0:1789305161.842289:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785791360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305161.842300:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.842308:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305161.842321:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789305161.842325:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.842332:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305161.842339:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789305161.842341:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2c02eb8000 from 7 10000000:01000000:0.0:1789305161.842343:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789305161.846615:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.846631:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.846645:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305161.846671:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785791488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305161.846739:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305161.847011:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c05aaa600 going to sleep for 11 seconds 00000100:00100000:1.0:1789305161.847519:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785791488 00000100:00100000:1.0:1789305161.847530:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785791488 00000100:00100000:1.0:1789305161.847612:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:1.0:1789305161.847622:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785791488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305161.847637:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305161.847652:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371c00/0xefc0bb72312981b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312981a9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305161.847679:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371c00/0xefc0bb72312981b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312981a9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305161.847690:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371c00/0xefc0bb72312981b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312981a9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305161.847699:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371c00, rc 0) 00000100:00100000:1.0:1789305161.847760:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785791488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305161.847767:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1789305161.847839:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785791488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305161.847855:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305161.847864:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305161.847927:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785791616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.847959:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.848047:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.848140:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785791616 00000100:00100000:0.0:1789305161.848145:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785791616 00000100:00100000:0.0:1789305161.848168:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:0.0:1789305161.848175:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785791616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789305161.848434:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785791616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.848441:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1789305161.848522:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785791616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.848550:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785791744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.848592:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.848620:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.848661:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785791744 00000100:00100000:0.0:1789305161.848665:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785791744 00000100:00100000:0.0:1789305161.848684:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:0.0:1789305161.848691:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785791744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789305161.848865:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785791744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.848872:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1789305161.848970:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785791744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789305161.849350:0:104988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104988:1876219785791872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789305161.849401:0:104988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305161.849430:0:104988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c012549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.849469:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785791872 00000100:00100000:0.0:1789305161.849475:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785791872 00000100:00100000:0.0:1789305161.849506:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1789305161.849514:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:104988:x1876219785791872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789305161.849657:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:104988:x1876219785791872:12345-0@lo:502:llog_process_th.0 Request processed in 144us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.849664:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1789305161.849756:0:104988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104988:1876219785791872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789305161.849783:0:104988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789305161.849792:0:104988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789305161.849794:0:104988:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:2.0:1789305161.849801:0:104988:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2c02eb8000 00000020:00000080:2.0:1789305161.849804:0:104988:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:00020000:2.0:1789305161.850271:0:104988:0:(obd_config.c:1432:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 452us 00000100:00100000:2.0:1789305161.850295:0:104988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104988:1876219785792000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789305161.850334:0:104988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.850371:0:104988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.850408:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785792000 00000100:00100000:0.0:1789305161.850413:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785792000 00000100:00100000:0.0:1789305161.850443:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1789305161.850450:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:104988:x1876219785792000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789305161.850589:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:104988:x1876219785792000:12345-0@lo:502:llog_process_th.0 Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.850597:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1789305161.850696:0:104988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104988:1876219785792000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789305161.850717:0:104988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789305161.850722:0:104988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789305161.850724:0:104988:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:2.0:1789305161.850727:0:104988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789305161.850862:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789305161.850881:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789305161.850890:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.850902:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305161.850912:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789305161.850915:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2c205fe800 from 7 10000000:01000000:0.0:1789305161.850917:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789305161.850941:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.850950:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.850960:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305161.850975:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785792128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305161.851007:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305161.851180:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c19bae9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789305161.851299:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785792128 00000100:00100000:3.0:1789305161.851305:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785792128 00000100:00100000:3.0:1789305161.851341:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1789305161.851350:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785792128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305161.851372:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305161.851385:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312981be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312981b7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305161.851408:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312981be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312981b7 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305161.851417:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312981be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312981b7 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305161.851426:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860ec00, rc 0) 00000100:00100000:3.0:1789305161.851469:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785792128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305161.851475:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:2.0:1789305161.851564:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785792128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305161.851577:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305161.851587:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305161.851631:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785792256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.851659:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.851685:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.851730:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785792256 00000100:00100000:0.0:1789305161.851734:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785792256 00000100:00100000:0.0:1789305161.851751:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:0.0:1789305161.851757:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785792256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789305161.851991:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785792256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.851998:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:2.0:1789305161.852060:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785792256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.852086:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785792384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.852152:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.852172:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.852231:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785792384 00000100:00100000:0.0:1789305161.852235:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785792384 00000100:00100000:0.0:1789305161.852252:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:0.0:1789305161.852258:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785792384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789305161.852390:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785792384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.852396:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:2.0:1789305161.852478:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785792384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789305161.852800:0:104990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104990:1876219785792512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789305161.852836:0:104990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.852858:0:104990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.852897:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785792512 00000100:00100000:0.0:1789305161.852902:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785792512 00000100:00100000:0.0:1789305161.852920:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:0.0:1789305161.852926:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:104990:x1876219785792512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789305161.853061:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:104990:x1876219785792512:12345-0@lo:502:llog_process_th.0 Request processed in 133us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.853068:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:2.0:1789305161.853406:0:104990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104990:1876219785792512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789305161.853432:0:104990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789305161.853440:0:104990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789305161.853442:0:104990:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:2.0:1789305161.853449:0:104990:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e2c205fe800 00000020:00000080:2.0:1789305161.853451:0:104990:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:00020000:2.0:1789305161.853854:0:104990:0:(obd_config.c:1432:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 389us 00000100:00100000:2.0:1789305161.853883:0:104990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104990:1876219785792640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789305161.853928:0:104990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305161.853958:0:104990:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c40d1c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789305161.853998:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785792640 00000100:00100000:0.0:1789305161.854004:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785792640 00000100:00100000:0.0:1789305161.854036:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:0.0:1789305161.854044:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:104990:x1876219785792640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789305161.854234:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:104990:x1876219785792640:12345-0@lo:502:llog_process_th.0 Request processed in 191us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305161.854245:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1789305161.854328:0:104990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:efa29217-37b2-4712-9233-afe8f4b7c3f7:104990:1876219785792640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789305161.854350:0:104990:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789305161.854368:0:104990:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789305161.854370:0:104990:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:2.0:1789305161.854375:0:104990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789305161.854540:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789305161.854561:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789305161.854572:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305161.854584:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305162.066288:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305162.528445:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785792768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305162.528516:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305162.528638:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785792768 00000100:00100000:0.0:1789305162.528647:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785792768 00000100:00100000:0.0:1789305162.528711:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1789305162.528720:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785792768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789305162.528756:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305162.528805:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785792768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305162.528813:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00080000:3.0:1789305162.528930:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305162.528970:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785792768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305163.026568:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785793024:0@lo:400:kworker.0 00000100:00100000:0.0:1789305163.026645:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305163.026715:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789305163.026721:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785792896:0@lo:400:kworker.0 00000100:00100000:0.0:1789305163.026747:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305163.026769:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785793408:0@lo:400:kworker.0 00000100:00100000:0.0:1789305163.026787:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305163.026813:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785792896 00000100:00100000:0.0:1789305163.026821:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785792896 00000100:00100000:0.0:1789305163.026860:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:0.0:1789305163.026868:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785792896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305163.026917:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785792896:12345-0@lo:400:kworker.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305163.026924:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:0.0:1789305163.026968:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785792896:0@lo:400:kworker.0 00000100:00100000:1.0:1789305163.027039:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785793024 00000100:00100000:1.0:1789305163.027043:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785793024 00000100:00100000:1.0:1789305163.027080:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785793408 00000100:00100000:1.0:1789305163.027083:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785793408 00000100:00100000:1.0:1789305163.027142:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:1.0:1789305163.027149:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785793024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305163.027188:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785793024:12345-0@lo:400:kworker.0 Request processed in 39us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305163.027194:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00100000:1.0:1789305163.027206:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:1.0:1789305163.027212:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785793408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305163.027237:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785793408:12345-0@lo:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305163.027243:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:1.0:1789305163.027281:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785793408:0@lo:400:kworker.0 00000100:00100000:1.0:1789305163.027290:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785793024:0@lo:400:kworker.0 00000100:00100000:3.0:1789305163.027410:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785793280:0@lo:400:kworker.0 00000100:00100000:3.0:1789305163.027441:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305163.027472:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789305163.027479:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785793152:0@lo:400:kworker.0 00000100:00100000:3.0:1789305163.027503:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789305163.027533:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305163.027545:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785793152 00000100:00100000:3.0:1789305163.027549:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785793152 00000100:00100000:3.0:1789305163.027583:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1789305163.027589:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785793152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305163.027623:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785793152:12345-0@lo:400:kworker.0 Request processed in 34us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305163.027629:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00080000:3.0:1789305163.027645:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305163.027671:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785793152:0@lo:400:kworker.0 00000100:00100000:1.0:1789305163.027794:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785793280 00000100:00100000:1.0:1789305163.027798:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785793280 00000100:00100000:1.0:1789305163.027838:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:1.0:1789305163.027844:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785793280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305163.027875:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785793280:12345-0@lo:400:kworker.0 Request processed in 31us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305163.027881:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00080000:3.0:1789305163.028288:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305163.028316:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785793280:0@lo:400:kworker.0 00010000:00010000:1.0:1789305163.090334:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305163.538442:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305163.538476:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785793536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305163.538552:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305163.538743:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785793536 00000100:00100000:0.0:1789305163.538751:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785793536 00000100:00100000:0.0:1789305163.538843:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1789305163.538853:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785793536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305163.538892:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305163.538950:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785793536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305163.538957:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:3.0:1789305163.539111:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785793536:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789305164.123630:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305165.144313:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305166.164393:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789305166.752655:0:105225:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: start setup 09:12:45 (1789305165) === 00010000:00010000:0.0:1789305167.186293:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305167.634454:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305167.634481:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785793664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305167.634561:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305167.634713:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785793664 00000100:00100000:0.0:1789305167.634725:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785793664 00000100:00100000:0.0:1789305167.634803:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1789305167.634812:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785793664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789305167.634848:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305167.634894:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785793664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305167.634899:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1789305167.634937:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785793664:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789305167.635005:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305168.164619:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785794176:0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.164710:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305168.164795:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789305168.164801:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785793792:0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.164835:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305168.164876:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785794304:0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.164899:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305168.164927:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785793920:0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.164952:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305168.164971:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789305168.164975:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785794048:0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.164998:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305168.165030:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785794176 00000100:00100000:2.0:1789305168.165040:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785794176 00000100:00100000:2.0:1789305168.165129:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785794304 00000100:00100000:2.0:1789305168.165133:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785794304 00000100:00100000:2.0:1789305168.165165:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785793920 00000100:00100000:2.0:1789305168.165168:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785793920 00000100:00100000:2.0:1789305168.165188:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:2.0:1789305168.165196:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785794176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.165248:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785794176:12345-0@lo:400:kworker.0 Request processed in 53us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305168.165255:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:2.0:1789305168.165273:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885 00000100:00100000:2.0:1789305168.165279:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785794304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.165315:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785794304:12345-0@lo:400:kworker.0 Request processed in 36us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305168.165320:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885 00000100:00100000:2.0:1789305168.165331:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1789305168.165336:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785793920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.165499:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785793920:12345-0@lo:400:kworker.0 Request processed in 161us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305168.165506:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1789305168.165527:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785793792 00000100:00100000:2.0:1789305168.165531:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785793792 00000100:00100000:2.0:1789305168.165557:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1789305168.165563:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785793792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.165593:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785793792:12345-0@lo:400:kworker.0 Request processed in 31us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305168.165599:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1789305168.165632:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785794048 00000100:00100000:2.0:1789305168.165635:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785794048 00000100:00100000:2.0:1789305168.165661:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1789305168.165667:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785794048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.165694:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785794048:12345-0@lo:400:kworker.0 Request processed in 27us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305168.165700:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00080000:2.0:1789305168.165729:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789305168.165734:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305168.165765:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785793792:0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.165778:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785794304:0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.165787:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785794176:0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.165815:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785794048:0@lo:400:kworker.0 00000100:00100000:2.0:1789305168.165823:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785793920:0@lo:400:kworker.0 00010000:00010000:1.0:1789305168.210303:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305168.663021:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789305168.663045:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785794432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305168.663130:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305168.663201:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785794432 00000100:00100000:0.0:1789305168.663209:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785794432 00000100:00100000:0.0:1789305168.663265:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1789305168.663275:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785794432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305168.663322:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305168.663369:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785794432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305168.663377:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1789305168.663427:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785794432:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789305169.237177:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305170.261430:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305171.282304:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305172.306320:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305172.754343:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789305172.755996:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785794560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305172.756082:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305172.756482:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785794560 00000100:00100000:0.0:1789305172.756495:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785794560 00000100:00080000:2.0:1789305172.756810:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789305172.756850:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:0.0:1789305172.756863:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785794560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789305172.756910:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305172.756979:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785794560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305172.756987:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:2.0:1789305172.757076:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785794560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305173.266663:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785794816:0@lo:400:kworker.0 00000100:00100000:2.0:1789305173.266740:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785794688:0@lo:400:kworker.0 00000100:00100000:1.0:1789305173.266750:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305173.266807:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785794816 00000100:00100000:0.0:1789305173.266817:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785794816 00000100:00100000:3.0:1789305173.266872:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785794944:0@lo:400:kworker.0 00000100:00100000:0.0:1789305173.266876:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:0.0:1789305173.266888:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785794816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305173.267319:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305173.267366:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785795200:0@lo:400:kworker.0 00000100:00100000:2.0:1789305173.267540:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305173.267590:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785795072:0@lo:400:kworker.0 00000100:00100000:2.0:1789305173.267617:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305173.267648:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785795200 00000100:00100000:2.0:1789305173.267653:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785795200 00000100:00100000:2.0:1789305173.267687:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785795072 00000100:00100000:2.0:1789305173.267690:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785795072 00000100:00100000:2.0:1789305173.267706:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:2.0:1789305173.267712:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785795200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305173.267754:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785795200:12345-0@lo:400:kworker.0 Request processed in 41us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305173.267761:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00100000:2.0:1789305173.267777:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:2.0:1789305173.267783:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785795072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305173.267813:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785795072:12345-0@lo:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305173.267818:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00100000:2.0:1789305173.267836:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785794688 00000100:00100000:2.0:1789305173.267840:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785794688 00000100:00100000:2.0:1789305173.267864:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1789305173.267871:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785794688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305173.267899:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785794688:12345-0@lo:400:kworker.0 Request processed in 30us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305173.267904:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00080000:2.0:1789305173.267939:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305173.267968:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785795072:0@lo:400:kworker.0 00000100:00100000:2.0:1789305173.267996:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785794688:0@lo:400:kworker.0 00000100:00100000:2.0:1789305173.268152:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785795200:0@lo:400:kworker.0 00000100:00100000:3.0:1789305173.274228:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305173.278984:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785794944 00000100:00100000:2.0:1789305173.279008:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785794944 00000100:00100000:2.0:1789305173.279138:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1789305173.279150:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785794944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305173.279275:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785794944:12345-0@lo:400:kworker.0 Request processed in 127us (5053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305173.279284:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1789305173.279359:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785794944:0@lo:400:kworker.0 00000100:00080000:3.0:1789305173.280172:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305173.280557:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785794816:12345-0@lo:400:kworker.0 Request processed in 13667us (13805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305173.280572:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00100000:1.0:1789305173.280911:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785794816:0@lo:400:kworker.0 00010000:00010000:2.0:1789305173.330414:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305173.778409:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785795328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305173.778492:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305173.778664:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785795328 00000100:00100000:3.0:1789305173.778673:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785795328 00000100:00100000:3.0:1789305173.778731:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1789305173.778741:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785795328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789305173.778777:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305173.778829:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785795328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305173.778837:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1789305173.779067:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785795328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789305174.354414:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305175.380690:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305176.403337:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305177.426714:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789305177.871264:0:105631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing load_modules_local 00000100:00100000:2.0:1789305177.874422:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785795456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789305177.874561:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305177.874688:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785795456 00000100:00100000:3.0:1789305177.874708:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785795456 00000100:00100000:3.0:1789305177.874771:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:3.0:1789305177.874780:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785795456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789305177.874815:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305177.874858:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785795456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305177.874864:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00080000:2.0:1789305177.874916:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305177.874946:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36ead500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785795456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305178.392942:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785795584:0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.393016:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305178.393066:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785796096:0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.393187:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305178.393229:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789305178.393235:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785795968:0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.393258:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305178.393286:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785795712:0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.393324:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305178.393342:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785796224:0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.393362:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305178.393391:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305178.393398:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785795840:0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.393419:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305178.393732:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785795584 00000100:00100000:3.0:1789305178.393742:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785795584 00000100:00100000:3.0:1789305178.393796:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:3.0:1789305178.393806:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785795584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.393867:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785795584:12345-0@lo:400:kworker.0 Request processed in 61us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305178.393875:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:3.0:1789305178.393915:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785796096 00000100:00100000:3.0:1789305178.393919:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785796096 00000100:00100000:3.0:1789305178.393953:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785795968 00000100:00100000:3.0:1789305178.393956:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785795968 00000100:00100000:3.0:1789305178.393973:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785795712 00000100:00100000:3.0:1789305178.393975:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785795712 00000100:00100000:3.0:1789305178.393987:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:3.0:1789305178.393993:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785796096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.394026:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785796096:12345-0@lo:400:kworker.0 Request processed in 33us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305178.394031:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00100000:3.0:1789305178.394042:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:3.0:1789305178.394048:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785795968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.394075:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785795968:12345-0@lo:400:kworker.0 Request processed in 27us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305178.394081:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00100000:3.0:1789305178.394106:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:3.0:1789305178.394113:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785795712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.394144:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785795712:12345-0@lo:400:kworker.0 Request processed in 31us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305178.394149:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00100000:3.0:1789305178.394172:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785796224 00000100:00100000:3.0:1789305178.394176:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785796224 00000100:00100000:3.0:1789305178.394196:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785795840 00000100:00100000:3.0:1789305178.394211:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785795840 00000100:00100000:3.0:1789305178.394233:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1789305178.394239:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785796224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.394270:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785796224:12345-0@lo:400:kworker.0 Request processed in 31us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305178.394276:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1789305178.394286:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1789305178.394292:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785795840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.394318:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785795840:12345-0@lo:400:kworker.0 Request processed in 26us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305178.394324:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1789305178.394367:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785795968:0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.394378:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785795584:0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.394388:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785796096:0@lo:400:kworker.0 00000100:00080000:3.0:1789305178.394413:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789305178.394417:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305178.394439:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785795840:0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.395935:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785795712:0@lo:400:kworker.0 00000100:00100000:3.0:1789305178.395952:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785796224:0@lo:400:kworker.0 00010000:00010000:0.0:1789305178.465170:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305178.898458:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785796352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305178.898533:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305178.898604:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785796352 00000100:00100000:1.0:1789305178.898612:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785796352 00000100:00100000:1.0:1789305178.898655:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1789305178.898663:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785796352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305178.898697:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305178.898742:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785796352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305178.898749:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1789305178.898793:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785796352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789305179.486453:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305180.498576:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305181.522282:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789305182.092962:0:105895:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00010000:00010000:1.0:1789305182.546743:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305182.995417:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789305183.004733:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785796480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305183.004821:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305183.005080:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785796480 00000100:00100000:2.0:1789305183.005103:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785796480 00000100:00100000:2.0:1789305183.005186:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00080000:0.0:1789305183.005195:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305183.005197:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785796480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305183.005253:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305183.005316:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785796480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305183.005324:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:0.0:1789305183.005425:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785796480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305183.506666:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785796736:0@lo:400:kworker.0 00000100:00100000:1.0:1789305183.506701:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785796992:0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.506735:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305183.506761:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305183.506796:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785797248:0@lo:400:kworker.0 00000100:00100000:1.0:1789305183.506802:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789305183.506811:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785796608:0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.506829:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305183.506857:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305183.506865:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785796864:0@lo:400:kworker.0 00000100:00100000:1.0:1789305183.506873:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305183.506902:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305183.506911:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785797120:0@lo:400:kworker.0 00000100:00100000:1.0:1789305183.506944:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305183.506946:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785796736 00000100:00100000:3.0:1789305183.506954:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785796736 00000100:00100000:1.0:1789305183.506986:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785796608 00000100:00100000:1.0:1789305183.506991:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785796608 00000100:00100000:1.0:1789305183.507031:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1789305183.507040:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785796608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305183.507118:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785796608:12345-0@lo:400:kworker.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305183.507126:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1789305183.507190:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785796608:0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.508124:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785796992 00000100:00100000:3.0:1789305183.508132:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785796992 00000100:00100000:3.0:1789305183.508188:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785797120 00000100:00100000:3.0:1789305183.508191:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785797120 00000100:00100000:1.0:1789305183.508231:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:1.0:1789305183.508322:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785796736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.508337:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:3.0:1789305183.508347:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785796992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305183.508392:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785796736:12345-0@lo:400:kworker.0 Request processed in 151us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305183.508400:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00100000:1.0:1789305183.508540:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:1.0:1789305183.508549:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785797120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.508580:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785796992:12345-0@lo:400:kworker.0 Request processed in 234us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305183.508588:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:1.0:1789305183.508593:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785797120:12345-0@lo:400:kworker.0 Request processed in 45us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305183.508602:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00100000:3.0:1789305183.508618:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785797248 00000100:00100000:3.0:1789305183.508622:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785797248 00000100:00100000:3.0:1789305183.508653:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785796864 00000100:00100000:3.0:1789305183.508656:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785796864 00000100:00100000:3.0:1789305183.508679:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1789305183.508685:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785797248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.508719:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785797248:12345-0@lo:400:kworker.0 Request processed in 34us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305183.508724:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1789305183.508739:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1789305183.508745:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785796864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.508769:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785796864:12345-0@lo:400:kworker.0 Request processed in 25us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305183.508778:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00080000:3.0:1789305183.508811:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789305183.508816:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305183.508855:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785796864:0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.508870:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785796736:0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.508879:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785797248:0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.508917:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785797120:0@lo:400:kworker.0 00000100:00100000:3.0:1789305183.508930:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785796992:0@lo:400:kworker.0 00010000:00010000:0.0:1789305183.573278:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305184.019743:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789305184.019923:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785797376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305184.019981:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305184.020027:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785797376 00000100:00100000:3.0:1789305184.020036:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785797376 00000100:00100000:3.0:1789305184.020177:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:3.0:1789305184.020188:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785797376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789305184.020226:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305184.020276:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785797376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305184.020283:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1789305184.020311:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785797376:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789305184.597334:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789305185.357787:0:106091:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000020:00000004:2.0:1789305185.364055:0:106092:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000020:00000004:1.0:1789305185.390950:0:106093:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00010000:00010000:2.0:1789305185.618431:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789305186.168817:0:106141:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5e65cd20 20000000:00000080:1.0:1789305186.168836:0:106141:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e2c3f6f4800 uarg=0000000000000000 20000000:01000000:1.0:1789305186.168868:0:106141:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789305186.168876:0:106141:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789305186.168880:0:106141:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789305186.169824:0:106142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789305186.169986:0:106141:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789305186.178024:0:106141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789305186.178063:0:106141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.178086:0:106141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129818d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.178144:0:106141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41371c00/0xefc0bb72312981b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312981a9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.178151:0:106141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312981be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312981b7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.178159:0:106141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 6/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.178207:0:106141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312981be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312981b7 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.178225:0:106141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312981be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312981b7 expref: 18 pid: 5847 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305186.178241:0:106141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106141:1876219785797504:0@lo:104: 00000100:00100000:1.0:1789305186.178316:0:106141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789305186.178381:0:106141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41371c00/0xefc0bb72312981b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312981a9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.178389:0:106141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c41371c00/0xefc0bb72312981b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312981a9 expref: 18 pid: 5846 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305186.178403:0:106141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106141:1876219785797632:0@lo:104: 00010000:00010000:1.0:1789305186.178428:0:106141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129818d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.178437:0:106141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298194 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129818d expref: 18 pid: 5846 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305186.178445:0:106141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106141:1876219785797760:0@lo:104: 00000100:00100000:1.0:1789305186.178462:0:106141:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08e1b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789305186.180080:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789305186.180155:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305186.180186:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305186.180204:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785797504 00000100:00100000:0.0:1789305186.180212:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785797504 00000100:00100000:0.0:1789305186.180269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785797632 00000100:00100000:0.0:1789305186.180272:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785797632 00000100:00100000:0.0:1789305186.180284:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785797760 00000100:00100000:0.0:1789305186.180286:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785797760 00000100:00100000:0.0:1789305186.180299:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1789305186.180307:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3b4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+5:106141:x1876219785797504:12345-0@lo:104: 00010000:00010000:0.0:1789305186.180325:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180396:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305186.180402:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3b4e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+5:106141:x1876219785797504:12345-0@lo:104: Request processed in 96us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305186.180409:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1789305186.180449:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789305186.180456:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+4:106141:x1876219785797632:12345-0@lo:104: 00010000:00010000:0.0:1789305186.180464:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180498:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789305186.180503:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+4:106141:x1876219785797632:12345-0@lo:104: Request processed in 48us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305186.180509:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789305186.180521:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1789305186.180527:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:106141:x1876219785797760:12345-0@lo:104: 00010000:00010000:0.0:1789305186.180535:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180568:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789305186.180573:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41245180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:106141:x1876219785797760:12345-0@lo:104: Request processed in 46us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305186.180578:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00010000:00010000:0.0:1789305186.180596:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789305186.180602:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180610:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305186.180614:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180624:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305186.180637:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305186.180644:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789305186.180682:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180689:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305186.180711:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180718:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa600/0xefc0bb72312981b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180732:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789305186.180735:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180741:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afbc00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305186.180743:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180750:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305186.180757:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305186.180762:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789305186.180776:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180782:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305186.180788:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180794:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afbc00/0xefc0bb72312981a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180803:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305186.180806:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180811:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305186.180815:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180821:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305186.180827:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305186.180832:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789305186.180844:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180850:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305186.180866:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180878:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129818d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.180892:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305186.180893:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305186.180895:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305186.180902:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305186.180908:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305186.180927:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785797888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305186.180960:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305186.180995:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789305186.181002:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785798016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305186.181025:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305186.181049:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785798144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305186.181066:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305186.181116:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785797888 00000100:00100000:0.0:1789305186.181120:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785797888 00010000:00010000:0.0:1789305186.181158:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312981be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312981b7 expref: 19 pid: 5847 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305186.181177:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785798016 00000100:00100000:0.0:1789305186.181179:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785798016 00010000:00010000:0.0:1789305186.181190:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41371c00/0xefc0bb72312981b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312981a9 expref: 20 pid: 5846 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305186.181197:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785798144 00000100:00100000:0.0:1789305186.181199:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785798144 00010000:00010000:0.0:1789305186.181207:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298194 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129818d expref: 21 pid: 5846 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305186.181217:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1789305186.181222:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+21:3314:x1876219785797888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305186.181231:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305186.181236:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312981be lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312981b7 expref: 21 pid: 5847 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181245:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312981be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312981b7 expref: 21 pid: 5847 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181260:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305186.181289:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+21:3314:x1876219785797888:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305186.181296:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1789305186.181310:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1789305186.181316:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2eb4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+20:3314:x1876219785798016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305186.181323:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305186.181328:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41371c00/0xefc0bb72312981b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312981a9 expref: 20 pid: 5846 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181335:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41371c00/0xefc0bb72312981b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312981a9 expref: 20 pid: 5846 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181343:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305186.181363:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2eb4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+20:3314:x1876219785798016:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305186.181369:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1789305186.181400:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1789305186.181406:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785798144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305186.181413:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305186.181416:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298194 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129818d expref: 19 pid: 5846 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181424:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298194 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129818d expref: 19 pid: 5846 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181436:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181445:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181459:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181466:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181473:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181480:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181485:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371e00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305186.181489:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181495:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181503:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.181512:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305186.181536:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785798144:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305186.181542:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1789305186.181578:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785798144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305186.181595:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785798016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305186.181600:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c41246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785797888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305186.181748:0:106141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860ec00/0xefc0bb72312981be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312981b7 expref: 18 pid: 5847 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305186.181761:0:106141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106141:1876219785797504:0@lo:104: 00010000:00010000:1.0:1789305186.181772:0:106141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371c00/0xefc0bb72312981b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312981a9 expref: 17 pid: 5846 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305186.181793:0:106141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106141:1876219785797632:0@lo:104: 00010000:00010000:1.0:1789305186.181803:0:106141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298194 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129818d expref: 16 pid: 5846 timeout: 2735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305186.181811:0:106141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:106141:1876219785797760:0@lo:104: 00010000:00010000:1.0:1789305186.181826:0:106141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.181835:0:106141:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.181841:0:106141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305186.181847:0:106141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371e00/0xefc0bb72312981c5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 106141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305186.644207:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789305187.085861:0:106191:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=0, dev=0 10000000:01000000:0.0:1789305187.282189:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789305187.282199:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2c3fb35000 from 10 10000000:01000000:0.0:1789305187.282205:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789305187.282260:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305187.282273:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305187.282284:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305187.282310:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305187.282379:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305187.282439:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1789305187.282546:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785798272 00000100:00100000:3.0:1789305187.282556:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785798272 00000100:00100000:3.0:1789305187.282609:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:3.0:1789305187.282617:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:5849:x1876219785798272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305187.282629:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305187.282644:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312981d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312981cc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.282874:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312981d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312981cc expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.282887:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312981d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312981cc expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.282896:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789305187.282943:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785798272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 327us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305187.282949:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:0.0:1789305187.283079:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305187.283174:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305187.283184:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305187.283238:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789305187.283265:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305187.283329:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1789305187.283353:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785798400 00000100:00100000:3.0:1789305187.283356:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785798400 00000100:00100000:3.0:1789305187.283385:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:3.0:1789305187.283394:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785798400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789305187.283631:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785798400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305187.283638:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:0.0:1789305187.283849:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789305187.283877:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789305187.283906:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305187.283922:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c110ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1789305187.283939:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785798528 00000100:00100000:3.0:1789305187.283943:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785798528 00000100:00100000:3.0:1789305187.284009:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:3.0:1789305187.284016:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785798528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789305187.284193:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785798528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305187.284200:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:0.0:1789305187.284205:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789305187.285206:0:106203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789305187.285280:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789305187.285297:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789305187.285307:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.285318:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305187.285328:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789305187.285331:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2c02eb8000 from 10 10000000:01000000:3.0:1789305187.285334:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789305187.285363:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.285371:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.285380:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305187.285401:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789305187.285443:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305187.285484:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08f81600 going to sleep for 11 seconds 00000100:00100000:0.0:1789305187.285678:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785798656 00000100:00100000:0.0:1789305187.285684:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785798656 00000100:00100000:0.0:1789305187.285713:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1789305187.285721:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785798656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305187.285732:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305187.285745:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb000/0xefc0bb72312981e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312981da expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305187.285766:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb000/0xefc0bb72312981e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312981da expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305187.285777:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb000/0xefc0bb72312981e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312981da expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305187.285786:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb000, rc 0) 00000100:00100000:0.0:1789305187.285832:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785798656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305187.285838:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:3.0:1789305187.285910:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305187.285923:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.285932:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305187.285977:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789305187.286004:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305187.286064:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08f81600 going to sleep for 11 seconds 00000100:00100000:2.0:1789305187.286146:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785798784 00000100:00100000:2.0:1789305187.286150:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785798784 00000100:00100000:2.0:1789305187.286170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1789305187.286177:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785798784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789305187.286506:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785798784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305187.286513:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:3.0:1789305187.286580:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789305187.286610:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789305187.286648:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305187.286674:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08f81600 going to sleep for 11 seconds 00000100:00100000:0.0:1789305187.287336:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785798912 00000100:00100000:0.0:1789305187.287345:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785798912 00000100:00100000:0.0:1789305187.287375:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1789305187.287382:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785798912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789305187.287536:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785798912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305187.287543:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:3.0:1789305187.287564:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785798912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789305187.288617:0:106204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789305187.288699:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789305187.288715:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789305187.288878:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.288890:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305187.288901:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789305187.288904:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2c205fe800 from 10 10000000:01000000:3.0:1789305187.288907:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789305187.288937:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.288945:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.288954:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305187.288974:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785799040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789305187.289022:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305187.289142:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08f81600 going to sleep for 11 seconds 00000100:00100000:2.0:1789305187.289198:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785799040 00000100:00100000:2.0:1789305187.289205:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785799040 00000100:00100000:2.0:1789305187.289276:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1789305187.289285:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785799040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305187.289297:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305187.289310:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312981ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312981e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305187.289333:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312981ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312981e8 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305187.289344:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312981ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312981e8 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305187.289352:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc600, rc 0) 00000100:00100000:2.0:1789305187.289405:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785799040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305187.289412:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:0.0:1789305187.289484:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785799040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305187.289497:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305187.289506:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305187.289552:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785799168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789305187.289571:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305187.289591:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c18373d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789305187.289621:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785799168 00000100:00100000:1.0:1789305187.289624:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785799168 00000100:00100000:1.0:1789305187.289653:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:1.0:1789305187.289660:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785799168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789305187.289898:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785799168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305187.289903:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1789305187.290000:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785799168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789305187.290024:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785799296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789305187.290057:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305187.290077:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c18373d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789305187.290129:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785799296 00000100:00100000:2.0:1789305187.290133:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785799296 00000100:00100000:2.0:1789305187.290157:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:2.0:1789305187.290163:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785799296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789305187.290298:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785799296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305187.290304:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:0.0:1789305187.290326:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785799296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789305187.291561:0:106205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789305187.291647:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789305187.291670:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789305187.291682:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305187.291694:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305187.667219:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305188.114283:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789305188.114327:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785799424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305188.114444:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305188.114515:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785799424 00000100:00100000:2.0:1789305188.114525:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785799424 00000100:00100000:2.0:1789305188.114607:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1789305188.114618:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c41128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785799424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305188.114656:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305188.114716:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c41128850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785799424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305188.114725:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:0.0:1789305188.114755:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b036ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785799424:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789305188.115657:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305188.629457:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785799552:0@lo:400:kworker.0 00000100:00100000:2.0:1789305188.629533:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305188.629668:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789305188.629675:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785799680:0@lo:400:kworker.0 00000100:00100000:2.0:1789305188.629705:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305188.629744:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785799552 00000100:00100000:2.0:1789305188.629751:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785799552 00000100:00100000:2.0:1789305188.629799:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1789305188.629806:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785799552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305188.629858:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785799552:12345-0@lo:400:kworker.0 Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305188.629865:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1789305188.629912:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785799680 00000100:00100000:2.0:1789305188.629916:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785799680 00000100:00100000:2.0:1789305188.629957:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:2.0:1789305188.629965:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785799680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305188.629997:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785799680:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305188.630002:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00100000:2.0:1789305188.630042:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785799680:0@lo:400:kworker.0 00000100:00100000:2.0:1789305188.630051:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785799552:0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.630444:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785800192:0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.630480:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305188.630505:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789305188.630510:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785800064:0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.630531:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305188.630555:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785799808:0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.630579:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305188.630598:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789305188.630603:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785799936:0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.630623:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305188.630653:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785800192 00000100:00100000:1.0:1789305188.630658:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785800192 00000100:00100000:1.0:1789305188.630689:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785799808 00000100:00100000:1.0:1789305188.630691:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785799808 00000100:00100000:1.0:1789305188.630720:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1789305188.630727:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785800192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.630763:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785800192:12345-0@lo:400:kworker.0 Request processed in 36us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305188.630769:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1789305188.630783:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1789305188.630789:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785799808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.630817:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785799808:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305188.630823:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1789305188.630841:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785800064 00000100:00100000:1.0:1789305188.630844:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785800064 00000100:00100000:1.0:1789305188.630867:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785799936 00000100:00100000:1.0:1789305188.630871:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785799936 00000100:00100000:1.0:1789305188.631237:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:1.0:1789305188.631246:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785800064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.631280:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785800064:12345-0@lo:400:kworker.0 Request processed in 36us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305188.631286:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00100000:1.0:1789305188.631298:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:1.0:1789305188.631303:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785799936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.631327:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785799936:12345-0@lo:400:kworker.0 Request processed in 24us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305188.631332:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00080000:1.0:1789305188.631409:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789305188.631414:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305188.631444:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785799936:0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.631457:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785799808:0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.631481:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785800064:0@lo:400:kworker.0 00000100:00100000:1.0:1789305188.631490:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785800192:0@lo:400:kworker.0 00010000:00010000:0.0:1789305188.690389:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305189.153663:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789305189.153685:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785800320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305189.153753:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305189.153818:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785800320 00000100:00100000:3.0:1789305189.153827:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785800320 00000100:00100000:3.0:1789305189.153870:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1789305189.153879:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785800320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789305189.153912:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305189.153958:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785800320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305189.153966:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1789305189.154020:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785800320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789305189.714699:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789305190.568742:0:106390:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=0, dev=0 00000020:00000004:2.0:1789305190.577214:0:106391:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=0, dev=0 00000020:00000004:1.0:1789305190.597303:0:106392:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=0, dev=0 00010000:00010000:2.0:1789305190.739455:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305191.763846:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305192.787436:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305193.234418:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789305193.241794:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785800448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305193.241868:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305193.243049:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785800448 00000100:00100000:1.0:1789305193.243069:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785800448 00000100:00100000:1.0:1789305193.243436:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1789305193.243445:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785800448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305193.243482:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305193.243542:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785800448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305193.243549:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00080000:0.0:1789305193.243696:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305193.244377:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785800448:0@lo:13:osp-pre-1-0.0 00000020:00000004:1.0:1789305193.328078:0:106537:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=50221, dev=0 00000100:00100000:2.0:1789305193.747650:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785800832:0@lo:400:kworker.0 00000100:00100000:3.0:1789305193.747708:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785800960:0@lo:400:kworker.0 00000100:00100000:2.0:1789305193.747764:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305193.747766:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305193.747859:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785800960 00000100:00100000:3.0:1789305193.747927:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785800960 00000100:00100000:3.0:1789305193.748139:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:3.0:1789305193.748150:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785800960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305193.748217:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785800576:0@lo:400:kworker.0 00000100:00100000:2.0:1789305193.748325:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785800704:0@lo:400:kworker.0 00000100:00100000:2.0:1789305193.748356:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305193.748382:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785801216:0@lo:400:kworker.0 00000100:00100000:2.0:1789305193.748405:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305193.748481:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785800704 00000100:00100000:2.0:1789305193.748486:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785800704 00000100:00100000:2.0:1789305193.748525:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:2.0:1789305193.748556:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785800704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305193.748635:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785800704:12345-0@lo:400:kworker.0 Request processed in 103us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305193.748643:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00080000:2.0:1789305193.748698:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305193.748742:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785800704:0@lo:400:kworker.0 00000100:00100000:2.0:1789305193.748854:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785800832 00000100:00100000:2.0:1789305193.748858:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785800832 00000100:00100000:2.0:1789305193.748930:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785801216 00000100:00100000:2.0:1789305193.748934:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785801216 00000100:00100000:2.0:1789305193.748953:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:2.0:1789305193.748959:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785800832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305193.748996:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785800832:12345-0@lo:400:kworker.0 Request processed in 37us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305193.749020:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:2.0:1789305193.749045:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:2.0:1789305193.749051:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785801216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305193.749183:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785801216:12345-0@lo:400:kworker.0 Request processed in 116us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305193.749189:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00080000:2.0:1789305193.749223:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789305193.749274:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785800832:0@lo:400:kworker.0 00000100:00100000:2.0:1789305193.749318:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785801216:0@lo:400:kworker.0 00000100:00100000:3.0:1789305193.752076:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785800960:12345-0@lo:400:kworker.0 Request processed in 3920us (4307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305193.752254:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785800960:0@lo:400:kworker.0 00000100:00100000:1.0:1789305193.752618:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305193.752716:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785801088:0@lo:400:kworker.0 00000100:00100000:1.0:1789305193.752750:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305193.753296:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785801088 00000100:00100000:3.0:1789305193.753375:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00100000:2.0:1789305193.753407:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785801088 00000100:00100000:2.0:1789305193.753764:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:2.0:1789305193.753771:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785801088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305193.753829:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785801088:12345-0@lo:400:kworker.0 Request processed in 59us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305193.753836:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:1.0:1789305193.754186:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785801088:0@lo:400:kworker.0 00000100:00100000:0.0:1789305193.754252:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785800576 00000100:00100000:0.0:1789305193.754257:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785800576 00000100:00100000:0.0:1789305193.754288:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1789305193.754293:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785800576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305193.754331:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785800576:12345-0@lo:400:kworker.0 Request processed in 39us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305193.754342:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:1.0:1789305193.754449:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785800576:0@lo:400:kworker.0 00000100:00080000:3.0:1789305193.754946:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789305193.811569:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305194.258602:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789305194.258627:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785801344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789305194.258714:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305194.258856:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785801344 00000100:00100000:1.0:1789305194.258866:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785801344 00000100:00100000:1.0:1789305194.258920:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1789305194.258932:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785801344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305194.258972:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305194.259031:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785801344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305194.259038:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1789305194.259294:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785801344:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789305194.834337:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305195.858207:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789305196.611039:0:106734:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=50221, dev=0 00000020:00000004:0.0:1789305196.622769:0:106735:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=50221, dev=0 00000020:00000004:0.0:1789305196.655536:0:106736:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=50221, dev=0 00010000:00010000:1.0:1789305196.886284:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305197.906854:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305198.188170:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305198.188363:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765716352 00000100:00100000:3.0:1789305198.188375:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765716352 00000100:00100000:3.0:1789305198.188424:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1477 00000100:00100000:3.0:1789305198.188432:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1876219765716352:12345-192.168.202.29@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789305198.188459:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8b9cec9f-35a6-4528-b610-aec2cd17adff@192.168.202.29@tcp t0 exp 0000000000000000 cur 2647 last 0 00000020:00000080:3.0:1789305198.188492:0:5847:0:(genops.c:1384:class_connect()) connect: client 8b9cec9f-35a6-4528-b610-aec2cd17adff, cookie 0xefc0bb72312981f6 00000100:00080000:3.0:1789305198.188537:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9e2b02d15800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789305198.188612:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+5:2353:x1876219765716352:12345-192.168.202.29@tcp:250:mount.lustre.0 Request processed in 179us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305198.188619:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1477 00000100:00100000:3.0:1789305198.198087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305198.198258:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765716480 00000100:00100000:1.0:1789305198.198269:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765716480 00000100:00100000:1.0:1789305198.198606:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1478 00000100:00100000:1.0:1789305198.198618:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+5:63805:x1876219765716480:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789305198.198637:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305198.198660:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371200/0xefc0bb72312981fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100a17 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305198.198690:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371200/0xefc0bb72312981fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a17 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305198.198702:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371200/0xefc0bb72312981fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a17 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305198.198711:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371200, rc 0) 00000100:00100000:1.0:1789305198.198769:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+6:63805:x1876219765716480:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 153us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.198778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1478 00000100:00100000:1.0:1789305198.201690:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305198.201742:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765716608 00000100:00100000:3.0:1789305198.201751:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765716608 00000100:00100000:3.0:1789305198.201796:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1479 00000100:00100000:3.0:1789305198.201803:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+6:63805:x1876219765716608:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789305198.202032:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+6:63805:x1876219765716608:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 229us (349us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789305198.202045:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1479 00000100:00100000:2.0:1789305198.205864:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305198.205928:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765716736 00000100:00100000:1.0:1789305198.205938:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765716736 00000100:00100000:1.0:1789305198.206002:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1480 00000100:00100000:1.0:1789305198.206023:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+6:63805:x1876219765716736:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789305198.206048:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305198.206068:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231298204 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100a1e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305198.206123:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231298204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a1e expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305198.206137:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231298204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a1e expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305198.206146:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371e00, rc 0) 00000100:00100000:1.0:1789305198.206209:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+7:63805:x1876219765716736:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 197us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.206217:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1480 00000100:00100000:0.0:1789305198.209261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305198.209301:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765716864 00000100:00100000:2.0:1789305198.209311:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765716864 00000100:00100000:2.0:1789305198.209367:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1481 00000100:00100000:2.0:1789305198.209460:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+7:63805:x1876219765716864:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789305198.209793:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+8:63805:x1876219765716864:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 337us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305198.209801:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1481 00000100:00100000:2.0:1789305198.211674:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305198.211714:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765716992 00000100:00100000:1.0:1789305198.211724:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765716992 00000100:00100000:1.0:1789305198.211805:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1482 00000100:00100000:1.0:1789305198.211815:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+8:63805:x1876219765716992:12345-192.168.202.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789305198.212236:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+8:63805:x1876219765716992:12345-192.168.202.29@tcp:503:mount.lustre.0 Request processed in 423us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.212245:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1482 00000100:00100000:1.0:1789305198.217760:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305198.217872:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765717120 00000100:00100000:2.0:1789305198.217883:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765717120 00000100:00100000:2.0:1789305198.217940:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1483 00000100:00100000:2.0:1789305198.217957:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+8:63824:x1876219765717120:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789305198.218440:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+8:63824:x1876219765717120:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 490us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305198.218450:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1483 00000100:00100000:0.0:1789305198.240859:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305198.240967:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765717248 00000100:00100000:1.0:1789305198.240978:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765717248 00000100:00100000:1.0:1789305198.241045:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1484 00000100:00100000:1.0:1789305198.241055:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+8:63824:x1876219765717248:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789305198.241393:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+8:63824:x1876219765717248:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 339us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.241402:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1484 00000100:00100000:2.0:1789305198.248818:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305198.248871:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765717376 00000100:00100000:3.0:1789305198.248882:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765717376 00000100:00100000:3.0:1789305198.249142:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1485 00000100:00100000:3.0:1789305198.249153:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+8:63805:x1876219765717376:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789305198.249170:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305198.249190:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e200/0xefc0bb723129820b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100a48 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305198.249218:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e200/0xefc0bb723129820b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a48 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305198.249228:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e200/0xefc0bb723129820b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a48 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305198.249236:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e200, rc 0) 00000100:00100000:3.0:1789305198.249285:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+9:63805:x1876219765717376:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 135us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305198.249292:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1485 00000100:00100000:3.0:1789305198.252877:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305198.253124:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765717504 00000100:00100000:2.0:1789305198.253136:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765717504 00000100:00100000:2.0:1789305198.253233:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1486 00000100:00100000:2.0:1789305198.253245:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+9:63805:x1876219765717504:12345-192.168.202.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789305198.253270:0:5847:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789305198.253293:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789305198.253298:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789305198.253311:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789305198.253314:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789305198.260643:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+9:63805:x1876219765717504:12345-192.168.202.29@tcp:256:mount.lustre.0 Request processed in 7389us (7763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305198.260659:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1486 00000100:00100000:3.0:1789305198.262919:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305198.263040:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765717632 00000100:00100000:0.0:1789305198.263052:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765717632 00000100:00100000:0.0:1789305198.263501:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1487 00000100:00100000:0.0:1789305198.263513:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+9:63805:x1876219765717632:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789305198.263530:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305198.263551:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231298212 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100a4f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305198.263583:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231298212 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a4f expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305198.263595:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231298212 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a4f expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305198.263604:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa200, rc 0) 00000100:00100000:0.0:1789305198.263662:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63805:x1876219765717632:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 152us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305198.263669:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1487 00000100:00100000:3.0:1789305198.266274:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305198.266383:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765717760 00000100:00100000:2.0:1789305198.266394:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765717760 00000100:00100000:2.0:1789305198.266446:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1488 00000100:00100000:2.0:1789305198.266456:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63805:x1876219765717760:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789305198.266701:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63805:x1876219765717760:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 247us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305198.266707:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1488 00000100:00100000:3.0:1789305198.269393:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305198.269556:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765717888 00000100:00100000:0.0:1789305198.269567:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765717888 00000100:00100000:0.0:1789305198.269679:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1489 00000100:00100000:0.0:1789305198.269690:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63805:x1876219765717888:12345-192.168.202.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789305198.269923:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63805:x1876219765717888:12345-192.168.202.29@tcp:503:mount.lustre.0 Request processed in 235us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305198.269931:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1489 00000100:00100000:3.0:1789305198.273651:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305198.274051:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765718016 00000100:00100000:1.0:1789305198.274063:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765718016 00000100:00100000:1.0:1789305198.274323:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1490 00000100:00100000:1.0:1789305198.274336:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63827:x1876219765718016:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789305198.274663:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63827:x1876219765718016:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 329us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.274671:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1490 00000100:00100000:3.0:1789305198.285981:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305198.286069:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765718144 00000100:00100000:2.0:1789305198.286080:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765718144 00000100:00100000:2.0:1789305198.286263:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1491 00000100:00100000:2.0:1789305198.286273:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63827:x1876219765718144:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789305198.286650:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63827:x1876219765718144:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 378us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305198.286656:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1491 00000100:00100000:3.0:1789305198.293342:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305198.293736:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765718272 00000100:00100000:2.0:1789305198.293747:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765718272 00000100:00100000:2.0:1789305198.293792:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1261 00000100:00100000:2.0:1789305198.293798:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1876219765718272:12345-192.168.202.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789305198.293823:0:5853:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 75fc90c1-a4fe-419b-8369-98cdb6ace105@192.168.202.29@tcp t0 exp 0000000000000000 cur 2647 last 0 00000020:00000080:2.0:1789305198.293860:0:5853:0:(genops.c:1384:class_connect()) connect: client 75fc90c1-a4fe-419b-8369-98cdb6ace105, cookie 0xefc0bb7231298219 00000004:00100000:2.0:1789305198.293920:0:5853:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789305198.294334:0:5853:0:(import.c:65:import_set_state_nolock()) ffff9e2c384c3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789305198.294529:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:2353:x1876219765718272:12345-192.168.202.29@tcp:38:mount.lustre.0 Request processed in 728us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305198.294536:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1261 00000100:00100000:3.0:1789305198.300737:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305198.300817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305198.301220:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765718400 00000100:00100000:2.0:1789305198.301231:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765718400 00000100:00100000:2.0:1789305198.301293:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765718528 00000100:00100000:2.0:1789305198.301297:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765718528 00000100:00100000:2.0:1789305198.301324:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1262 00000100:00100000:2.0:1789305198.301333:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75fc90c1-a4fe-419b-8369-98cdb6ace105+7:0:x1876219765718400:12345-192.168.202.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789305198.301394:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1789305198.301490:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75fc90c1-a4fe-419b-8369-98cdb6ace105+7:0:x1876219765718400:12345-192.168.202.29@tcp:41:mount.lustre.0 Request processed in 157us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305198.301498:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1262 00000100:00100000:2.0:1789305198.301519:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1263 00000100:00100000:2.0:1789305198.301525:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:63805:x1876219765718528:12345-192.168.202.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789305198.301537:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1789305198.301560:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:63805:x1876219765718528:12345-192.168.202.29@tcp:41:mount.lustre.0 Request processed in 35us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305198.301567:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1263 00000100:00080000:3.0:1789305198.301806:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305198.307652:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305198.307756:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765718656 00000100:00100000:1.0:1789305198.307769:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765718656 00000100:00100000:1.0:1789305198.307866:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1264 00000100:00100000:1.0:1789305198.307877:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:63805:x1876219765718656:12345-192.168.202.29@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789305198.307988:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:63805:x1876219765718656:12345-192.168.202.29@tcp:40:mount.lustre.0 Request processed in 112us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.307995:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1264 00000100:00100000:2.0:1789305198.310206:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305198.310256:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305198.310269:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765719040 00000100:00100000:3.0:1789305198.310280:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765719040 00000100:00100000:2.0:1789305198.310295:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305198.310324:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 128 00000100:00100000:3.0:1789305198.310332:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2a6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:63805:x1876219765719040:12345-192.168.202.29@tcp:33:mount.lustre.0 00000100:00100000:1.0:1789305198.310641:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765718784 00000100:00100000:1.0:1789305198.310648:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765718784 00000100:00100000:1.0:1789305198.310679:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765718912 00000100:00100000:1.0:1789305198.310682:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765718912 00000100:00100000:1.0:1789305198.310699:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 693 00000100:00100000:1.0:1789305198.310705:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1876219765718784:12345-192.168.202.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789305198.310730:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 75fc90c1-a4fe-419b-8369-98cdb6ace105@192.168.202.29@tcp t0 exp 0000000000000000 cur 2647 last 0 00000020:00000080:1.0:1789305198.310762:0:6691:0:(genops.c:1384:class_connect()) connect: client 75fc90c1-a4fe-419b-8369-98cdb6ace105, cookie 0xefc0bb7231298220 00002000:00100000:1.0:1789305198.310803:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 75fc90c1-a4fe-419b-8369-98cdb6ace105/ffff9e2c3f69e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789305198.310828:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789305198.310834:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 694 00000100:00100000:2.0:1789305198.310843:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1876219765718912:12345-192.168.202.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789305198.310863:0:17212:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 75fc90c1-a4fe-419b-8369-98cdb6ace105@192.168.202.29@tcp t0 exp 0000000000000000 cur 2647 last 0 00000020:00000080:2.0:1789305198.310887:0:17212:0:(genops.c:1384:class_connect()) connect: client 75fc90c1-a4fe-419b-8369-98cdb6ace105, cookie 0xefc0bb7231298227 00002000:00100000:2.0:1789305198.310894:0:17212:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 75fc90c1-a4fe-419b-8369-98cdb6ace105/ffff9e2c20272800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789305198.310910:0:17212:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789305198.311136:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789305198.311163:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9e2c3f698000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789305198.311225:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:2353:x1876219765718784:12345-192.168.202.29@tcp:8:mount.lustre.0 Request processed in 518us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.311234:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 693 00002000:00080000:2.0:1789305198.311300:0:17212:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789305198.311318:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2c20274000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789305198.311510:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:2353:x1876219765718912:12345-192.168.202.29@tcp:8:mount.lustre.0 Request processed in 666us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305198.311518:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 694 00000004:00200000:3.0:1789305198.311697:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789305198.311835:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2a6d3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:63805:x1876219765719040:12345-192.168.202.29@tcp:33:mount.lustre.0 Request processed in 1503us (1638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305198.311843:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 128 00000100:00100000:2.0:1789305198.354996:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789305198.355027:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785801472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789305198.355123:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305198.355329:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785801472 00000100:00100000:1.0:1789305198.355338:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785801472 00000100:00100000:1.0:1789305198.355688:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:1.0:1789305198.355701:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785801472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305198.355727:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305198.355790:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785801472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.355797:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1789305198.355933:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785801472:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789305198.356199:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305198.443777:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305198.444216:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765719168 00000100:00100000:0.0:1789305198.444228:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765719168 00000100:00100000:0.0:1789305198.444358:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1265 00000100:00100000:0.0:1789305198.444379:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:63847:x1876219765719168:12345-192.168.202.29@tcp:101:mkdir.0 00010000:00010000:0.0:1789305198.444403:0:30980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305198.444432:0:30980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb723129822e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100a79 expref: -99 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305198.444499:0:30980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231298235 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305198.444513:0:30980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231298235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305198.444527:0:30980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231298235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789305198.444567:0:30980:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789305198.444571:0:30980:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789305198.444608:0:30980:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231298235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305198.444632:0:30980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afa400/0xefc0bb723129822e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a79 expref: 8 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305198.444650:0:30980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231298235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a79 expref: 7 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305198.444658:0:30980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:0.0:1789305198.444661:0:30980:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789305198.444666:0:30980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb800, rc 0) 00000100:00100000:0.0:1789305198.444736:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75fc90c1-a4fe-419b-8369-98cdb6ace105+7:63847:x1876219765719168:12345-192.168.202.29@tcp:101:mkdir.0 Request processed in 369us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305198.444743:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1265 00000100:00100000:1.0:1789305198.866434:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785801984:0@lo:400:kworker.0 00000100:00100000:1.0:1789305198.866503:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305198.866567:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789305198.866574:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785801856:0@lo:400:kworker.0 00000100:00100000:1.0:1789305198.866612:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305198.866642:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785801856 00000100:00100000:1.0:1789305198.866650:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785801856 00000100:00100000:1.0:1789305198.866702:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1789305198.866713:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785801856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305198.866783:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785801856:12345-0@lo:400:kworker.0 Request processed in 73us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.866790:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1789305198.866831:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785801856:0@lo:400:kworker.0 00000100:00100000:1.0:1789305198.866852:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785801984 00000100:00100000:1.0:1789305198.866856:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785801984 00000100:00100000:1.0:1789305198.866883:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:1.0:1789305198.866890:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785801984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305198.866925:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876219785801984:12345-0@lo:400:kworker.0 Request processed in 36us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.866931:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:1.0:1789305198.866955:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1876219785801984:0@lo:400:kworker.0 00000100:00100000:2.0:1789305198.867065:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785801600:0@lo:400:kworker.0 00000100:00100000:2.0:1789305198.867137:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305198.867159:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785802112:0@lo:400:kworker.0 00000100:00100000:2.0:1789305198.867181:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305198.867197:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789305198.867203:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785801728:0@lo:400:kworker.0 00000100:00100000:2.0:1789305198.867223:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305198.867249:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785802112 00000100:00100000:2.0:1789305198.867252:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785802112 00000100:00100000:2.0:1789305198.867276:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785801728 00000100:00100000:2.0:1789305198.867279:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785801728 00000100:00100000:2.0:1789305198.867296:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1789305198.867302:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785802112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305198.867336:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785802112:12345-0@lo:400:kworker.0 Request processed in 34us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305198.867342:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1789305198.867358:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:2.0:1789305198.867363:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785801728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305198.867389:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b036e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785801728:12345-0@lo:400:kworker.0 Request processed in 26us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305198.867394:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:2.0:1789305198.867419:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785801728:0@lo:400:kworker.0 00000100:00100000:2.0:1789305198.867429:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785802112:0@lo:400:kworker.0 00000100:00080000:3.0:1789305198.867513:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789305198.867518:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305198.868130:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785801600 00000100:00100000:1.0:1789305198.868137:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785801600 00000100:00100000:1.0:1789305198.868167:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1789305198.868174:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785801600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305198.868413:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785801600:12345-0@lo:400:kworker.0 Request processed in 239us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305198.868420:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:3.0:1789305198.870168:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785801600:0@lo:400:kworker.0 00010000:00010000:0.0:1789305198.931178:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305199.378467:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785802240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305199.378542:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305199.378704:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785802240 00000100:00100000:1.0:1789305199.378714:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785802240 00000100:00100000:1.0:1789305199.378768:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:1.0:1789305199.378778:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785802240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305199.378814:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305199.378870:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785802240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305199.378878:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:2.0:1789305199.379133:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785802240:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789305199.933564:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75fc90c1-a4fe-419b-8369-98cdb6ace105 00000001:00100000:1.0:1789305199.934333:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75fc90c1-a4fe-419b-8369-98cdb6ace105 00010000:00010000:1.0:1789305199.955532:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305200.234479:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305200.235289:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765719296 00000100:00100000:1.0:1789305200.235302:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765719296 00000100:00100000:1.0:1789305200.235392:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1266 00000100:00100000:1.0:1789305200.235406:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+7:63901:x1876219765719296:12345-192.168.202.29@tcp:41:lfs.0 00000004:00000024:1.0:1789305200.235455:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789305200.235584:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+7:63901:x1876219765719296:12345-192.168.202.29@tcp:41:lfs.0 Request processed in 183us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305200.235592:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1266 00000100:00080000:3.0:1789305200.236168:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305200.239579:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305200.239692:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765719424 00000100:00100000:0.0:1789305200.239703:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765719424 00000100:00100000:0.0:1789305200.239782:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 971 00000100:00100000:0.0:1789305200.239791:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:63901:x1876219765719424:12345-192.168.202.29@tcp:13:lfs.0 00002000:00000024:0.0:1789305200.239817:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305200.239891:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:63901:x1876219765719424:12345-192.168.202.29@tcp:13:lfs.0 Request processed in 101us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305200.239898:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 971 00000100:00080000:3.0:1789305200.240257:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305200.242429:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305200.242581:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765719552 00000100:00100000:3.0:1789305200.242589:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765719552 00000100:00100000:3.0:1789305200.242662:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 972 00000100:00100000:3.0:1789305200.242672:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:63901:x1876219765719552:12345-192.168.202.29@tcp:13:lfs.0 00002000:00000024:3.0:1789305200.242713:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789305200.242789:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:63901:x1876219765719552:12345-192.168.202.29@tcp:13:lfs.0 Request processed in 118us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305200.242796:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 972 00000100:00080000:0.0:1789305200.243084:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789305200.978229:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305202.003422:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789305202.255623:0:106934:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1789305202.477721:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 75fc90c1-a4fe-419b-8369-98cdb6ace105 00010000:00010000:1.0:1789305203.027509:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305203.475510:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0651f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785802368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305203.475594:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305203.475639:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785802368 00000100:00100000:1.0:1789305203.475647:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785802368 00000100:00080000:0.0:1789305203.475678:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305203.475713:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1789305203.475723:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785802368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305203.475757:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305203.475813:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785802368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305203.475830:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1789305203.476111:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0651f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785802368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789305203.553749:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305203.553801:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305203.553843:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305203.553881:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305203.553916:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765720064 00000100:00100000:2.0:1789305203.553924:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765720064 00000100:00100000:2.0:1789305203.553994:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765719936 00000100:00100000:2.0:1789305203.553999:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765719936 00000100:00100000:1.0:1789305203.554026:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765719808 00000100:00100000:2.0:1789305203.554032:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1462 00000100:00100000:1.0:1789305203.554033:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765719808 00000100:00100000:2.0:1789305203.554046:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2354:x1876219765720064:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305203.554079:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1905 00000100:00100000:1.0:1789305203.554119:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:2354:x1876219765719808:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305203.554184:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765719680 00000100:00100000:3.0:1789305203.554188:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765719680 00000100:00100000:0.0:1789305203.554210:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1463 00000100:00100000:3.0:1789305203.554214:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1493 00000100:00100000:3.0:1789305203.554222:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:2354:x1876219765719680:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305203.554227:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2354:x1876219765719936:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305203.554266:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2354:x1876219765720064:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 222us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305203.554273:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1462 00000100:00080000:2.0:1789305203.554297:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789305203.554302:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789305203.554303:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305203.554740:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0651e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:2354:x1876219765719808:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 652us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305203.554746:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1905 00000100:00100000:3.0:1789305203.555444:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:2354:x1876219765719680:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1221us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305203.555453:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1493 00000100:00100000:0.0:1789305203.562739:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2354:x1876219765719936:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 8506us (8843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305203.562759:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1463 00000100:00100000:1.0:1789305203.988345:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785802496:0@lo:400:kworker.0 00000100:00100000:1.0:1789305203.988419:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305203.988511:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785802496 00000100:00100000:3.0:1789305203.988518:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785802496 00000100:00100000:3.0:1789305203.988579:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:3.0:1789305203.988588:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785802496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305203.993257:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785802496:12345-0@lo:400:kworker.0 Request processed in 4655us (4822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305203.993273:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:3.0:1789305203.993471:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785802880:0@lo:400:kworker.0 00000100:00100000:3.0:1789305203.993541:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305203.995985:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785802496:0@lo:400:kworker.0 00000100:00100000:1.0:1789305203.996034:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785802880 00000100:00100000:1.0:1789305203.996040:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785802880 00000100:00100000:1.0:1789305203.996102:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:1.0:1789305203.996109:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785802880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305203.996189:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785802880:12345-0@lo:400:kworker.0 Request processed in 79us (2649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305203.996196:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00100000:1.0:1789305203.996230:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785802880:0@lo:400:kworker.0 00000100:00080000:0.0:1789305203.996557:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305203.997187:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785802624:0@lo:400:kworker.0 00000100:00100000:1.0:1789305203.997231:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305203.997270:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789305203.997277:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785802752:0@lo:400:kworker.0 00000100:00100000:1.0:1789305203.997301:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305203.997333:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785802752 00000100:00100000:1.0:1789305203.997338:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785802752 00000100:00100000:1.0:1789305203.997379:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1789305203.997387:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785802752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305203.997429:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785802752:12345-0@lo:400:kworker.0 Request processed in 44us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305203.997436:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1789305203.997468:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785802752:0@lo:400:kworker.0 00000100:00080000:1.0:1789305203.997485:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305203.997524:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785802624 00000100:00100000:3.0:1789305203.997529:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785802624 00000100:00100000:3.0:1789305203.997572:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907 00000100:00100000:3.0:1789305203.997580:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785802624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305203.997620:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876219785802624:12345-0@lo:400:kworker.0 Request processed in 41us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305203.997626:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907 00000100:00100000:3.0:1789305203.997654:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876219785802624:0@lo:400:kworker.0 00000100:00100000:1.0:1789305203.998845:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785803008:0@lo:400:kworker.0 00000100:00100000:1.0:1789305203.998888:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305203.999841:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785803008 00000100:00100000:3.0:1789305203.999850:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785803008 00000100:00100000:3.0:1789305203.999907:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:3.0:1789305203.999917:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785803008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305204.005061:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c08b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785803008:12345-0@lo:400:kworker.0 Request processed in 5137us (6163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305204.005078:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:1.0:1789305204.005659:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785803008:0@lo:400:kworker.0 00000100:00080000:1.0:1789305204.005869:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789305204.050417:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305204.498555:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789305204.498578:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785803136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305204.498642:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305204.498845:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785803136 00000100:00100000:1.0:1789305204.498853:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785803136 00000100:00100000:1.0:1789305204.498902:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1789305204.498911:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785803136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789305204.498945:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305204.499005:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785803136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305204.499012:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1789305204.499056:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785803136:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1789305204.820279:0:107082:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc12ac4e30 20000000:00000080:0.0:1789305204.820299:0:107082:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e2c37022400 uarg=0000000000000000 20000000:01000000:0.0:1789305204.820338:0:107082:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789305204.820345:0:107082:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789305204.820350:0:107082:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789305204.821496:0:107083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789305204.821749:0:107082:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789305204.830351:0:107082:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789305204.830555:0:107082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.830645:0:107082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312981d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312981cc expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.830654:0:107082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb000/0xefc0bb72312981e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312981da expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.830662:0:107082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312981ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312981e8 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.830674:0:107082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231298212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a4f expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.830683:0:107082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.830730:0:107082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231298212 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a4f expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.830747:0:107082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231298212 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a4f expref: 9 pid: 5846 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305204.830833:0:107082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107082:1876219785803264:192.168.202.29@tcp:104: 00010000:00010000:1.0:1789305204.832041:0:107082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312981ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312981e8 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.832057:0:107082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312981ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312981e8 expref: 18 pid: 5847 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305204.832069:0:107082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107082:1876219785803392:0@lo:104: 00000100:00100000:1.0:1789305204.832136:0:107082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789305204.832179:0:107082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb000/0xefc0bb72312981e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312981da expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.832187:0:107082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afb000/0xefc0bb72312981e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312981da expref: 18 pid: 5846 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305204.832196:0:107082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c38653480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107082:1876219785803520:0@lo:104: 00000100:00100000:1.0:1789305204.832221:0:107082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305204.832253:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785803392 00000100:00100000:1.0:1789305204.832260:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785803392 00000100:00100000:1.0:1789305204.832300:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785803520 00000100:00100000:1.0:1789305204.832303:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785803520 00000100:00100000:1.0:1789305204.832315:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1789305204.832323:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c38650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+4:107082:x1876219785803392:12345-0@lo:104: 00010000:00010000:1.0:1789305204.832337:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.832382:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789305204.832388:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c38650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+4:107082:x1876219785803392:12345-0@lo:104: Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305204.832394:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1789305204.832412:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1789305204.832632:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:107082:x1876219785803520:12345-0@lo:104: 00010000:00010000:1.0:1789305204.832640:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.832674:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789305204.832679:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:107082:x1876219785803520:12345-0@lo:104: Request processed in 51us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305204.832685:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00010000:00010000:1.0:1789305204.832702:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789305204.832708:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.832721:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789305204.832725:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.832733:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789305204.832741:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305204.832747:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789305204.832976:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305204.832982:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305204.833005:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860ee00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305204.833008:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305204.833014:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305204.833020:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305204.833026:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789305204.833336:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.833344:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789305204.833366:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.833373:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f600/0xefc0bb72312981e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.833385:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305204.833387:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305204.833389:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305204.833404:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785803648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789305204.833533:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789305204.833681:0:107082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312981d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312981cc expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.833698:0:107082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312981d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312981cc expref: 18 pid: 5847 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305204.833708:0:107082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107082:1876219785803776:0@lo:104: 00000100:00100000:1.0:1789305204.833732:0:107082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305204.833767:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785803776 00000100:00100000:1.0:1789305204.833772:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785803776 00000100:00100000:1.0:1789305204.833803:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789305204.833810:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:107082:x1876219785803776:12345-0@lo:104: 00010000:00010000:1.0:1789305204.833819:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.833858:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789305204.833863:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:107082:x1876219785803776:12345-0@lo:104: Request processed in 54us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305204.833869:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789305204.833889:0:107082:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789305204.833911:0:107082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107082:1876219785803392:0@lo:104: 00000100:00100000:1.0:1789305204.833919:0:107082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c38653480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107082:1876219785803520:0@lo:104: 00000100:00100000:1.0:1789305204.833925:0:107082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107082:1876219785803776:0@lo:104: 00000100:00100000:1.0:1789305204.834292:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785803648 00000100:00100000:1.0:1789305204.834297:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785803648 00010000:00010000:1.0:1789305204.834316:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312981ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312981e8 expref: 19 pid: 5847 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305204.834339:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1789305204.834346:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785803648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305204.834359:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305204.834365:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312981ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312981e8 expref: 19 pid: 5847 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.834373:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312981ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312981e8 expref: 19 pid: 5847 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.834389:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc600/0xefc0bb72312981ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312981e8 expref: 19 pid: 5847 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.834403:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789305204.834636:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785803648:12345-0@lo:103:ldlm_bl.0 Request processed in 289us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305204.834643:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:1.0:1789305204.834676:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785803648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305204.835222:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305204.835232:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305204.835241:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afaa00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789305204.835245:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305204.835254:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789305204.835260:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305204.835270:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789305204.835367:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305204.835375:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305204.835404:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305204.835518:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785803904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789305204.835572:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789305204.835697:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860ee00/0xefc0bb72312981da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305204.835711:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305204.835713:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305204.835715:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305204.835731:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785803904 00000100:00100000:0.0:1789305204.835737:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785803904 00010000:00010000:0.0:1789305204.835774:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb000/0xefc0bb72312981e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312981da expref: 18 pid: 5846 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305204.835805:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1789305204.835813:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785803904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305204.835823:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305204.835828:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb000/0xefc0bb72312981e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312981da expref: 18 pid: 5846 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305204.835836:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb000/0xefc0bb72312981e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312981da expref: 18 pid: 5846 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305204.835849:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb000/0xefc0bb72312981e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312981da expref: 18 pid: 5846 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305204.835859:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305204.835891:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:3312:x1876219785803904:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305204.835898:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1789305204.835930:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785803904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305204.839691:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305204.839707:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305204.839742:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305204.839751:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb72312981cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981d3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305204.839832:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305204.839834:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305204.839836:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305204.839844:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305204.839865:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785804032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305204.839930:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305204.840276:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785804032 00000100:00100000:3.0:1789305204.840284:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785804032 00010000:00010000:3.0:1789305204.840316:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312981d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312981cc expref: 17 pid: 5847 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305204.840349:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1789305204.840358:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:3312:x1876219785804032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305204.840370:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305204.840375:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312981d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312981cc expref: 17 pid: 5847 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305204.840390:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312981d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312981cc expref: 17 pid: 5847 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305204.840405:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e600/0xefc0bb72312981d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312981cc expref: 17 pid: 5847 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305204.840551:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789305204.840793:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305204.840814:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765720192 00000100:00100000:1.0:1789305204.840818:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765720192 00010000:00010000:1.0:1789305204.840840:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231298212 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a4f expref: 10 pid: 5846 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305204.840860:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 486 00000100:00100000:1.0:1789305204.840867:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:2355:x1876219765720192:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789305204.840875:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305204.840879:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231298212 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a4f expref: 10 pid: 5846 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.840889:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231298212 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a4f expref: 10 pid: 5846 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.840902:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.840911:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.840925:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.840932:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.840940:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.840947:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.840966:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789305204.840970:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.840979:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.840997:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.841019:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789305204.841058:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:2355:x1876219765720192:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 191us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305204.841065:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 486 00010000:00010000:1.0:1789305204.841136:0:107082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afa200/0xefc0bb7231298212 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a4f expref: 9 pid: 5846 timeout: 2754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305204.841147:0:107082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c08b34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107082:1876219785803264:192.168.202.29@tcp:104: 00010000:00010000:1.0:1789305204.841178:0:107082:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.841187:0:107082:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.841192:0:107082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305204.841198:0:107082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370000/0xefc0bb723129823c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305204.842232:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:3312:x1876219785804032:12345-0@lo:103:ldlm_bl.0 Request processed in 1869us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305204.842243:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1789305204.844491:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785804032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305205.075015:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305206.098199:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305206.228710:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789305206.228717:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2c3fb35000 from 10 10000000:01000000:0.0:1789305206.228721:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789305206.228763:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231298243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305206.228775:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231298243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305206.228788:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231298243 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305206.228814:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305206.228883:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305206.228930:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c03f11a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789305206.229323:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785804160 00000100:00100000:3.0:1789305206.229333:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785804160 00000100:00100000:3.0:1789305206.229420:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:3.0:1789305206.229430:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+16:5849:x1876219785804160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305206.229444:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305206.229459:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f400/0xefc0bb723129824a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298243 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305206.229482:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f400/0xefc0bb723129824a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298243 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305206.229493:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860f400/0xefc0bb723129824a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298243 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305206.229501:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f400, rc 0) 00000100:00100000:3.0:1789305206.229551:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785804160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305206.229557:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1789305206.230191:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305206.230210:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231298243 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129824a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305206.230221:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231298243 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb723129824a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305206.230289:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789305206.230327:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305206.230365:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08ec8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789305206.230417:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785804288 00000100:00100000:0.0:1789305206.230422:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785804288 00000100:00100000:0.0:1789305206.230456:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1789305206.230464:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785804288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789305206.230700:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785804288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305206.230707:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1789305206.230788:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789305206.230815:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789305206.230854:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305206.230879:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08ec8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789305206.230922:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785804416 00000100:00100000:0.0:1789305206.230927:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785804416 00000100:00100000:0.0:1789305206.230961:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1789305206.230968:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785804416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789305206.231125:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785804416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305206.231131:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:2.0:1789305206.231225:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789305206.232003:0:107161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789305206.233680:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789305206.233719:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789305206.233729:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231298243 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129824a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305206.233741:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa200/0xefc0bb7231298243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb723129824a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305206.233751:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789305206.233753:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2c02eb8000 from 10 10000000:01000000:0.0:1789305206.233756:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789305206.233788:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb7231298251 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305206.233796:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb7231298251 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305206.233807:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb7231298251 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305206.233829:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305206.233891:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305206.233936:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f709240 going to sleep for 11 seconds 00000100:00100000:3.0:1789305206.234001:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785804544 00000100:00100000:3.0:1789305206.234008:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785804544 00000100:00100000:3.0:1789305206.234057:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1789305206.234066:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+17:5849:x1876219785804544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305206.234078:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305206.234114:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231298258 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298251 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305206.234135:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231298258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298251 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305206.234144:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e600/0xefc0bb7231298258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298251 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305206.234151:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e600, rc 0) 00000100:00100000:3.0:1789305206.234190:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785804544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305206.234196:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:0.0:1789305206.234288:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305206.234300:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb7231298251 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298258 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305206.234308:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb7231298251 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298258 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305206.234354:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789305206.234377:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305206.234403:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f709240 going to sleep for 11 seconds 00000100:00100000:3.0:1789305206.234448:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785804672 00000100:00100000:3.0:1789305206.234452:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785804672 00000100:00100000:3.0:1789305206.234481:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1789305206.234488:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785804672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789305206.234724:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785804672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305206.234731:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:0.0:1789305206.234802:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789305206.234832:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789305206.234868:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305206.234890:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c3f709240 going to sleep for 11 seconds 00000100:00100000:3.0:1789305206.234936:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785804800 00000100:00100000:3.0:1789305206.234951:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785804800 00000100:00100000:3.0:1789305206.235165:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1789305206.235172:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785804800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789305206.235313:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785804800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305206.235319:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:1.0:1789305206.235381:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789305206.237173:0:107162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789305206.237742:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789305206.237767:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789305206.237778:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb7231298251 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298258 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.237790:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb200/0xefc0bb7231298251 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298258 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305206.237802:0:5849:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789305206.237804:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e2c205fe800 from 10 10000000:01000000:1.0:1789305206.237807:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789305206.237836:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129825f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.237845:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129825f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.237855:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129825f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305206.237875:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789305206.237929:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305206.237975:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789305206.237994:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785804928 00000100:00100000:1.0:1789305206.238001:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785804928 00000100:00100000:1.0:1789305206.238042:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:1.0:1789305206.238051:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785804928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305206.238064:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305206.238075:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371800/0xefc0bb7231298266 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129825f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.238123:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371800/0xefc0bb7231298266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129825f expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.238135:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371800/0xefc0bb7231298266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129825f expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.238147:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371800, rc 0) 00000100:00100000:1.0:1789305206.238184:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785804928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305206.238191:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:1.0:1789305206.238234:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785804928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305206.238247:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129825f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298266 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.238256:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129825f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298266 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305206.238303:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785805056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789305206.238327:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305206.238344:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789305206.238355:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785805056 00000100:00100000:1.0:1789305206.238358:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785805056 00000100:00100000:1.0:1789305206.238378:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:1.0:1789305206.238384:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785805056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789305206.238604:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785805056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305206.238611:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:1.0:1789305206.238640:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785805056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789305206.238664:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785805184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789305206.238702:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305206.238715:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c062c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789305206.238725:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785805184 00000100:00100000:1.0:1789305206.238729:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785805184 00000100:00100000:1.0:1789305206.238748:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:1.0:1789305206.238752:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785805184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789305206.238870:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785805184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305206.238877:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:1.0:1789305206.238920:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785805184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789305206.239575:0:107164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789305206.239626:0:5849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789305206.239643:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789305206.239651:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129825f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298266 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.239661:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41370e00/0xefc0bb723129825f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298266 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305206.438413:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305206.439306:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765720320 00000100:00100000:1.0:1789305206.439319:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765720320 00000100:00100000:1.0:1789305206.439434:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1504 00000100:00100000:1.0:1789305206.439445:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+9:63819:x1876219765720320:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305206.439462:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305206.439479:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41370600/0xefc0bb723129826d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.439511:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41370600/0xefc0bb723129826d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a80 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.439542:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41370600/0xefc0bb723129826d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a80 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305206.439553:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41370600, rc 0) 00000100:00100000:1.0:1789305206.439617:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63819:x1876219765720320:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 Request processed in 174us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305206.439625:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1504 00000100:00100000:3.0:1789305206.441376:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305206.441841:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765720448 00000100:00100000:1.0:1789305206.441849:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765720448 00000100:00100000:1.0:1789305206.441898:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1505 00000100:00100000:1.0:1789305206.441907:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63819:x1876219765720448:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789305206.442382:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63819:x1876219765720448:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 Request processed in 474us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305206.442390:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1505 00000100:00100000:1.0:1789305206.447414:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305206.447482:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765720576 00000100:00100000:2.0:1789305206.447490:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765720576 00000100:00100000:2.0:1789305206.447536:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1506 00000100:00100000:2.0:1789305206.447546:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63819:x1876219765720576:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789305206.447884:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02e51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:63819:x1876219765720576:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 Request processed in 337us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305206.447893:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1506 00010000:00010000:3.0:1789305207.122627:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305208.146199:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305208.598990:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785805312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305208.599067:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305208.599356:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785805312 00000100:00100000:0.0:1789305208.599363:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785805312 00000100:00100000:0.0:1789305208.599413:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1789305208.599420:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785805312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789305208.599457:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305208.599496:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785805312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305208.599501:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1789305208.599545:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785805312:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789305208.600128:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789305208.677630:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305208.677677:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305208.677727:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305208.677849:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765720704 00000100:00100000:1.0:1789305208.677860:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765720704 00000100:00100000:1.0:1789305208.677926:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1507 00000100:00100000:1.0:1789305208.677938:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:2354:x1876219765720704:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305208.678022:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:2354:x1876219765720704:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 85us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305208.678039:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1507 00000100:00100000:1.0:1789305208.678080:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765720832 00000100:00100000:1.0:1789305208.678084:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765720832 00000100:00100000:1.0:1789305208.678146:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1909 00000100:00100000:1.0:1789305208.678154:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:2354:x1876219765720832:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305208.678200:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:2354:x1876219765720832:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305208.678206:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1909 00000100:00080000:1.0:1789305208.678237:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305208.678761:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305208.678791:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765720960 00000100:00100000:3.0:1789305208.678796:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765720960 00000100:00100000:3.0:1789305208.678823:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765721088 00000100:00100000:3.0:1789305208.678825:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765721088 00000100:00100000:3.0:1789305208.678847:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1465 00000100:00100000:3.0:1789305208.678854:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2354:x1876219765720960:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305208.678886:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2354:x1876219765720960:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305208.678893:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1465 00000100:00100000:3.0:1789305208.678907:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1466 00000100:00100000:3.0:1789305208.678913:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2354:x1876219765721088:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305208.678948:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2354:x1876219765721088:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 36us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305208.678953:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1466 00000100:00080000:1.0:1789305208.679711:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789305208.679716:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305209.106434:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785805440:0@lo:400:kworker.0 00000100:00100000:1.0:1789305209.106462:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785805568:0@lo:400:kworker.0 00000100:00100000:0.0:1789305209.106541:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785805824:0@lo:400:kworker.0 00000100:00100000:1.0:1789305209.113868:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305209.113950:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789305209.113962:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785805696:0@lo:400:kworker.0 00000100:00100000:1.0:1789305209.115180:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305209.115266:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785805568 00000100:00100000:1.0:1789305209.115276:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785805568 00000100:00100000:1.0:1789305209.116161:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:1.0:1789305209.116176:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785805568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305209.116249:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785805568:12345-0@lo:400:kworker.0 Request processed in 78us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305209.116256:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:1.0:1789305209.116287:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785805696 00000100:00100000:1.0:1789305209.116292:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785805696 00000100:00100000:3.0:1789305209.117012:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305209.117300:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785805440 00000100:00100000:2.0:1789305209.117307:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785805440 00000100:00100000:2.0:1789305209.117381:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:2.0:1789305209.117399:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785805440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305209.117454:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3315:x1876219785805440:12345-0@lo:400:kworker.0 Request processed in 66us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305209.117460:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1789305209.117468:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:1.0:1789305209.117478:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785805696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305209.117515:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785805696:12345-0@lo:400:kworker.0 Request processed in 41us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305209.117522:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00080000:1.0:1789305209.117544:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305209.117580:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785805696:0@lo:400:kworker.0 00000100:00100000:0.0:1789305209.117814:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305209.117864:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789305209.117874:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785805568:0@lo:400:kworker.0 00000100:00100000:0.0:1789305209.117874:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785805952:0@lo:400:kworker.0 00000100:00100000:0.0:1789305209.117906:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305209.117966:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785805824 00000100:00100000:1.0:1789305209.117971:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785805824 00000100:00100000:1.0:1789305209.117999:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785805952 00000100:00100000:1.0:1789305209.118002:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785805952 00000100:00100000:1.0:1789305209.118019:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:1.0:1789305209.118024:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785805824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305209.118058:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785805824:12345-0@lo:400:kworker.0 Request processed in 34us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305209.118064:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:1.0:1789305209.118075:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:1.0:1789305209.118081:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785805952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305209.118128:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785805952:12345-0@lo:400:kworker.0 Request processed in 48us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305209.118134:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00080000:1.0:1789305209.118151:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305209.118170:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785805952:0@lo:400:kworker.0 00000100:00100000:1.0:1789305209.118193:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785805824:0@lo:400:kworker.0 00000100:00100000:2.0:1789305209.118373:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785805440:0@lo:400:kworker.0 00010000:00010000:0.0:1789305209.172229:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789305209.207376:0:107280:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: finish setup 09:13:28 (1789305208) === 00000100:00100000:1.0:1789305209.619075:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785806080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305209.619207:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305209.619379:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785806080 00000100:00100000:0.0:1789305209.619388:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785806080 00000100:00100000:0.0:1789305209.619441:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1789305209.619451:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785806080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305209.619487:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305209.619542:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785806080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305209.619549:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1789305209.622877:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785806080:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789305210.196412:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305210.668191:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305210.668239:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305210.668281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305210.668337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305210.668371:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765721472 00000100:00100000:3.0:1789305210.668380:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765721472 00000100:00100000:3.0:1789305210.668435:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765721344 00000100:00100000:3.0:1789305210.668439:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765721344 00000100:00100000:3.0:1789305210.668452:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765721600 00000100:00100000:3.0:1789305210.668454:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765721600 00000100:00100000:3.0:1789305210.668473:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:3.0:1789305210.668483:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b9cec9f-35a6-4528-b610-aec2cd17adff+12:2355:x1876219765721472:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789305210.668501:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305210.668522:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e200/0xefc0bb723129820b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a48 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305210.668554:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305210.668625:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b9cec9f-35a6-4528-b610-aec2cd17adff+11:2355:x1876219765721472:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 141us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305210.668633:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:3.0:1789305210.668651:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:3.0:1789305210.668658:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2eb4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b9cec9f-35a6-4528-b610-aec2cd17adff+10:2355:x1876219765721344:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789305210.668665:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305210.668674:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371e00/0xefc0bb7231298204 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a1e expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305210.668688:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305210.668717:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2eb4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b9cec9f-35a6-4528-b610-aec2cd17adff+9:2355:x1876219765721344:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 59us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305210.668733:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:3.0:1789305210.668778:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:3.0:1789305210.668785:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b9cec9f-35a6-4528-b610-aec2cd17adff+8:2355:x1876219765721600:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789305210.668793:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305210.668801:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41370600/0xefc0bb723129826d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a80 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305210.668810:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305210.668828:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8b9cec9f-35a6-4528-b610-aec2cd17adff+7:2355:x1876219765721600:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 43us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305210.668834:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:1.0:1789305210.671774:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765721216 00000100:00100000:1.0:1789305210.671788:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765721216 00000100:00100000:1.0:1789305210.671870:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 695 00000100:00100000:1.0:1789305210.671882:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c410d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2353:x1876219765721216:12345-192.168.202.29@tcp:9:umount.0 00000020:00000080:1.0:1789305210.671924:0:17212:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231298227 00000100:00080000:1.0:1789305210.671935:0:17212:0:(import.c:65:import_set_state_nolock()) ffff9e2c20274000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789305210.671940:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:1.0:1789305210.671990:0:17212:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1789305210.672384:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c410d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:75fc90c1-a4fe-419b-8369-98cdb6ace105+2:2353:x1876219765721216:12345-192.168.202.29@tcp:9:umount.0 Request processed in 503us (4202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305210.672393:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 695 00010000:00010000:0.0:1789305210.672708:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305210.679390:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305210.679774:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765721728 00000100:00100000:1.0:1789305210.679783:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765721728 00000100:00100000:1.0:1789305210.679906:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 696 00000100:00100000:1.0:1789305210.679919:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2353:x1876219765721728:12345-192.168.202.29@tcp:9:umount.0 00000020:00000080:1.0:1789305210.679954:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231298220 00000100:00080000:1.0:1789305210.679963:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2c3f698000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789305210.680020:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1789305210.680326:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:75fc90c1-a4fe-419b-8369-98cdb6ace105+2:2353:x1876219765721728:12345-192.168.202.29@tcp:9:umount.0 Request processed in 403us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305210.680334:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 696 00010000:00010000:3.0:1789305210.680606:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789305210.683636:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789305210.691759:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305210.693179:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765721984 00000100:00100000:1.0:1789305210.693193:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765721984 00000100:00100000:1.0:1789305210.693277:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1267 00000100:00100000:1.0:1789305210.693286:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75fc90c1-a4fe-419b-8369-98cdb6ace105+6:2353:x1876219765721984:12345-192.168.202.29@tcp:39:umount.0 00000020:00000080:1.0:1789305210.693319:0:30980:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb7231298219 00000020:00010000:1.0:1789305210.693329:0:30980:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9e2c384c1000: total 0 00000100:00080000:1.0:1789305210.693333:0:30980:0:(import.c:65:import_set_state_nolock()) ffff9e2c384c3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789305210.693404:0:30980:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967779 00000100:00100000:1.0:1789305210.694129:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:75fc90c1-a4fe-419b-8369-98cdb6ace105+5:2353:x1876219765721984:12345-192.168.202.29@tcp:39:umount.0 Request processed in 841us (2377us total) trans 4294967780 rc 0/0 00000100:00100000:1.0:1789305210.694138:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1267 00000100:00080000:2.0:1789305210.694374:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1789305210.698821:0:5840:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9e2c384c1000: total 0 00010000:00010000:0.0:1789305210.698831:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305210.698889:0:5840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c384c1000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789305210.698939:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e2c0558d400) 00010000:00010000:0.0:1789305210.698944:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789305210.698956:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e2c05afb800/0xefc0bb7231298235 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a79 expref: 4 pid: 30980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305210.699047:0:5840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c384c1000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789305210.699058:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305210.699060:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305210.699062:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305210.728360:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305210.729556:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765722240 00000100:00100000:1.0:1789305210.729571:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765722240 00000100:00100000:1.0:1789305210.729639:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1509 00000100:00100000:1.0:1789305210.729650:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+7:2353:x1876219765722240:12345-192.168.202.29@tcp:251:umount.0 00000020:00000080:1.0:1789305210.729690:0:5845:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb72312981f6 00000020:00010000:1.0:1789305210.729697:0:5845:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9e2b02d12000: total 0 00000100:00080000:1.0:1789305210.729702:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9e2b02d15800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789305210.729782:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8b9cec9f-35a6-4528-b610-aec2cd17adff+3:2353:x1876219765722240:12345-192.168.202.29@tcp:251:umount.0 Request processed in 133us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305210.729790:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1509 00000020:00010000:0.0:1789305210.730167:0:8464:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9e2b02d12000: total 0 00010000:00010000:0.0:1789305210.730211:0:8464:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2b02d12000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789305210.730244:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371200/0xefc0bb72312981fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a17 expref: 2 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305210.730263:0:8464:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2b02d12000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789305210.730272:0:8464:0:(genops.c:885:class_export_put()) final put ffff9e2b02d12000/8b9cec9f-35a6-4528-b610-aec2cd17adff 00010000:00010000:0.0:1789305210.730297:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305210.730300:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305210.730302:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789305210.730575:0:62852:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2b02d12000/8b9cec9f-35a6-4528-b610-aec2cd17adff for MGS 00000020:00000080:2.0:1789305210.730615:0:62852:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2b02d15800 for MGS 00010000:00010000:3.0:1789305211.224414:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305212.243218:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789305212.720639:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 75fc90c1-a4fe-419b-8369-98cdb6ace105 00000001:00080000:0.0:1789305212.721292:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967780 is committed 00000020:00000080:0.0:1789305212.721301:0:5874:0:(genops.c:885:class_export_put()) final put ffff9e2c384c1000/75fc90c1-a4fe-419b-8369-98cdb6ace105 00000020:00000080:0.0:1789305212.721423:0:490:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c384c1000/75fc90c1-a4fe-419b-8369-98cdb6ace105 for lustre-MDT0000 00000020:00000080:0.0:1789305212.721498:0:490:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c384c3000 for lustre-MDT0000 00000020:00000080:3.0:1789305212.737829:0:107427:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe974921c0 20000000:00000080:3.0:1789305212.737848:0:107427:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e77400 uarg=0000000000000000 10000000:01000000:2.0:1789305212.777664:0:107427:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305212.777692:0:107427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305212.777710:0:107427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312981a2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129819b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305212.777788:0:107427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305212.777826:0:107427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312981a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129819b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305212.777841:0:107427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312981a2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129819b expref: 18 pid: 5846 timeout: 2762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305212.777854:0:107427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107427:1876219785806208:0@lo:104: 00000100:00100000:2.0:1789305212.777953:0:107427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305212.778057:0:107427:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c08b2d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789305212.778124:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785806208 00000100:00100000:1.0:1789305212.778132:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785806208 00000100:00100000:1.0:1789305212.778231:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1789305212.778241:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:107427:x1876219785806208:12345-0@lo:104: 00010000:00010000:1.0:1789305212.778253:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305212.778311:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789305212.778316:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:107427:x1876219785806208:12345-0@lo:104: Request processed in 78us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305212.778322:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00010000:00010000:0.0:1789305212.778357:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305212.778364:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.778371:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afa000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305212.778374:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.778382:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305212.778388:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305212.778393:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789305212.778421:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.778427:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305212.778447:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.778458:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afa000/0xefc0bb723129819b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312981a2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.778471:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305212.778472:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305212.778474:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305212.778489:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785806336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305212.778516:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305212.778551:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785806336 00000100:00100000:0.0:1789305212.778554:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785806336 00010000:00010000:0.0:1789305212.778570:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312981a2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129819b expref: 19 pid: 5846 timeout: 2762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305212.778593:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1789305212.778600:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785806336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305212.778609:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305212.778614:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312981a2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129819b expref: 19 pid: 5846 timeout: 2762 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305212.778620:0:107427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107427:1876219785806208:0@lo:104: 00010000:00010000:0.0:1789305212.778627:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312981a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129819b expref: 19 pid: 5846 timeout: 2762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.778647:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afac00/0xefc0bb72312981a2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129819b expref: 19 pid: 5846 timeout: 2762 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305212.778653:0:107427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.778660:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.778673:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305212.779194:0:107427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.779195:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305212.779215:0:107427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.779216:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.779233:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.779241:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.779247:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305212.779251:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.779259:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.779269:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.779278:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc400/0xefc0bb7231298274 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305212.779295:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789305212.779432:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785806336:12345-0@lo:103:ldlm_bl.0 Request processed in 833us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305212.779440:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1789305212.779500:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785806336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305213.271953:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789305213.472479:0:107475:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd41fd6c80 20000000:00000080:0.0:1789305213.472496:0:107475:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c37023800 uarg=0000000000000000 10000000:01000000:0.0:1789305213.477054:0:107475:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789305213.477084:0:107475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305213.477129:0:107475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305213.477140:0:107475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305213.477147:0:107475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305213.477154:0:107475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305213.477160:0:107475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305213.477165:0:107475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afac00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305213.477169:0:107475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305213.477176:0:107475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305213.477188:0:107475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305213.477195:0:107475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305213.477202:0:107475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afac00/0xefc0bb723129827b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305213.714307:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789305213.714330:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785806464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305213.714414:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305213.714463:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785806464 00000100:00100000:2.0:1789305213.714472:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785806464 00000100:00100000:2.0:1789305213.714545:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1789305213.714557:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785806464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305213.714593:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305213.714653:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785806464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305213.714661:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1789305213.714725:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03619500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785806464:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789305213.714739:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1789305214.129265:0:107523:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd39a95a00 20000000:00000080:3.0:1789305214.129287:0:107523:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c02e77000 uarg=0000000000000000 10000000:01000000:3.0:1789305214.129486:0:107523:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305214.129509:0:107523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.129524:0:107523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.129536:0:107523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.129543:0:107523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.129551:0:107523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.129558:0:107523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.129565:0:107523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305214.129569:0:107523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.129577:0:107523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.129591:0:107523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.129599:0:107523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.129606:0:107523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298282 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305214.226431:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785806976:0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.226499:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305214.226555:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789305214.226562:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785806592:0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.226591:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305214.226615:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785807104:0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.226636:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305214.226662:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785806720:0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.226684:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305214.226703:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305214.226708:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785806848:0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.226731:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305214.226764:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785806976 00000100:00100000:3.0:1789305214.226772:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785806976 00000100:00100000:3.0:1789305214.226823:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785807104 00000100:00100000:3.0:1789305214.226826:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785807104 00000100:00100000:3.0:1789305214.226846:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785806720 00000100:00100000:3.0:1789305214.226848:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785806720 00000100:00100000:3.0:1789305214.226874:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1789305214.226883:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785806976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.226932:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785806976:12345-0@lo:400:kworker.0 Request processed in 50us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305214.226938:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1789305214.226953:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1789305214.226958:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785807104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.226981:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876219785807104:12345-0@lo:400:kworker.0 Request processed in 24us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305214.226987:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1789305214.226996:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:3.0:1789305214.227002:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785806720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.227033:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785806720:12345-0@lo:400:kworker.0 Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305214.227038:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:3.0:1789305214.227055:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785806592 00000100:00100000:3.0:1789305214.227058:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785806592 00000100:00100000:3.0:1789305214.227082:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1789305214.228050:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785806592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.228137:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785806592:12345-0@lo:400:kworker.0 Request processed in 1048us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305214.228146:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1789305214.228193:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785806848 00000100:00100000:3.0:1789305214.229273:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785806848 00000100:00100000:3.0:1789305214.229315:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:3.0:1789305214.229321:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785806848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.229363:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785806848:12345-0@lo:400:kworker.0 Request processed in 44us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305214.229367:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00080000:3.0:1789305214.229382:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789305214.229385:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305214.233209:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785806592:0@lo:400:kworker.0 00000100:00100000:2.0:1789305214.233234:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1876219785807104:0@lo:400:kworker.0 00000100:00100000:2.0:1789305214.233245:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785806976:0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.235031:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785806848:0@lo:400:kworker.0 00000100:00100000:3.0:1789305214.235052:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785806720:0@lo:400:kworker.0 00010000:00010000:3.0:1789305214.290550:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305214.355125:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305214.355133:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305214.355136:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305214.355183:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.355191:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.355299:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305214.355323:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785807232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305214.355381:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305214.355491:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b03728540 going to sleep for 11 seconds 00000100:00100000:3.0:1789305214.356466:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785807232 00000100:00100000:3.0:1789305214.356476:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785807232 00000100:00100000:3.0:1789305214.356551:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1789305214.356561:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785807232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305214.356577:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305214.356717:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298290 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298289 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.356743:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298290 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298289 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.356754:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298290 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298289 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.356762:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860f800, rc 0) 00000100:00100000:3.0:1789305214.356884:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785807232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 324us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305214.356891:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:0.0:1789305214.356970:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785807232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305214.356987:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.356996:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305214.357019:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789305214.357027:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.357033:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305214.741729:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785807360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305214.741799:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305214.741908:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785807360 00000100:00100000:0.0:1789305214.741971:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785807360 00000100:00100000:0.0:1789305214.742028:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1789305214.742038:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785807360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305214.742072:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305214.742145:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785807360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305214.742152:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1789305214.742196:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785807360:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1789305214.813563:0:107571:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeee532690 20000000:00000080:3.0:1789305214.813581:0:107571:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3fb8f800 uarg=0000000000000000 10000000:01000000:3.0:1789305214.813794:0:107571:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305214.813814:0:107571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.813831:0:107571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298290 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298289 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.813840:0:107571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.813891:0:107571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298290 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231298289 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.814024:0:107571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298290 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231298289 expref: 18 pid: 5846 timeout: 2764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305214.814042:0:107571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06236300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107571:1876219785807488:0@lo:104: 00000100:00100000:3.0:1789305214.814191:0:107571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305214.814294:0:107571:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b024b56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789305214.814487:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789305214.814502:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785807488 00000100:00100000:0.0:1789305214.814511:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785807488 00000100:00100000:0.0:1789305214.814601:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1789305214.814611:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c412e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:107571:x1876219785807488:12345-0@lo:104: 00010000:00010000:0.0:1789305214.814624:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.814693:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305214.814700:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c412e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:107571:x1876219785807488:12345-0@lo:104: Request processed in 91us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305214.814708:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1789305214.814806:0:107571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06236300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107571:1876219785807488:0@lo:104: 00010000:00010000:3.0:1789305214.814827:0:107571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305214.814881:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305214.814888:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305214.814895:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789305214.814900:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305214.814931:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789305214.814939:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305214.814945:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789305214.814985:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305214.814992:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789305214.815014:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305214.815021:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c05afb000/0xefc0bb7231298289 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298290 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305214.815038:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305214.815040:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305214.815041:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305214.815055:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785807616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789305214.815084:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305214.815629:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785807616 00000100:00100000:0.0:1789305214.815636:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785807616 00010000:00010000:0.0:1789305214.815658:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298290 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298289 expref: 19 pid: 5846 timeout: 2764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305214.815719:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1789305214.815728:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785807616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305214.815741:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305214.815746:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298290 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298289 expref: 19 pid: 5846 timeout: 2764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815758:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298290 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231298289 expref: 19 pid: 5846 timeout: 2764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815780:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f800/0xefc0bb7231298290 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231298289 expref: 19 pid: 5846 timeout: 2764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815794:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815802:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815815:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815823:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815835:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815842:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815848:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305214.815852:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815872:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815891:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305214.815900:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789305214.816067:0:107571:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.816076:0:107571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305214.816082:0:107571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e200/0xefc0bb7231298297 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305214.817883:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785807616:12345-0@lo:103:ldlm_bl.0 Request processed in 2150us (2791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305214.817896:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1789305214.818114:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785807616:0@lo:103:ldlm_bl.0 00000001:00100000:1.0:1789305215.286743:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 75fc90c1-a4fe-419b-8369-98cdb6ace105 00000020:00000080:1.0:1789305215.286752:0:6723:0:(genops.c:885:class_export_put()) final put ffff9e2c3f69e000/75fc90c1-a4fe-419b-8369-98cdb6ace105 00000020:00000080:0.0:1789305215.287279:0:490:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c3f69e000/75fc90c1-a4fe-419b-8369-98cdb6ace105 for lustre-OST0000 00000020:00000080:0.0:1789305215.287614:0:490:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c3f698000 for lustre-OST0000 00000001:00100000:3.0:1789305215.304583:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 75fc90c1-a4fe-419b-8369-98cdb6ace105 00000020:00000080:3.0:1789305215.304591:0:7657:0:(genops.c:885:class_export_put()) final put ffff9e2c20272800/75fc90c1-a4fe-419b-8369-98cdb6ace105 00000020:00000080:0.0:1789305215.304726:0:490:0:(genops.c:844:class_export_destroy()) destroying export ffff9e2c20272800/75fc90c1-a4fe-419b-8369-98cdb6ace105 for lustre-OST0001 00000020:00000080:0.0:1789305215.304909:0:490:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9e2c20274000 for lustre-OST0001 00010000:00010000:3.0:1789305215.315275:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305216.341125:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789305216.478210:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789305216.478303:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789305216.478308:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789305216.478369:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305216.478382:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305216.478397:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305216.478429:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785807744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789305216.478499:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305216.478581:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08b2ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1789305216.478616:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785807744 00000100:00100000:3.0:1789305216.478622:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785807744 00000100:00100000:3.0:1789305216.478973:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1789305216.478982:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785807744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305216.478994:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305216.479006:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982a5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129829e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305216.479027:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129829e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305216.479034:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129829e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305216.479041:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e200, rc 0) 00000100:00100000:3.0:1789305216.479161:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785807744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305216.479166:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:0.0:1789305216.494324:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785807744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305216.494356:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305216.494374:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305216.494399:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789305216.494403:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305216.494411:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305217.365008:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789305217.880467:0:107771:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd5db25780 20000000:00000080:1.0:1789305217.880483:0:107771:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f72e800 uarg=0000000000000000 10000000:01000000:1.0:1789305217.880954:0:107771:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305217.880975:0:107771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305217.880996:0:107771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129829e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305217.881005:0:107771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305217.881050:0:107771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129829e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305217.881065:0:107771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982a5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129829e expref: 18 pid: 5845 timeout: 2767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305217.881081:0:107771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107771:1876219785807872:0@lo:104: 00000100:00100000:0.0:1789305217.881356:0:107771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305217.881443:0:107771:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c20752f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789305217.881483:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785807872 00000100:00100000:1.0:1789305217.881491:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785807872 00000100:00100000:1.0:1789305217.881576:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1789305217.881588:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:107771:x1876219785807872:12345-0@lo:104: 00010000:00010000:1.0:1789305217.881601:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305217.881676:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789305217.881683:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:107771:x1876219785807872:12345-0@lo:104: Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305217.881690:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00010000:00010000:2.0:1789305217.881746:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789305217.881755:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.881762:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecca00 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:2.0:1789305217.881766:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.881775:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789305217.881783:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305217.881788:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789305217.881819:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.881825:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789305217.881858:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.881865:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecca00/0xefc0bb723129829e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312982a5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.881883:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305217.881884:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305217.881886:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305217.881905:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785808000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789305217.881934:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305217.881970:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785808000 00000100:00100000:2.0:1789305217.881974:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785808000 00010000:00010000:2.0:1789305217.881993:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982a5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129829e expref: 19 pid: 5845 timeout: 2767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305217.882014:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1789305217.882021:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785808000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305217.882032:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305217.882037:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982a5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129829e expref: 19 pid: 5845 timeout: 2767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882047:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982a5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129829e expref: 19 pid: 5845 timeout: 2767 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882064:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882072:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882085:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882116:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882123:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882130:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882136:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371a00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305217.882140:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882148:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882156:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305217.882165:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789305217.882193:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785808000:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305217.882199:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1789305217.882237:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785808000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305217.882314:0:107771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982a5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129829e expref: 18 pid: 5845 timeout: 2767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305217.882336:0:107771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107771:1876219785807872:0@lo:104: 00010000:00010000:3.0:1789305217.882350:0:107771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305217.882358:0:107771:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305217.882365:0:107771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305217.882372:0:107771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371a00/0xefc0bb72312982ac lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305218.387052:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305218.835498:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785808128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305218.835572:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305218.836413:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785808128 00000100:00100000:0.0:1789305218.836424:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785808128 00000100:00100000:0.0:1789305218.836492:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1789305218.836503:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785808128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789305218.836538:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789305218.836613:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789305218.841133:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785808128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4622us (5550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305218.841148:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:1.0:1789305218.845015:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06236300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785808128:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1789305219.026564:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789305219.026572:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789305219.026578:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789305219.026629:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305219.026640:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305219.026655:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305219.027808:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785808256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789305219.027925:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305219.028050:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c013773c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789305219.031729:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785808256 00000100:00100000:3.0:1789305219.031744:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785808256 00000100:00100000:3.0:1789305219.031804:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:3.0:1789305219.031815:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785808256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305219.031842:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305219.032393:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312982ba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb72312982b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305219.032427:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312982ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb72312982b3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305219.032439:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312982ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312982b3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305219.032448:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e400, rc 0) 00000100:00100000:3.0:1789305219.032534:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785808256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 722us (4609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305219.032543:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:2.0:1789305219.032836:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785808256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305219.032859:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305219.032879:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305219.032900:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789305219.032906:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305219.032913:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305219.352673:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785808384:0@lo:400:kworker.0 00000100:00100000:0.0:1789305219.352749:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305219.352895:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785808384 00000100:00100000:3.0:1789305219.352903:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785808384 00000100:00100000:3.0:1789305219.352948:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1789305219.352957:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785808384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305219.355282:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785808640:0@lo:400:kworker.0 00000100:00100000:1.0:1789305219.355360:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305219.355396:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789305219.355403:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785808768:0@lo:400:kworker.0 00000100:00100000:1.0:1789305219.355430:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305219.355470:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785808640 00000100:00100000:1.0:1789305219.355478:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785808640 00000100:00100000:1.0:1789305219.355537:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:1.0:1789305219.355547:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785808640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305219.355598:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785808640:12345-0@lo:400:kworker.0 Request processed in 54us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305219.355605:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:1.0:1789305219.355630:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785808768 00000100:00100000:1.0:1789305219.355634:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785808768 00000100:00100000:1.0:1789305219.355663:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:1.0:1789305219.355669:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785808768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305219.355700:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785808768:12345-0@lo:400:kworker.0 Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305219.355706:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00080000:1.0:1789305219.355722:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789305219.355726:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305219.355759:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785808768:0@lo:400:kworker.0 00000100:00100000:1.0:1789305219.355769:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785808640:0@lo:400:kworker.0 00000100:00100000:3.0:1789305219.356203:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785808384:12345-0@lo:400:kworker.0 Request processed in 3245us (3452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305219.356212:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1789305219.358075:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785808512:0@lo:400:kworker.0 00000100:00100000:3.0:1789305219.358156:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305219.358197:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785809024:0@lo:400:kworker.0 00000100:00100000:3.0:1789305219.358222:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305219.358247:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789305219.358253:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785808896:0@lo:400:kworker.0 00000100:00100000:3.0:1789305219.358276:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305219.358311:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785808512 00000100:00100000:3.0:1789305219.358318:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785808512 00000100:00100000:3.0:1789305219.358436:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785808896 00000100:00100000:3.0:1789305219.358440:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785808896 00000100:00100000:3.0:1789305219.358475:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:3.0:1789305219.358482:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785808512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305219.358534:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785808512:12345-0@lo:400:kworker.0 Request processed in 53us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305219.358541:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:3.0:1789305219.358558:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:3.0:1789305219.358564:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785808896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305219.358590:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785808896:12345-0@lo:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305219.358594:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:3.0:1789305219.358614:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785809024 00000100:00100000:3.0:1789305219.358617:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785809024 00000100:00100000:3.0:1789305219.358641:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:3.0:1789305219.358647:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785809024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305219.358675:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785809024:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305219.358680:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:3.0:1789305219.358727:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785808896:0@lo:400:kworker.0 00000100:00100000:3.0:1789305219.358739:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c03618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785808512:0@lo:400:kworker.0 00000100:00100000:3.0:1789305219.358748:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785809024:0@lo:400:kworker.0 00000100:00100000:0.0:1789305219.360041:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0361aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785808384:0@lo:400:kworker.0 00000100:00080000:1.0:1789305219.361037:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789305219.410620:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305219.861052:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789305219.861074:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785809152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305219.861165:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305219.861226:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785809152 00000100:00100000:2.0:1789305219.861234:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785809152 00000100:00100000:2.0:1789305219.861280:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1789305219.861290:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785809152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789305219.861324:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305219.861381:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785809152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305219.861388:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1789305219.861437:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785809152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789305220.308983:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305220.309060:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765722368 00000100:00100000:2.0:1789305220.309071:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765722368 00000100:00100000:2.0:1789305220.313210:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1515 00000100:00100000:2.0:1789305220.313223:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1876219765722368:12345-192.168.202.29@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789305220.313258:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f0a20927-8136-42ab-80b0-31bbdbd3bd59@192.168.202.29@tcp t0 exp 0000000000000000 cur 2669 last 0 00000020:00000080:2.0:1789305220.313288:0:5847:0:(genops.c:1384:class_connect()) connect: client f0a20927-8136-42ab-80b0-31bbdbd3bd59, cookie 0xefc0bb72312982c1 00000100:00080000:2.0:1789305220.313345:0:5847:0:(import.c:65:import_set_state_nolock()) ffff9e2c27dfd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789305220.313429:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0a20927-8136-42ab-80b0-31bbdbd3bd59+5:2353:x1876219765722368:12345-192.168.202.29@tcp:250:mount.lustre.0 Request processed in 206us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305220.313437:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1515 00000100:00100000:2.0:1789305220.317152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305220.317236:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765722496 00000100:00100000:3.0:1789305220.317247:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765722496 00000100:00100000:3.0:1789305220.317299:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1516 00000100:00100000:3.0:1789305220.317309:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+5:64882:x1876219765722496:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789305220.317324:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305220.317342:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100a95 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305220.317370:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a95 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305220.317382:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e200/0xefc0bb72312982c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a95 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305220.317392:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e200, rc 0) 00000100:00100000:3.0:1789305220.317449:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+6:64882:x1876219765722496:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 142us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305220.317457:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1516 00000100:00100000:0.0:1789305220.331609:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305220.331748:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765722624 00000100:00100000:3.0:1789305220.331761:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765722624 00000100:00100000:3.0:1789305220.331825:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1517 00000100:00100000:3.0:1789305220.331836:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+6:64882:x1876219765722624:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789305220.332417:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+6:64882:x1876219765722624:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 581us (817us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789305220.332426:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1517 00000100:00100000:2.0:1789305220.343993:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305220.347442:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765722752 00000100:00100000:3.0:1789305220.347460:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765722752 00000100:00100000:3.0:1789305220.349931:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1518 00000100:00100000:3.0:1789305220.349957:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+6:64882:x1876219765722752:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789305220.349978:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305220.349999:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312982cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100a9c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305220.350029:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312982cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a9c expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305220.350040:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860fe00/0xefc0bb72312982cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100a9c expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305220.350049:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860fe00, rc 0) 00000100:00100000:3.0:1789305220.350129:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c05769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+7:64882:x1876219765722752:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 183us (6145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305220.350136:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1518 00000100:00100000:2.0:1789305220.358484:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305220.358799:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765722880 00000100:00100000:3.0:1789305220.358840:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765722880 00000100:00100000:3.0:1789305220.358894:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1519 00000100:00100000:3.0:1789305220.358901:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+7:64882:x1876219765722880:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789305220.359410:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+8:64882:x1876219765722880:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 507us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305220.359418:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1519 00000100:00100000:0.0:1789305220.361222:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305220.361601:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765723008 00000100:00100000:3.0:1789305220.361611:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765723008 00000100:00100000:3.0:1789305220.361662:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1520 00000100:00100000:3.0:1789305220.361672:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+8:64882:x1876219765723008:12345-192.168.202.29@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789305220.362033:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+8:64882:x1876219765723008:12345-192.168.202.29@tcp:503:mount.lustre.0 Request processed in 360us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305220.362042:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1520 00000100:00100000:2.0:1789305220.368203:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305220.368503:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765723136 00000100:00100000:3.0:1789305220.368514:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765723136 00000100:00100000:3.0:1789305220.368574:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1521 00000100:00100000:3.0:1789305220.368690:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+8:64901:x1876219765723136:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789305220.372302:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+8:64901:x1876219765723136:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 3597us (4091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305220.372320:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1521 00000100:00100000:0.0:1789305220.403275:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305220.403350:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765723264 00000100:00100000:3.0:1789305220.403361:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765723264 00000100:00100000:3.0:1789305220.403418:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1522 00000100:00100000:3.0:1789305220.403427:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+8:64901:x1876219765723264:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789305220.403729:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0576bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+8:64901:x1876219765723264:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 303us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305220.403736:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1522 00000100:00100000:1.0:1789305220.406879:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305220.407128:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765723392 00000100:00100000:3.0:1789305220.407139:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765723392 00000100:00100000:3.0:1789305220.407185:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1523 00000100:00100000:3.0:1789305220.407194:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+8:64882:x1876219765723392:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789305220.407209:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789305220.407226:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e800/0xefc0bb72312982d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100ac6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305220.407254:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e800/0xefc0bb72312982d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100ac6 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305220.407265:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c3860e800/0xefc0bb72312982d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100ac6 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305220.407274:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c3860e800, rc 0) 00000100:00100000:3.0:1789305220.407334:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+9:64882:x1876219765723392:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 142us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305220.407341:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1523 00000100:00100000:0.0:1789305220.410226:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305220.410302:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765723520 00000100:00100000:2.0:1789305220.410316:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765723520 00000100:00100000:2.0:1789305220.410380:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1524 00000100:00100000:2.0:1789305220.410391:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0a20927-8136-42ab-80b0-31bbdbd3bd59+9:64882:x1876219765723520:12345-192.168.202.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789305220.410421:0:5847:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789305220.410453:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789305220.410458:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789305220.410461:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789305220.410463:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789305220.413270:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0a20927-8136-42ab-80b0-31bbdbd3bd59+9:64882:x1876219765723520:12345-192.168.202.29@tcp:256:mount.lustre.0 Request processed in 2868us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305220.413287:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1524 00000100:00100000:1.0:1789305220.419456:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305220.419596:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765723648 00000100:00100000:0.0:1789305220.419610:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765723648 00000100:00100000:0.0:1789305220.419719:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1525 00000100:00100000:0.0:1789305220.419733:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+9:64882:x1876219765723648:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789305220.419754:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305220.419776:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312982dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b023c6d86100acd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305220.419822:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312982dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100acd expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305220.419834:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afa400/0xefc0bb72312982dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b023c6d86100acd expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305220.419843:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afa400, rc 0) 00000100:00100000:0.0:1789305220.419919:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:64882:x1876219765723648:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 189us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305220.419926:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1525 00000100:00100000:0.0:1789305220.424765:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305220.424847:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765723776 00000100:00100000:2.0:1789305220.424859:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765723776 00000100:00100000:2.0:1789305220.424968:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1526 00000100:00100000:2.0:1789305220.424979:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:64882:x1876219765723776:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789305220.425353:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:64882:x1876219765723776:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 374us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305220.425361:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1526 00000100:00100000:2.0:1789305220.431139:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305220.431363:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765723904 00000100:00100000:0.0:1789305220.431375:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765723904 00000100:00100000:0.0:1789305220.431431:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1527 00000100:00100000:0.0:1789305220.431440:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:64882:x1876219765723904:12345-192.168.202.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789305220.431863:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:64882:x1876219765723904:12345-192.168.202.29@tcp:503:mount.lustre.0 Request processed in 422us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305220.431872:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1527 00010000:00010000:2.0:1789305220.434322:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305220.435167:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305220.435269:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765724032 00000100:00100000:3.0:1789305220.435279:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765724032 00000100:00100000:3.0:1789305220.435329:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1528 00000100:00100000:3.0:1789305220.435338:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:64907:x1876219765724032:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789305220.435583:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:64907:x1876219765724032:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 238us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305220.435591:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1528 00000100:00100000:2.0:1789305220.470283:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305220.470352:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765724160 00000100:00100000:1.0:1789305220.470363:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765724160 00000100:00100000:1.0:1789305220.470427:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1529 00000100:00100000:1.0:1789305220.470438:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:64907:x1876219765724160:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789305220.470705:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:64907:x1876219765724160:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 269us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305220.470713:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1529 00000100:00100000:2.0:1789305220.473430:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305220.473494:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765724288 00000100:00100000:1.0:1789305220.473504:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765724288 00000100:00100000:1.0:1789305220.473566:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1268 00000100:00100000:1.0:1789305220.473574:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1876219765724288:12345-192.168.202.29@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789305220.473604:0:7654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0b597d4f-5f06-4326-afba-00059d8f9c97@192.168.202.29@tcp t0 exp 0000000000000000 cur 2670 last 0 00000020:00000080:1.0:1789305220.473651:0:7654:0:(genops.c:1384:class_connect()) connect: client 0b597d4f-5f06-4326-afba-00059d8f9c97, cookie 0xefc0bb72312982e4 00000004:00100000:1.0:1789305220.473682:0:7654:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789305220.473939:0:7654:0:(import.c:65:import_set_state_nolock()) ffff9e2c3f69e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789305220.474011:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b597d4f-5f06-4326-afba-00059d8f9c97+6:2353:x1876219765724288:12345-192.168.202.29@tcp:38:mount.lustre.0 Request processed in 436us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305220.474019:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1268 00000100:00100000:2.0:1789305220.477228:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305220.477356:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305220.478447:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765724544 00000100:00100000:3.0:1789305220.478461:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765724544 00000100:00100000:3.0:1789305220.478582:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765724416 00000100:00100000:3.0:1789305220.478586:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765724416 00000100:00100000:3.0:1789305220.478612:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1269 00000100:00100000:3.0:1789305220.478621:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+7:64882:x1876219765724544:12345-192.168.202.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789305220.478666:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1789305220.478740:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+7:64882:x1876219765724544:12345-192.168.202.29@tcp:41:mount.lustre.0 Request processed in 119us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305220.478748:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1269 00000100:00100000:3.0:1789305220.478767:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1270 00000100:00100000:3.0:1789305220.478773:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+6:0:x1876219765724416:12345-192.168.202.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789305220.478785:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1789305220.478819:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+6:0:x1876219765724416:12345-192.168.202.29@tcp:41:mount.lustre.0 Request processed in 46us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305220.478825:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1270 00000100:00080000:1.0:1789305220.479983:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305220.484873:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305220.485060:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765724672 00000100:00100000:1.0:1789305220.485072:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765724672 00000100:00100000:1.0:1789305220.485181:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1271 00000100:00100000:1.0:1789305220.485192:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b597d4f-5f06-4326-afba-00059d8f9c97+6:64882:x1876219765724672:12345-192.168.202.29@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789305220.485287:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0b597d4f-5f06-4326-afba-00059d8f9c97+6:64882:x1876219765724672:12345-192.168.202.29@tcp:40:mount.lustre.0 Request processed in 96us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305220.485294:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1271 00000100:00100000:3.0:1789305220.491258:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305220.491768:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305220.491875:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305220.492056:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765724800 00000100:00100000:0.0:1789305220.492067:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765724800 00000100:00100000:0.0:1789305220.492137:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765724928 00000100:00100000:0.0:1789305220.492141:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765724928 00000100:00100000:0.0:1789305220.492163:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 697 00000100:00100000:0.0:1789305220.492171:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876219765724800:12345-192.168.202.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789305220.492203:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0b597d4f-5f06-4326-afba-00059d8f9c97@192.168.202.29@tcp t0 exp 0000000000000000 cur 2670 last 0 00000020:00000080:0.0:1789305220.492236:0:6692:0:(genops.c:1384:class_connect()) connect: client 0b597d4f-5f06-4326-afba-00059d8f9c97, cookie 0xefc0bb72312982eb 00002000:00100000:0.0:1789305220.492249:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0b597d4f-5f06-4326-afba-00059d8f9c97/ffff9e2b02ec9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789305220.492262:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789305220.492508:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789305220.492541:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9e2b02ece800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789305220.492626:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b597d4f-5f06-4326-afba-00059d8f9c97+6:2353:x1876219765724800:12345-192.168.202.29@tcp:8:mount.lustre.0 Request processed in 455us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305220.492634:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 697 00000100:00100000:0.0:1789305220.492653:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 698 00000100:00100000:0.0:1789305220.492657:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1876219765724928:12345-192.168.202.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789305220.492673:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0b597d4f-5f06-4326-afba-00059d8f9c97@192.168.202.29@tcp t0 exp 0000000000000000 cur 2670 last 0 00000020:00000080:0.0:1789305220.492689:0:6692:0:(genops.c:1384:class_connect()) connect: client 0b597d4f-5f06-4326-afba-00059d8f9c97, cookie 0xefc0bb72312982f2 00002000:00100000:0.0:1789305220.492694:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0b597d4f-5f06-4326-afba-00059d8f9c97/ffff9e2b02ecb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789305220.492709:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789305220.492863:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789305220.492879:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9e2b02ecd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789305220.492902:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b597d4f-5f06-4326-afba-00059d8f9c97+6:2353:x1876219765724928:12345-192.168.202.29@tcp:8:mount.lustre.0 Request processed in 244us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305220.492912:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 698 00000100:00100000:1.0:1789305220.493771:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765725056 00000100:00100000:1.0:1789305220.493782:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765725056 00000100:00100000:1.0:1789305220.493845:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 129 00000100:00100000:1.0:1789305220.493866:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b597d4f-5f06-4326-afba-00059d8f9c97+6:64882:x1876219765725056:12345-192.168.202.29@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789305220.493929:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789305220.494002:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0b597d4f-5f06-4326-afba-00059d8f9c97+6:64882:x1876219765725056:12345-192.168.202.29@tcp:33:mount.lustre.0 Request processed in 148us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305220.494008:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 129 00010000:00010000:3.0:1789305221.458313:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305222.482852:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789305222.977109:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0b597d4f-5f06-4326-afba-00059d8f9c97 00010000:00010000:2.0:1789305223.507839:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305223.955278:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785809280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305223.955355:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305223.955453:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785809280 00000100:00100000:1.0:1789305223.955463:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785809280 00000100:00100000:1.0:1789305223.956356:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1789305223.956373:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785809280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789305223.956412:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789305223.956466:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785809280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305223.956528:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00080000:1.0:1789305223.956565:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305223.956625:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785809280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789305224.466699:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2b02d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785809408:0@lo:400:kworker.0 00000100:00100000:0.0:1789305224.466799:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305224.466956:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785809408 00000100:00100000:3.0:1789305224.466966:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785809408 00000100:00100000:3.0:1789305224.467021:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:3.0:1789305224.467030:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785809408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305224.467136:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785809536:0@lo:400:kworker.0 00000100:00100000:1.0:1789305224.467193:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305224.468547:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785809664:0@lo:400:kworker.0 00000100:00100000:0.0:1789305224.468598:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305224.468639:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789305224.468657:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785809792:0@lo:400:kworker.0 00000100:00100000:0.0:1789305224.468681:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305224.468715:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785809536 00000100:00100000:0.0:1789305224.468723:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785809536 00000100:00100000:0.0:1789305224.468759:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785809792 00000100:00100000:0.0:1789305224.468762:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785809792 00000100:00100000:0.0:1789305224.468810:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:0.0:1789305224.468818:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785809536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305224.468861:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876219785809536:12345-0@lo:400:kworker.0 Request processed in 44us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305224.468868:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:0.0:1789305224.468887:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:0.0:1789305224.468893:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785809792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305224.468923:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876219785809792:12345-0@lo:400:kworker.0 Request processed in 31us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305224.468928:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00080000:0.0:1789305224.468947:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305224.468977:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1876219785809792:0@lo:400:kworker.0 00000100:00100000:3.0:1789305224.469081:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785809408:12345-0@lo:400:kworker.0 Request processed in 2052us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305224.469105:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:2.0:1789305224.469408:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785809664 00000100:00100000:2.0:1789305224.469414:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785809664 00000100:00100000:2.0:1789305224.469464:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1789305224.469473:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785809664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305224.469512:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785809664:12345-0@lo:400:kworker.0 Request processed in 41us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305224.469518:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1789305224.469548:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785809664:0@lo:400:kworker.0 00000100:00080000:0.0:1789305224.469600:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305224.469963:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2b02d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785809408:0@lo:400:kworker.0 00000100:00100000:1.0:1789305224.469983:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785809920:0@lo:400:kworker.0 00000100:00100000:1.0:1789305224.470018:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305224.470331:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785810048:0@lo:400:kworker.0 00000100:00100000:0.0:1789305224.470361:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305224.470390:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876219785809536:0@lo:400:kworker.0 00000100:00100000:2.0:1789305224.470527:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785810048 00000100:00100000:2.0:1789305224.470531:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785810048 00000100:00100000:2.0:1789305224.470570:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1789305224.470578:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785810048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305224.470627:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785810048:12345-0@lo:400:kworker.0 Request processed in 51us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305224.470634:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:1.0:1789305224.470725:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785810048:0@lo:400:kworker.0 00000100:00100000:3.0:1789305224.470777:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785809920 00000100:00100000:3.0:1789305224.470782:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785809920 00000100:00100000:3.0:1789305224.470866:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:3.0:1789305224.470875:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785809920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305224.471005:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876219785809920:12345-0@lo:400:kworker.0 Request processed in 131us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305224.471013:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00080000:0.0:1789305224.471138:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305224.471369:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1876219785809920:0@lo:400:kworker.0 00010000:00010000:3.0:1789305224.530903:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305224.983189:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785810176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305224.983403:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305224.985597:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785810176 00000100:00100000:0.0:1789305224.985612:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785810176 00000100:00100000:0.0:1789305224.985712:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1789305224.985722:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785810176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305224.985782:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305224.985929:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785810176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 207us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305224.985937:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:2.0:1789305224.985972:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785810176:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789305225.340666:0:108114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25b: test nodemap info values ========= 09:13:44 (1789305224) 00000001:00100000:0.0:1789305225.546726:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0b597d4f-5f06-4326-afba-00059d8f9c97 00010000:00010000:1.0:1789305225.556172:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305225.571655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305225.571739:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305225.571789:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305225.571837:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305225.571865:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765725312 00000100:00100000:0.0:1789305225.571876:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765725312 00000100:00100000:0.0:1789305225.571942:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1922 00000100:00100000:0.0:1789305225.571954:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2355:x1876219765725312:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305225.572027:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2355:x1876219765725312:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305225.572035:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1922 00000100:00080000:0.0:1789305225.572055:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305225.573824:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765725440 00000100:00100000:3.0:1789305225.573836:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765725440 00000100:00100000:3.0:1789305225.573897:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765725568 00000100:00100000:3.0:1789305225.573901:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765725568 00000100:00100000:3.0:1789305225.573928:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1473 00000100:00100000:3.0:1789305225.573937:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2355:x1876219765725440:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305225.574004:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2355:x1876219765725440:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 68us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305225.574011:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1473 00000100:00100000:3.0:1789305225.574027:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1474 00000100:00100000:3.0:1789305225.574033:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b597d4f-5f06-4326-afba-00059d8f9c97+6:2355:x1876219765725568:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305225.574056:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b597d4f-5f06-4326-afba-00059d8f9c97+6:2355:x1876219765725568:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 23us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305225.574064:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1474 00000100:00080000:2.0:1789305225.574672:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789305225.574677:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305225.577067:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765725184 00000100:00100000:1.0:1789305225.577083:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765725184 00000001:00100000:3.0:1789305225.577459:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0b597d4f-5f06-4326-afba-00059d8f9c97 00000100:00100000:2.0:1789305225.579418:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1531 00000100:00100000:2.0:1789305225.579432:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:2355:x1876219765725184:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305225.579593:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:2355:x1876219765725184:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 164us (7948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305225.579601:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1531 00010000:00010000:3.0:1789305226.578461:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:1.0:1789305226.596308:0:108165:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1789305226.606580:0:108165:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000020:00000080:2.0:1789305227.287488:0:108213:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff67380ca0 20000000:00000080:2.0:1789305227.287511:0:108213:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36f57c00 uarg=0000000000000000 10000000:01000000:2.0:1789305227.290384:0:108213:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305227.290409:0:108213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305227.290429:0:108213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312982ba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb72312982b3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305227.290437:0:108213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305227.290477:0:108213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312982ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb72312982b3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305227.290493:0:108213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312982ba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb72312982b3 expref: 18 pid: 5846 timeout: 2776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305227.290510:0:108213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108213:1876219785810304:0@lo:104: 00000100:00100000:2.0:1789305227.290579:0:108213:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305227.290760:0:108213:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08ec8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789305227.291013:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785810304 00000100:00100000:0.0:1789305227.291021:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785810304 00000100:00100000:0.0:1789305227.292121:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1789305227.292139:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:108213:x1876219785810304:12345-0@lo:104: 00010000:00010000:0.0:1789305227.292156:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.292267:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305227.292273:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:108213:x1876219785810304:12345-0@lo:104: Request processed in 143us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305227.292281:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1789305227.292425:0:108213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108213:1876219785810304:0@lo:104: 00010000:00010000:3.0:1789305227.292449:0:108213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.292967:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305227.292976:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.292984:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305227.292989:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.292998:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305227.293006:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305227.293013:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789305227.293118:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.293126:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789305227.293188:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789305227.293251:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.293260:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd000/0xefc0bb72312982b3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb72312982ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.293280:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305227.293282:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305227.293284:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305227.293321:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785810432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305227.293375:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305227.293758:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785810432 00000100:00100000:0.0:1789305227.293769:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785810432 00010000:00010000:0.0:1789305227.293980:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312982ba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312982b3 expref: 19 pid: 5846 timeout: 2776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305227.294045:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1789305227.294054:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785810432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305227.294068:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305227.294073:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312982ba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb72312982b3 expref: 19 pid: 5846 timeout: 2776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294085:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312982ba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb72312982b3 expref: 19 pid: 5846 timeout: 2776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294124:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e400/0xefc0bb72312982ba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb72312982b3 expref: 19 pid: 5846 timeout: 2776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294139:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294147:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294165:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294171:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294177:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294184:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294189:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecce00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305227.294193:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294200:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294218:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305227.294226:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789305227.294278:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785810432:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305227.294285:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00010000:00010000:3.0:1789305227.294343:0:108213:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305227.294351:0:108213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305227.294356:0:108213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecce00/0xefc0bb72312982f9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305227.295451:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785810432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305227.603392:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789305228.005674:0:108261:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd5e729ea0 20000000:00000080:3.0:1789305228.005701:0:108261:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c37023800 uarg=0000000000000000 10000000:01000000:3.0:1789305228.005961:0:108261:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305228.005982:0:108261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.005998:0:108261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.006009:0:108261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.006016:0:108261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.006023:0:108261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.006031:0:108261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.006037:0:108261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305228.006041:0:108261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.006048:0:108261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.006059:0:108261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.006066:0:108261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.006072:0:108261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860f200/0xefc0bb7231298300 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789305228.622646:0:108311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc567a71f0 20000000:00000080:0.0:1789305228.622662:0:108311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c412ea000 uarg=0000000000000000 10000000:01000000:0.0:1789305228.623416:0:108311:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789305228.623439:0:108311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305228.623456:0:108311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305228.623468:0:108311:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305228.623475:0:108311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305228.623482:0:108311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305228.623490:0:108311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305228.623496:0:108311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb800 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305228.623501:0:108311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305228.623508:0:108311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305228.623522:0:108311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305228.623529:0:108311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305228.623536:0:108311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb800/0xefc0bb7231298307 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305228.628740:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789305229.074364:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789305229.074372:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789305229.074378:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789305229.074431:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.074444:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.074456:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305229.074486:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785810560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789305229.074588:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305229.074644:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08db5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789305229.074699:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785810560 00000100:00100000:2.0:1789305229.074708:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785810560 00000100:00100000:2.0:1789305229.074787:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:2.0:1789305229.074797:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785810560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305229.074810:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305229.074823:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298315 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129830e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305229.074845:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298315 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129830e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305229.074855:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298315 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129830e expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305229.074869:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecc200, rc 0) 00000100:00100000:2.0:1789305229.074908:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785810560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305229.074914:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:1.0:1789305229.075170:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785810560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305229.075189:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.075199:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305229.075218:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789305229.075223:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.075231:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305229.075404:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789305229.075416:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785810688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789305229.075449:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305229.075516:0:17936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785810688 00000100:00100000:2.0:1789305229.075521:0:17936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785810688 00000100:00100000:2.0:1789305229.075566:0:17936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1789305229.075573:0:17936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785810688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305229.075602:0:17936:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305229.075643:0:17936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785810688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305229.075649:0:17936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1789305229.075685:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785810688:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789305229.075745:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1789305229.232166:0:108359:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffef69d4bf0 20000000:00000080:2.0:1789305229.232183:0:108359:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36f55400 uarg=0000000000000000 10000000:01000000:2.0:1789305229.232392:0:108359:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305229.232411:0:108359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305229.232430:0:108359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298315 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129830e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305229.232438:0:108359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305229.232477:0:108359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298315 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129830e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305229.232514:0:108359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298315 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129830e expref: 18 pid: 5845 timeout: 2778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305229.232529:0:108359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108359:1876219785810816:0@lo:104: 00000100:00100000:2.0:1789305229.232590:0:108359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305229.232649:0:108359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08ec8000 going to sleep for 11 seconds 00000100:00100000:0.0:1789305229.232678:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785810816 00000100:00100000:0.0:1789305229.232686:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785810816 00000100:00100000:0.0:1789305229.232747:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1789305229.232757:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:108359:x1876219785810816:12345-0@lo:104: 00010000:00010000:0.0:1789305229.232770:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305229.232838:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305229.232844:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:108359:x1876219785810816:12345-0@lo:104: Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305229.232850:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00010000:00010000:3.0:1789305229.232921:0:5840:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789305229.232929:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.232937:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789305229.232942:0:5840:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.232951:0:5840:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789305229.232957:0:5840:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305229.232962:0:5840:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789305229.232997:0:5840:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233004:0:5840:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305229.233025:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233033:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860e400/0xefc0bb723129830e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298315 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305229.233042:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785810944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305229.233048:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305229.233050:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305229.233051:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305229.233073:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305229.233206:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785810944 00000100:00100000:3.0:1789305229.233211:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785810944 00010000:00010000:3.0:1789305229.233231:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298315 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129830e expref: 19 pid: 5845 timeout: 2778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305229.233267:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1789305229.233274:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785810944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305229.233284:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305229.233289:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298315 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129830e expref: 19 pid: 5845 timeout: 2778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233299:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298315 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129830e expref: 19 pid: 5845 timeout: 2778 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233313:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233533:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233545:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233550:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233554:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233558:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233561:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305229.233564:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233568:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233573:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305229.233580:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789305229.233612:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3313:x1876219785810944:12345-0@lo:103:ldlm_bl.0 Request processed in 338us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305229.233618:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1789305229.233646:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785810944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305229.234497:0:108359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc200/0xefc0bb7231298315 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129830e expref: 18 pid: 5845 timeout: 2778 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305229.234514:0:108359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108359:1876219785810816:0@lo:104: 00010000:00010000:2.0:1789305229.234529:0:108359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305229.234538:0:108359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305229.234544:0:108359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305229.234550:0:108359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd200/0xefc0bb723129831c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305229.588334:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785811200:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.588402:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305229.588453:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785811712:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.588479:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305229.588505:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789305229.588511:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785811072:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.588539:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305229.588561:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785811584:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.588583:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305229.588607:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785811328:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.588628:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305229.588646:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789305229.588650:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785811456:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.588670:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305229.588703:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785811200 00000100:00100000:1.0:1789305229.588709:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785811200 00000100:00100000:1.0:1789305229.588762:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785811584 00000100:00100000:1.0:1789305229.588776:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785811584 00000100:00100000:1.0:1789305229.588805:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785811456 00000100:00100000:1.0:1789305229.588808:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785811456 00000100:00100000:1.0:1789305229.588825:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:1.0:1789305229.588833:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785811200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.588883:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785811200:12345-0@lo:400:kworker.0 Request processed in 51us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305229.588890:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:1.0:1789305229.588909:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:1.0:1789305229.588915:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785811584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.588939:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785811584:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305229.588945:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:1.0:1789305229.588955:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:1.0:1789305229.588960:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785811456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.588987:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785811456:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305229.588993:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:1.0:1789305229.589009:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785811712 00000100:00100000:1.0:1789305229.589012:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785811712 00000100:00100000:1.0:1789305229.589034:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785811328 00000100:00100000:1.0:1789305229.589036:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785811328 00000100:00100000:1.0:1789305229.589055:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:1.0:1789305229.589060:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785811712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.589086:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2b02d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785811712:12345-0@lo:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305229.589121:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:1.0:1789305229.589131:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:1.0:1789305229.589137:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785811328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.589161:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785811328:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305229.589166:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:1.0:1789305229.589183:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785811072 00000100:00100000:1.0:1789305229.589187:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785811072 00000100:00100000:1.0:1789305229.589212:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:1.0:1789305229.589218:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785811072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.589247:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3315:x1876219785811072:12345-0@lo:400:kworker.0 Request processed in 29us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305229.589252:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00080000:1.0:1789305229.589292:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789305229.589297:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305229.589337:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785811456:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.589348:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785811328:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.589406:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:efa29217-37b2-4712-9233-afe8f4b7c3f7:3315:1876219785811072:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.589417:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785811584:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.589429:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785811200:0@lo:400:kworker.0 00000100:00100000:1.0:1789305229.589437:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785811712:0@lo:400:kworker.0 00010000:00010000:1.0:1789305229.650383:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789305229.801937:0:108408:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffddd815f50 20000000:00000080:1.0:1789305229.801955:0:108408:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02057400 uarg=0000000000000000 10000000:01000000:1.0:1789305229.802406:0:108408:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305229.802429:0:108408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.802444:0:108408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.802455:0:108408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.802461:0:108408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.802468:0:108408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.802475:0:108408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.802481:0:108408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789305229.802485:0:108408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.802494:0:108408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.802507:0:108408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.802515:0:108408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305229.802522:0:108408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298323 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305230.098380:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785811840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789305230.098472:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305230.098963:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785811840 00000100:00100000:0.0:1789305230.098971:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785811840 00000100:00100000:0.0:1789305230.099033:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1789305230.099043:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785811840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305230.099176:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305230.100688:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785811840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1641us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305230.100702:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1789305230.101227:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785811840:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789305230.355189:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789305230.355197:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789305230.355202:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789305230.355259:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.355276:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.355288:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305230.355458:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785811968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789305230.355540:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305230.355593:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785811968 00000100:00100000:2.0:1789305230.355601:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08ec8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789305230.355612:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785811968 00000100:00100000:0.0:1789305230.355675:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:0.0:1789305230.355685:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785811968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305230.355701:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305230.355727:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231298331 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129832a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305230.355760:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231298331 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129832a expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305230.355771:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231298331 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129832a expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305230.355783:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afba00, rc 0) 00000100:00100000:0.0:1789305230.355958:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785811968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 274us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305230.355965:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00100000:2.0:1789305230.356062:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785811968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305230.356077:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.356086:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789305230.356140:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789305230.356148:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.356156:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789305230.461406:0:108457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfe665f80 20000000:00000080:1.0:1789305230.461424:0:108457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2b02055c00 uarg=0000000000000000 10000000:01000000:1.0:1789305230.461828:0:108457:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305230.461848:0:108457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305230.461864:0:108457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231298331 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129832a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305230.461872:0:108457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305230.461910:0:108457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231298331 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129832a expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305230.461924:0:108457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231298331 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129832a expref: 18 pid: 5847 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305230.461939:0:108457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108457:1876219785812096:0@lo:104: 00000100:00100000:1.0:1789305230.462001:0:108457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305230.462338:0:108457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c38be8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789305230.462381:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785812096 00000100:00100000:0.0:1789305230.462389:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785812096 00000100:00100000:0.0:1789305230.462484:0:52683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1789305230.462495:0:52683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:108457:x1876219785812096:12345-0@lo:104: 00010000:00010000:0.0:1789305230.462509:0:52683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305230.462603:0:52683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789305230.462609:0:52683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:108457:x1876219785812096:12345-0@lo:104: Request processed in 117us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305230.462616:0:52683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1789305230.462677:0:108457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02ea9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108457:1876219785812096:0@lo:104: 00010000:00010000:1.0:1789305230.462696:0:108457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305230.462737:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789305230.462744:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305230.462757:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecd600 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789305230.462761:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305230.462769:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789305230.462776:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305230.462782:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789305230.462823:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305230.462830:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305230.462853:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305230.462860:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecd600/0xefc0bb723129832a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298331 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305230.462876:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305230.462878:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305230.462880:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305230.462888:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789305230.462899:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785812224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305230.462932:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305230.463035:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785812224 00000100:00100000:2.0:1789305230.463040:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785812224 00010000:00010000:2.0:1789305230.463071:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231298331 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129832a expref: 19 pid: 5847 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305230.463169:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1789305230.463353:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c2eb4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3312:x1876219785812224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789305230.463368:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789305230.463374:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231298331 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129832a expref: 19 pid: 5847 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463384:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231298331 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129832a expref: 19 pid: 5847 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463397:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afba00/0xefc0bb7231298331 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129832a expref: 19 pid: 5847 timeout: 2780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463410:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463418:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463431:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463439:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463446:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463452:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463457:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371200 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305230.463461:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463472:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463491:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305230.463500:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789305230.463536:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c2eb4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3312:x1876219785812224:12345-0@lo:103:ldlm_bl.0 Request processed in 361us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305230.463543:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00010000:00010000:3.0:1789305230.463607:0:108457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305230.463620:0:108457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305230.463625:0:108457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371200/0xefc0bb7231298338 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305230.464731:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:efa29217-37b2-4712-9233-afe8f4b7c3f7:3312:1876219785812224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305230.674246:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305230.691387:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305230.691647:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305230.691654:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765725824 00000100:00100000:1.0:1789305230.691664:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765725824 00000100:00100000:1.0:1789305230.691740:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1926 00000100:00100000:1.0:1789305230.691751:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2356:x1876219765725824:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305230.691828:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2356:x1876219765725824:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305230.691836:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1926 00000100:00080000:1.0:1789305230.691857:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305230.691933:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765726080 00000100:00100000:0.0:1789305230.691939:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765726080 00000100:00100000:0.0:1789305230.691980:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1477 00000100:00100000:0.0:1789305230.691988:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2356:x1876219765726080:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:1.0:1789305230.692070:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305230.692187:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1789305230.692220:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1789305230.692252:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765725696 00000100:00100000:1.0:1789305230.692257:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765725696 00000100:00100000:1.0:1789305230.692294:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1535 00000100:00100000:1.0:1789305230.692301:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:2356:x1876219765725696:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305230.692333:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c07bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:2356:x1876219765725696:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305230.692340:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1535 00000100:00100000:1.0:1789305230.692367:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765725952 00000100:00100000:1.0:1789305230.692371:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765725952 00000100:00100000:1.0:1789305230.692411:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1478 00000100:00100000:1.0:1789305230.692418:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2356:x1876219765725952:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305230.692444:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2356:x1876219765725952:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305230.692451:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1478 00000100:00080000:2.0:1789305230.692495:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789305230.692860:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2356:x1876219765726080:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 872us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305230.692866:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1477 00010000:00010000:0.0:1789305231.701971:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789305231.705845:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789305231.705853:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:2.0:1789305231.705858:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789305231.705901:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305231.705914:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305231.705926:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305231.705949:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785812352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789305231.706015:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305231.706130:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b01e16840 going to sleep for 11 seconds 00000100:00100000:0.0:1789305231.707986:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785812352 00000100:00100000:0.0:1789305231.707998:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785812352 00000100:00100000:0.0:1789305231.708050:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:0.0:1789305231.708060:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785812352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305231.708077:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789305231.708117:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231298346 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129833f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305231.708144:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231298346 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129833f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305231.708157:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231298346 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129833f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305231.708165:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c05afb600, rc 0) 00000100:00100000:0.0:1789305231.708230:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785812352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (2214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305231.708237:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:0.0:1789305231.708304:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785812352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305231.708320:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305231.708330:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305231.708350:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789305231.708356:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305231.708364:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789305232.610189:0:108605:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb33cabd0 20000000:00000080:3.0:1789305232.610209:0:108605:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c37021400 uarg=0000000000000000 10000000:01000000:3.0:1789305232.610417:0:108605:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305232.610437:0:108605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305232.610455:0:108605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231298346 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129833f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305232.610856:0:108605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305232.610901:0:108605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231298346 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129833f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305232.610917:0:108605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231298346 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129833f expref: 18 pid: 5846 timeout: 2782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305232.610932:0:108605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108605:1876219785812480:0@lo:104: 00000100:00100000:3.0:1789305232.611000:0:108605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305232.611138:0:108605:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2c2e90d480 going to sleep for 11 seconds 00000100:00100000:1.0:1789305232.612289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785812480 00000100:00100000:1.0:1789305232.612302:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785812480 00000100:00100000:1.0:1789305232.612404:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1789305232.612414:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:108605:x1876219785812480:12345-0@lo:104: 00010000:00010000:1.0:1789305232.612429:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.612516:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789305232.612522:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:108605:x1876219785812480:12345-0@lo:104: Request processed in 111us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305232.612528:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1789305232.612610:0:108605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108605:1876219785812480:0@lo:104: 00010000:00010000:3.0:1789305232.612631:0:108605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305232.614487:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789305232.614504:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305232.614516:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc400 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:0.0:1789305232.614521:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305232.614531:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789305232.614538:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305232.614544:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789305232.614608:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305232.614615:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789305232.614644:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305232.614652:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c40ecc400/0xefc0bb723129833f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298346 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305232.614679:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305232.614681:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305232.614683:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305232.614712:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785812608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789305232.614773:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305232.615342:0:57145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785812608 00000100:00100000:1.0:1789305232.615351:0:57145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785812608 00010000:00010000:1.0:1789305232.615461:0:57145:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231298346 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129833f expref: 19 pid: 5846 timeout: 2782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305232.615530:0:57145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1789305232.615541:0:57145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785812608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789305232.615674:0:57145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789305232.615681:0:57145:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231298346 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129833f expref: 19 pid: 5846 timeout: 2782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.615704:0:57145:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231298346 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129833f expref: 19 pid: 5846 timeout: 2782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.615719:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb600/0xefc0bb7231298346 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129833f expref: 19 pid: 5846 timeout: 2782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.615733:0:57145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.615742:0:57145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.615759:0:57145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.615766:0:57145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.615773:0:57145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.615779:0:57145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.615785:0:57145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860e400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789305232.615789:0:57145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.615799:0:57145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305232.615930:0:108605:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305232.615940:0:108605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.617302:0:57145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.617326:0:57145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860e400/0xefc0bb723129834d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305232.617348:0:57145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789305232.617450:0:57145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785812608:12345-0@lo:103:ldlm_bl.0 Request processed in 1908us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305232.617458:0:57145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789305232.617735:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785812608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305232.722532:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789305233.319395:0:108655:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc269dc910 20000000:00000080:1.0:1789305233.319414:0:108655:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c3f72d400 uarg=0000000000000000 10000000:01000000:1.0:1789305233.319994:0:108655:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789305233.320021:0:108655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.320041:0:108655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.320051:0:108655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.320059:0:108655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.320065:0:108655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.320072:0:108655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.320079:0:108655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41371600 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:1.0:1789305233.320083:0:108655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.320409:0:108655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.320424:0:108655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.320432:0:108655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.320439:0:108655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371600/0xefc0bb7231298354 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305233.746396:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789305234.194328:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789305234.194352:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785812736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789305234.194500:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305234.201946:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785812736 00000100:00100000:2.0:1789305234.202034:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785812736 00000100:00100000:2.0:1789305234.202190:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1789305234.202202:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785812736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305234.202242:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305234.202340:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785812736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (7840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305234.202348:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00080000:0.0:1789305234.202479:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789305234.206036:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c0573dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785812736:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1789305234.514151:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789305234.514158:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:3.0:1789305234.514163:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789305234.514209:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305234.514222:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305234.514234:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305234.514258:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785812864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789305234.514327:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305234.514376:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08b3fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789305234.514463:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785812864 00000100:00100000:1.0:1789305234.514471:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785812864 00000100:00100000:1.0:1789305234.514522:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:1.0:1789305234.514532:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785812864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305234.514545:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789305234.514559:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231298362 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129835b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305234.514584:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231298362 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129835b expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305234.514600:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231298362 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129835b expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305234.514609:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c41371a00, rc 0) 00000100:00100000:1.0:1789305234.515832:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c037e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785812864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1297us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305234.515844:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:3.0:1789305234.519209:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785812864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789305234.519237:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305234.519251:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305234.519273:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789305234.519279:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305234.519290:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305234.706529:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785812992:0@lo:400:kworker.0 00000100:00100000:0.0:1789305234.706596:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305234.710231:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785812992 00000100:00100000:1.0:1789305234.710245:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785812992 00000100:00100000:1.0:1789305234.710312:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:1.0:1789305234.710322:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785812992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305234.710415:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876219785812992:12345-0@lo:400:kworker.0 Request processed in 95us (3819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305234.710423:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:1.0:1789305234.710470:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876219785812992:0@lo:400:kworker.0 00000100:00100000:0.0:1789305234.710715:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785813376:0@lo:400:kworker.0 00000100:00100000:0.0:1789305234.710765:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305234.710803:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789305234.710808:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785813248:0@lo:400:kworker.0 00000100:00100000:0.0:1789305234.710826:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305234.710924:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785813376 00000100:00100000:3.0:1789305234.710928:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785813376 00000100:00100000:3.0:1789305234.710966:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785813248 00000100:00100000:3.0:1789305234.710969:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785813248 00000100:00100000:3.0:1789305234.710987:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1789305234.710993:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785813376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305234.711033:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876219785813376:12345-0@lo:400:kworker.0 Request processed in 40us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305234.711039:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1789305234.711051:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1789305234.711057:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c3fd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785813248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305234.711080:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c3fd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876219785813248:12345-0@lo:400:kworker.0 Request processed in 24us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305234.711085:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1789305234.711185:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1876219785813248:0@lo:400:kworker.0 00000100:00100000:3.0:1789305234.711194:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1876219785813376:0@lo:400:kworker.0 00000100:00080000:0.0:1789305234.711323:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305234.711623:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785813504:0@lo:400:kworker.0 00000100:00100000:1.0:1789305234.711657:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305234.711696:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789305234.711703:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785813120:0@lo:400:kworker.0 00000100:00100000:0.0:1789305234.711836:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785813504 00000100:00100000:0.0:1789305234.711842:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785813504 00000100:00100000:0.0:1789305234.711884:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:0.0:1789305234.711892:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785813504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305234.716948:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785813504:12345-0@lo:400:kworker.0 Request processed in 5046us (5279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305234.716964:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:1.0:1789305234.717133:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305234.717200:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785813504:0@lo:400:kworker.0 00000100:00100000:0.0:1789305234.717310:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785813120 00000100:00100000:0.0:1789305234.717317:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785813120 00000100:00100000:0.0:1789305234.717367:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:0.0:1789305234.717376:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785813120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789305234.717427:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876219785813120:12345-0@lo:400:kworker.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305234.717434:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00080000:0.0:1789305234.717452:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305234.723427:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1876219785813120:0@lo:400:kworker.0 00010000:00010000:0.0:1789305234.770207:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789305235.218425:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785813632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305235.218503:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305235.218929:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785813632 00000100:00100000:0.0:1789305235.218938:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785813632 00000100:00100000:0.0:1789305235.219021:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:0.0:1789305235.219031:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785813632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305235.219066:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305235.219152:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0573dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785813632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305235.219160:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1789305235.219237:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785813632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789305235.794408:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305235.816617:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305235.816766:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305235.816853:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305235.816881:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1789305235.816958:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765726208 00000100:00100000:0.0:1789305235.816968:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765726208 00000100:00100000:0.0:1789305235.817017:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1538 00000100:00100000:0.0:1789305235.817026:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:2355:x1876219765726208:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305235.817113:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:2355:x1876219765726208:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 88us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305235.817120:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1538 00000100:00100000:0.0:1789305235.817151:0:30980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765726336 00000100:00100000:0.0:1789305235.817155:0:30980:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765726336 00000100:00100000:0.0:1789305235.817192:0:30980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1930 00000100:00100000:0.0:1789305235.817198:0:30980:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2355:x1876219765726336:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305235.817229:0:30980:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36ead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2355:x1876219765726336:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305235.817235:0:30980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1930 00000100:00080000:0.0:1789305235.817350:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789305235.818556:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765726464 00000100:00100000:1.0:1789305235.818564:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765726464 00000100:00100000:1.0:1789305235.818643:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765726592 00000100:00100000:1.0:1789305235.818646:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765726592 00000100:00100000:0.0:1789305235.818684:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1481 00000100:00100000:0.0:1789305235.818694:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2355:x1876219765726464:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1789305235.818757:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2355:x1876219765726464:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 64us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305235.818764:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1481 00000100:00080000:3.0:1789305235.819832:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789305235.819838:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789305235.819955:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1482 00000100:00100000:1.0:1789305235.819967:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2355:x1876219765726592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1789305235.820015:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2355:x1876219765726592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 52us (3132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305235.820022:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1482 00000020:00000080:3.0:1789305236.045544:0:108851:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec0efa510 20000000:00000080:3.0:1789305236.045635:0:108851:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c37022400 uarg=0000000000000000 00010000:00010000:3.0:1789305236.045934:0:108851:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c3f698000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789305236.045944:0:108851:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c3f698000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789305236.045957:0:108851:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789305236.045975:0:108851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305236.045992:0:108851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231298362 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129835b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305236.046000:0:108851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305236.046034:0:108851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231298362 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb723129835b expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305236.046045:0:108851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231298362 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb723129835b expref: 18 pid: 5845 timeout: 2785 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305236.046056:0:108851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108851:1876219785813760:0@lo:104: 00000100:00100000:3.0:1789305236.046188:0:108851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305236.046291:0:108851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08b3fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789305236.046498:0:52683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785813760 00000100:00100000:0.0:1789305236.046505:0:52683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785813760 00000100:00100000:2.0:1789305236.046582:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1789305236.046593:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:108851:x1876219785813760:12345-0@lo:104: 00010000:00010000:2.0:1789305236.046606:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305236.046729:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789305236.046736:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:108851:x1876219785813760:12345-0@lo:104: Request processed in 146us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305236.046744:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00010000:00010000:1.0:1789305236.046815:0:8464:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789305236.046822:0:8464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305236.046829:0:8464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860f200 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:1.0:1789305236.046833:0:8464:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305236.046842:0:8464:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789305236.046850:0:8464:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305236.046855:0:8464:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1789305236.046894:0:108851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108851:1876219785813760:0@lo:104: 00010000:00010000:1.0:1789305236.046894:0:8464:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305236.046900:0:8464:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789305236.046913:0:108851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305236.046957:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785813888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789305236.046988:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305236.047027:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785813888 00000100:00100000:0.0:1789305236.047031:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785813888 00010000:00010000:1.0:1789305236.047035:0:8464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305236.047043:0:8464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c3860f200/0xefc0bb723129835b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298362 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047051:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231298362 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129835b expref: 19 pid: 5845 timeout: 2785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305236.047059:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305236.047060:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305236.047062:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789305236.047071:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1789305236.047078:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785813888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305236.047117:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789305236.047123:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231298362 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb723129835b expref: 19 pid: 5845 timeout: 2785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047134:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231298362 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb723129835b expref: 19 pid: 5845 timeout: 2785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047152:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c41371a00/0xefc0bb7231298362 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb723129835b expref: 19 pid: 5845 timeout: 2785 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047163:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047171:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047184:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047192:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047199:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047206:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047212:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c3860fa00 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:0.0:1789305236.047216:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047224:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047244:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305236.047257:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789305236.047297:0:108851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305236.047305:0:108851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305236.047311:0:108851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c3860fa00/0xefc0bb7231298369 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305236.048862:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785813888:12345-0@lo:103:ldlm_bl.0 Request processed in 1780us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305236.048873:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1789305236.048942:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785813888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789305236.819200:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789305237.597336:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789305237.597344:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:1.0:1789305237.597349:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789305237.597401:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305237.597413:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305237.597425:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789305237.597451:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785814016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789305237.597515:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305237.597609:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b08db59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789305237.600357:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785814016 00000100:00100000:2.0:1789305237.600373:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785814016 00000100:00100000:2.0:1789305237.601747:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:2.0:1789305237.601765:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785814016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305237.601783:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305237.601814:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231298377 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb7231298370 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305237.601842:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231298377 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb7231298370 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305237.601853:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231298377 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298370 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305237.601862:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecd400, rc 0) 00000100:00100000:2.0:1789305237.601938:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785814016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305237.601953:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1789305237.602047:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02eab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785814016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789305237.602065:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305237.602076:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789305237.602119:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789305237.602125:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305237.602132:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305237.842502:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789305238.866798:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789305239.029924:0:109048:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd8fc7c00 20000000:00000080:0.0:1789305239.029943:0:109048:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c06087800 uarg=0000000000000000 00010000:00010000:0.0:1789305239.030397:0:109048:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e2c3f698000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789305239.030412:0:109048:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e2c3f698000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789305239.030427:0:109048:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789305239.030445:0:109048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305239.030464:0:109048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231298377 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb7231298370 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305239.030471:0:109048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305239.030509:0:109048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231298377 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xefc0bb7231298370 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305239.030523:0:109048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231298377 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xefc0bb7231298370 expref: 18 pid: 5845 timeout: 2788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305239.030537:0:109048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109048:1876219785814144:0@lo:104: 00000100:00100000:0.0:1789305239.030597:0:109048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305239.030697:0:5835:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789305239.030711:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785814144 00000100:00100000:1.0:1789305239.030717:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785814144 00000100:00100000:1.0:1789305239.030773:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1789305239.030783:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c412ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:109048:x1876219785814144:12345-0@lo:104: 00010000:00010000:1.0:1789305239.030796:0:5835:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789305239.030848:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789305239.030855:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c412ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+3:109048:x1876219785814144:12345-0@lo:104: Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305239.030862:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00010000:00010000:3.0:1789305239.030889:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789305239.030898:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.030907:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c41370000 already unused, calling callback (ffffffffc1d83c20) 10000000:00010000:3.0:1789305239.030912:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.030921:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789305239.030929:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789305239.030936:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789305239.030977:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.030984:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789305239.031008:0:109048:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b03728300 going to sleep for 11 seconds 00010000:00010000:3.0:1789305239.031017:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031026:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9e2c41370000/0xefc0bb7231298370 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xefc0bb7231298377 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305239.031034:0:109048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109048:1876219785814144:0@lo:104: 00010000:00010000:3.0:1789305239.031045:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305239.031049:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789305239.031052:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789305239.031056:0:109048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305239.031061:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789305239.031077:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785814272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789305239.031136:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789305239.031477:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785814272 00000100:00100000:3.0:1789305239.031483:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785814272 00010000:00010000:3.0:1789305239.031504:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231298377 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298370 expref: 19 pid: 5845 timeout: 2788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305239.031532:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1789305239.031540:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:3314:x1876219785814272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789305239.031550:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789305239.031555:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231298377 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xefc0bb7231298370 expref: 19 pid: 5845 timeout: 2788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031567:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231298377 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xefc0bb7231298370 expref: 19 pid: 5845 timeout: 2788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031580:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecd400/0xefc0bb7231298377 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xefc0bb7231298370 expref: 19 pid: 5845 timeout: 2788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031593:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031601:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031614:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031621:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031628:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031652:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031657:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c05afb400 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:3.0:1789305239.031661:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031668:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031694:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789305239.031703:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789305239.031721:0:109048:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305239.031731:0:109048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305239.031738:0:109048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c05afb400/0xefc0bb723129837e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789305239.031742:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36eac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3314:x1876219785814272:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305239.031755:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1789305239.033148:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:efa29217-37b2-4712-9233-afe8f4b7c3f7:3314:1876219785814272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789305239.315164:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789305239.315191:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785814400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789305239.315277:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305239.315344:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785814400 00000100:00100000:2.0:1789305239.315353:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785814400 00000100:00100000:2.0:1789305239.315421:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:2.0:1789305239.315431:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785814400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789305239.315476:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789305239.315521:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c0361b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876219785814400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305239.315529:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:2.0:1789305239.315580:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1876219785814400:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789305239.315957:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789305239.827073:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785814528:0@lo:400:kworker.0 00000100:00100000:2.0:1789305239.827177:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305239.827242:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785815040:0@lo:400:kworker.0 00000100:00100000:2.0:1789305239.827270:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305239.827301:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785814784:0@lo:400:kworker.0 00000100:00100000:2.0:1789305239.827329:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305239.827363:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789305239.827370:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785814656:0@lo:400:kworker.0 00000100:00100000:2.0:1789305239.827392:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305239.827411:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785815168:0@lo:400:kworker.0 00000100:00100000:2.0:1789305239.827430:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789305239.827460:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785815040 00000100:00100000:2.0:1789305239.827468:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785815040 00000100:00100000:2.0:1789305239.827520:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785814656 00000100:00100000:2.0:1789305239.827523:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785814656 00000100:00100000:2.0:1789305239.827546:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:2.0:1789305239.827555:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785815040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305239.827608:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c03619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876219785815040:12345-0@lo:400:kworker.0 Request processed in 55us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305239.827616:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:2.0:1789305239.827647:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1789305239.827654:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785814656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789305239.828277:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876219785814656:12345-0@lo:400:kworker.0 Request processed in 621us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305239.828288:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00080000:2.0:1789305239.828314:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789305239.828410:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1876219785815040:0@lo:400:kworker.0 00000100:00100000:2.0:1789305239.828442:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876219785814656:0@lo:400:kworker.0 00000100:00100000:3.0:1789305239.828881:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785814912:0@lo:400:kworker.0 00000100:00100000:3.0:1789305239.828993:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789305239.829404:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785814784 00000100:00100000:1.0:1789305239.829412:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785814784 00000100:00100000:1.0:1789305239.829464:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785815168 00000100:00100000:1.0:1789305239.829468:0:17212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785815168 00000100:00100000:1.0:1789305239.829493:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:1.0:1789305239.829501:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785814784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305239.829563:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c36efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785814784:12345-0@lo:400:kworker.0 Request processed in 62us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305239.829571:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1789305239.829591:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785814784:0@lo:400:kworker.0 00000100:00100000:1.0:1789305239.829592:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:1.0:1789305239.829603:0:17212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785815168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789305239.829659:0:17212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876219785815168:12345-0@lo:400:kworker.0 Request processed in 58us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305239.829665:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:2.0:1789305239.829738:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1876219785815168:0@lo:400:kworker.0 00000100:00080000:3.0:1789305239.830257:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789305239.830296:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785814912 00000100:00100000:3.0:1789305239.830302:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785814912 00000100:00100000:3.0:1789305239.830350:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1789305239.830357:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785814912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305239.830406:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876219785814912:12345-0@lo:400:kworker.0 Request processed in 50us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305239.830413:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00080000:3.0:1789305239.830433:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789305239.830457:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c06234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1876219785814912:0@lo:400:kworker.0 00000100:00100000:3.0:1789305239.830501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785814528 00000100:00100000:3.0:1789305239.830505:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785814528 00000100:00100000:3.0:1789305239.830532:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:3.0:1789305239.830538:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785814528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789305239.830574:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:3313:x1876219785814528:12345-0@lo:400:kworker.0 Request processed in 35us (3397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305239.830580:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:3.0:1789305239.830634:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c36eac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:efa29217-37b2-4712-9233-afe8f4b7c3f7:3313:1876219785814528:0@lo:400:kworker.0 00010000:00010000:3.0:1789305239.890293:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789305239.896723:0:109096:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe21b3cd60 20000000:00000080:2.0:1789305239.896743:0:109096:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9e2c36f57c00 uarg=0000000000000000 10000000:01000000:2.0:1789305239.896976:0:109096:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789305239.896999:0:109096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305239.897015:0:109096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305239.897026:0:109096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305239.897033:0:109096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305239.897041:0:109096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305239.897048:0:109096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305239.897055:0:109096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e2c40ecc000 already unused, calling callback (ffffffffc17828b0) 00010000:00010000:2.0:1789305239.897061:0:109096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305239.897068:0:109096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305239.897081:0:109096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305239.898218:0:109096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305239.898225:0:109096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e2c40ecc000/0xefc0bb7231298385 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789305240.339908:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789305240.339934:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c02f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785815296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789305240.340010:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305240.342461:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785815296 00000100:00100000:0.0:1789305240.342476:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785815296 00000100:00100000:0.0:1789305240.342568:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1789305240.342579:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785815296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789305240.342626:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789305240.342717:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876219785815296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (2707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789305240.342725:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1789305240.342796:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c02f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1876219785815296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789305240.918634:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789305240.933246:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305240.933332:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305240.935318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305240.935355:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1789305240.935413:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765726848 00000100:00100000:3.0:1789305240.935427:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765726848 00000100:00100000:3.0:1789305240.935808:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1934 00000100:00100000:3.0:1789305240.935821:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2357:x1876219765726848:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1789305240.935909:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2357:x1876219765726848:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 91us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789305240.935918:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1934 00000100:00080000:3.0:1789305240.935940:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789305240.936338:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765726976 00000100:00100000:0.0:1789305240.936346:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765726976 00000100:00080000:3.0:1789305240.936502:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789305240.937833:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765726720 00000100:00100000:2.0:1789305240.937846:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765726720 00000100:00100000:2.0:1789305240.937891:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1541 00000100:00100000:2.0:1789305240.937899:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:2357:x1876219765726720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1789305240.937967:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0a20927-8136-42ab-80b0-31bbdbd3bd59+10:2357:x1876219765726720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 69us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305240.937974:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1541 00000100:00100000:1.0:1789305240.939656:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219765727104 00000100:00100000:1.0:1789305240.939779:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219765727104 00000100:00100000:1.0:1789305240.939902:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 699 00000100:00100000:1.0:1789305240.939912:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2353:x1876219765726976:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:1.0:1789305240.939940:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb72312982eb 00000100:00080000:1.0:1789305240.939951:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2b02ece800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789305240.939996:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1789305240.940327:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+2:2353:x1876219765726976:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 416us (7090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305240.940336:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 699 00000100:00100000:1.0:1789305240.940353:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 700 00000100:00100000:1.0:1789305240.940373:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+5:2353:x1876219765727104:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:1.0:1789305240.941051:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xefc0bb72312982f2 00000100:00080000:1.0:1789305240.941062:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9e2b02ecd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789305240.941157:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1789305240.941342:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c06237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0b597d4f-5f06-4326-afba-00059d8f9c97+2:2353:x1876219765727104:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 980us (8007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789305240.941350:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 700 00000100:00080000:3.0:1789305240.942057:0:5848:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789305240.942254:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789305240.942302:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789305241.043306:0:5849:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789305241.043315:0:5849:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e2c08b13380 from 1 10000000:01000000:0.0:1789305241.043320:0:5849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789305241.043368:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb723129838c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305241.043381:0:5849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb723129838c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305241.043397:0:5849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb723129838c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789305241.043423:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785815424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789305241.043490:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789305241.043553:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e2b03728180 going to sleep for 11 seconds 00000100:00100000:2.0:1789305241.043598:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876219785815424 00000100:00100000:2.0:1789305241.043608:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876219785815424 00000100:00100000:2.0:1789305241.043675:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1789305241.043685:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+18:5849:x1876219785815424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789305241.043698:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789305241.043712:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298393 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xefc0bb723129838c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305241.043737:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298393 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xefc0bb723129838c expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305241.043748:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e2c40ecde00/0xefc0bb7231298393 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xefc0bb723129838c expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305241.043757:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e2c40ecde00, rc 0) 00000100:00100000:2.0:1789305241.043808:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9e2c02eef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:efa29217-37b2-4712-9233-afe8f4b7c3f7+19:5849:x1876219785815424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789305241.043815:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:0.0:1789305241.043943:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e2c3fd86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:efa29217-37b2-4712-9233-afe8f4b7c3f7:5849:1876219785815424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789305241.043958:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb723129838c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298393 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305241.043968:0:5849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb723129838c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xefc0bb7231298393 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789305241.043986:0:5849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789305241.043991:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb723129838c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298393 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789305241.043999:0:5849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9e2c05afaa00/0xefc0bb723129838c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xefc0bb7231298393 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789305241.942082:0:8464:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789305242.573814:0:109240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-sec test_25b: @@@@@@ FAIL: nodemap info differs from get_param output (1) 00010000:00010000:2.0:1789305242.962320:0:5840:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 74104 lines, 74104 kept, 0 dropped, 0 bad.